-- Logs begin at Thu 2022-05-19 11:18:03 UTC, end at Thu 2022-05-19 12:41:24 UTC. -- May 19 11:54:05.216801 dv-cinder-804735-30-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 19 11:54:05.225708 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 11:54:05.227633 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 11:54:05 2022] *** May 19 11:54:05.227633 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 11:54:05.227633 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 11:54:05.227633 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: nodename: dv-cinder-804735-30-iscsi May 19 11:54:05.227633 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: machine: x86_64 May 19 11:54:05.227633 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: clock source: unix May 19 11:54:05.227633 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: pcre jit disabled May 19 11:54:05.227633 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: detected number of CPU cores: 4 May 19 11:54:05.227633 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: current working directory: / May 19 11:54:05.227633 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: detected binary path: /usr/bin/uwsgi-core May 19 11:54:05.227633 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: your processes number limit is 47680 May 19 11:54:05.228231 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: your memory page size is 4096 bytes May 19 11:54:05.228231 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: detected max file descriptor number: 2048 May 19 11:54:05.228231 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: lock engine: pthread robust mutexes May 19 11:54:05.228231 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: thunder lock: enabled May 19 11:54:05.228231 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 11:54:05.228231 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 11:54:05.272712 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: Python main interpreter initialized at 0x555bdb3299c0 May 19 11:54:05.272712 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: python threads support enabled May 19 11:54:05.272712 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: your server socket listen backlog is limited to 100 connections May 19 11:54:05.272712 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: your mercy for graceful operations on workers is 90 seconds May 19 11:54:05.273088 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: mapped 403077 bytes (393 KB) for 2 cores May 19 11:54:05.273167 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: *** Operational MODE: preforking *** May 19 11:54:05.273413 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: *** uWSGI is running in multiple interpreter mode *** May 19 11:54:05.273413 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: spawned uWSGI master process (pid: 80179) May 19 11:54:05.273615 dv-cinder-804735-30-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 19 11:54:05.274706 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: spawned uWSGI worker 1 (pid: 80189, cores: 1) May 19 11:54:05.274706 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: spawned uWSGI worker 2 (pid: 80190, cores: 1) May 19 11:54:05.274706 dv-cinder-804735-30-iscsi devstack@keystone.service[80179]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 11:54:10.922083 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 11:54:10.922083 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: from cryptography.utils import int_from_bytes May 19 11:54:10.922849 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 11:54:10.922849 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: from cryptography.utils import int_from_bytes May 19 11:54:10.927285 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 11:54:10.927285 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: from cryptography.utils import int_from_bytes May 19 11:54:10.927743 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 11:54:10.927743 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: from cryptography.utils import int_from_bytes May 19 11:54:10.972846 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 11:54:10.973043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 11:54:10.973237 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] command line args: [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 11:54:10.973511 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 11:54:10.973692 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ================================================================================ {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 11:54:10.973950 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] admin_token = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.974200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] config_dir = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.974387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.974570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] config_source = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.974752 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] debug = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.974952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.975207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 11:54:10.975325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 11:54:10.975407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.975473 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.975535 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] command line args: [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 11:54:10.975731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.975824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 11:54:10.975959 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ================================================================================ {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 11:54:10.976039 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.976219 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] admin_token = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.976345 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.976450 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] log_config_append = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.976552 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] config_dir = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.976656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.976755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.976851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] log_dir = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.976965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] config_source = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.977063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] log_file = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.977165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] debug = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.977289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.977371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.977474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.977548 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.977548 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.977731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.977804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.977921 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.978006 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.978084 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.978202 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.978283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.978391 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.978477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_config_append = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.978582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.978659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.978776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_dir = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.978850 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.978975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_file = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.979085 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.979175 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.979319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.979446 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.979554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.979638 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.979802 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.979946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.980078 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.980209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.980286 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.980349 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.980512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.980761 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.980841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.981000 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.981093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] publish_errors = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.981234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.981315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.981466 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.981571 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.981650 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.981726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.981902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.981988 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.982121 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.982207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.982354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] standard_threads = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.982440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.982587 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.982833 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.982906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.983057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.983129 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] publish_errors = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.983186 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] use_journal = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.983303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.983391 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] use_json = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.983507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] use_stderr = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.983583 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.983682 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] use_syslog = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.983757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.983936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.984089 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.984231 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.984360 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.984499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] standard_threads = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.984628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.984763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.984891 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.985038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.985185 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.985307 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.985435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.985568 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] use_journal = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.985568 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] use_json = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.985817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.985950 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] use_stderr = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.986077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.986205 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] use_syslog = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.986343 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.986482 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 11:54:10.986615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.986749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.986882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.987010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.987734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.987959 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.988090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.988225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.988355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.988483 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.988615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.988760 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.988889 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.989015 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.989147 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.989275 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.989409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.989545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.989684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.989817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.989944 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.990076 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.990203 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.990340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.990472 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.990609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.990737 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.990863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.990863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.991113 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.991241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.991368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.991497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.991630 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.991763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.991898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.991898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.992057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.992127 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.992197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.992276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.992357 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.992434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.992505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.992574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.992643 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.992711 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.992788 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.992859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.992927 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.993011 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.993083 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.993163 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.993331 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.993406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.993481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.993558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.993629 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.993709 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.993781 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.993856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.993926 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.993995 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.994063 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.994140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.994211 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.994304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.994382 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.994537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.994615 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.994770 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.994848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.995009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.995086 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.995253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.995335 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.995484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.995567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.995720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.995832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.995980 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.996083 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.996193 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.996292 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.996396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.996493 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.996626 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.996732 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.996863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.996942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.997104 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.997180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.997333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.997412 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.997568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.997688 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.997801 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.997882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.998018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.998095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.998247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.998367 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.998494 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.998579 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.998726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.998804 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.998963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.999041 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.999195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.999323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.999459 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.999590 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.999725 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:10.999859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.000017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.000152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.000283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.000407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.000531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.000677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.000817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.000941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.001066 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.001196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.001320 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.001457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.001593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.001724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.001846 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.001975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.002101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.002234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.002378 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.002505 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.002635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.002765 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.002893 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.003029 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.003166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.003298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.003427 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.003555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.003683 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.003811 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.003967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.004102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.004243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.004369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.004496 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.004699 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.004827 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.004957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.005086 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.005214 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.005342 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.005478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.005605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.005733 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.005897 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.006022 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.006099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.006180 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.006253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.006324 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.006394 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.006470 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.006590 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.006674 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.006748 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.006818 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.006888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.006966 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.007037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.007120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.007201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.007284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.007284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.007411 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.007481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.007551 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.007626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.007706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.007706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.007834 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.007964 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.008058 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.008202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.008332 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.008437 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.008598 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.008676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.008845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.008922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.009080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.external = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.009169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.009314 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.009391 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.009579 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.009667 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.009818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.009897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.010060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.password = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.010177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.010294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.token = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.010444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.010553 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.010692 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.010781 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.010929 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.external = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.011009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.011165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.011243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.011454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.011544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.011687 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.011802 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.011931 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.password = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.012024 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.012177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.token = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.012258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.012421 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.012500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.012662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.012741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.012909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.012989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.013142 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.013227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.013390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.013469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.013627 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.013708 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.013858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.013944 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.014096 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.014189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.014347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.014438 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.014597 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.014677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.014849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.014927 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.015087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.015173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.015332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.015411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.015568 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.015647 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.015836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.015935 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.016095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.016174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.016335 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.016415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.016586 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.016668 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.016835 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.016923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.017068 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.017147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.017319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.017400 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.017559 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.017638 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.017815 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.017894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.018038 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.018113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.018333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.018411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.018574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.018653 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.018824 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.018905 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.019061 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.019147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.019308 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.019387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.019548 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.019629 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.019783 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.019862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.020046 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.020128 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.020297 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.020379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.020528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.020607 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.020768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.020847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.021003 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.021083 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.021255 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.021334 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.021485 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.021563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.021717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.021798 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.021947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.022027 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.022193 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.022279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.022425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.022505 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.022663 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.022749 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.022915 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.023003 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.023166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.023246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.023398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.023477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.023640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.023727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.023874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.023981 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.024128 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.024207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.024368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.024459 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.024599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.024679 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.024836 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.024914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.025079 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.025166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.025319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.025397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.025568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.025647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.025799 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.025886 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.026033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.026111 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.026271 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.026350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.026502 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.026589 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.026738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.026818 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.026980 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.027059 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.027210 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.027296 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.027449 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.027529 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.027678 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.027756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.027964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.028059 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.028178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.028263 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.028413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.028491 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.028648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.028734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.028887 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.028966 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.029116 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.029195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.029355 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.029442 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.029586 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.029666 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.029819 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.029896 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.030053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.030139 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.030296 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.030375 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.030533 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.030610 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.030767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.030853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.031002 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.031080 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.031235 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.031314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.031473 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.031559 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.031705 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.031784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.031975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.032057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.032226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.032316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.032459 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.032538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.032695 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.032774 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.032934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.033020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.033164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.033242 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.033396 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.033475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.033631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.033712 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.034368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.034456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.034614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.034694 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.034862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.034941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.035108 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.035186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.035343 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.035421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.035577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.035658 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.035814 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.035893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.036068 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.036147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.036311 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.036391 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.036544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.036623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.036778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.036855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.037015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.037096 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.037248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.037327 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.037495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.037577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.037739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.037819 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.037972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.038051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.038217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.038296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.038444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.038522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.038679 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.038757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.038913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.038990 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.039145 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.039225 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.039380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.039458 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.039627 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.039710 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.039862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.039961 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.040131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.040210 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.040362 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.040440 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.040600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.040681 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.040835 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.040913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.041070 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.041149 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.041294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.041371 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.041542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.041628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.041785 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.041864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.042018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.042099 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.042254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.042334 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.042487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.042565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.042728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.042809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.042964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] role.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.043043 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.043196 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.043274 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] role.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.043433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.043513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.043690 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.043768 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.043963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.044084 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.044177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.044254 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.044418 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.044497 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.044657 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.044736 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.044892 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] role.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.044972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.045140 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] role.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.045219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.045637 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.045718 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.045870 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.045950 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.046121 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.046200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.046371 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.046457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.046619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.046697 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.046864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.046941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.047109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.047259 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.047360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.047495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.047610 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.047748 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.047827 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.048025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.048111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.048278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.048357 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.048527 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.048607 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.048762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.048843 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.049014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.049186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.049265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.049424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.049512 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.050235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.050375 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.050503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.050628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.050766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.050903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.051031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.051159 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.051286 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.051417 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.051542 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.051677 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.051804 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.051976 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.052103 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.052235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.052364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.052513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.052643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] token.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.052772 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.052901 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.053029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.053165 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.053296 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.053424 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.053553 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.053680 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.053808 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.053942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.054072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.054208 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.054338 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.054338 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.054580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.054715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.054862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.054940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.055012 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.055084 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.055155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.055235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.055309 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.055380 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.055451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.055522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.055592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.055671 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.055745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.055817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.055888 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.056022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.056104 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.056278 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.056359 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.056516 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.056596 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.connection = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.056756 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.056845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.056990 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.057070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.057239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.057319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.057479 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.057557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.057706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.057784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.057942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.058021 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.058183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.058262 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.058420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.058500 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.connection = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.058664 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.058757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.058901 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.058982 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.059144 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.059223 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.059387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.059513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.059635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.059728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.059870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.059967 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.060134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.060227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.060364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.060443 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.060605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.060685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.060840 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.060992 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.060992 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 11:54:11.061127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.061308 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.061558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.061794 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.062039 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.062280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.062522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.062759 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 11:54:11.062929 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 11:54:11.093330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.093568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.093796 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.099510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.099742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.099986 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.103209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.110029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.131692 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.131944 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.136429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.136664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.184775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.185320 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.238727 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.238956 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.239070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.239368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.304757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.304992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.305080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.305217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.305322 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.305439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.305522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.305658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.305739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.305876 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.305959 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.306106 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.328876 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.329031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.329130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.329208 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.329322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.329405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.329544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.329634 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.329765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.329846 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.329983 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.330064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.330200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.330288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.341985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.342251 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.355267 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.355503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.355733 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.356023 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.356216 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.356434 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.356653 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.356859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.357093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.357321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.357547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.357768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.357985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.358199 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 11:54:11.373846 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.374060 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 11:54:11.374224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.374400 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.374501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 11:54:11.374607 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 11:54:11.374758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.374876 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.374953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 11:54:11.375138 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.375226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.375396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.375477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.375645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.375720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.376411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.387038 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.387316 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.387585 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.387868 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.388431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.388706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.388973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.389255 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.396563 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.397895 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.399843 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.400147 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.400435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.400824 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.401110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.401217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.401375 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.401495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.401648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.401774 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.401927 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.402168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.402247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.402454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.402533 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.402717 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.402797 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.402989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.403266 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.403538 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.403810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.404100 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.430413 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.431894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.432523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.432841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.433274 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.433553 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.438903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.439131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.439243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.439411 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.439523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.439806 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.446746 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.447031 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.447159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.447439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.451657 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.451964 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.452072 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.452243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.452360 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.452523 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.452643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.452796 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.452930 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.453070 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.453209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.453337 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.453484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.453601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.453755 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.454026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.473328 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.473602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.473822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.474103 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.478123 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.478703 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.481765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.482060 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.482346 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.482641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.487044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.487673 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.490644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.491303 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.494368 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.494667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.494950 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.495187 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.495267 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.495498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.495580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.495780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.495948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.496151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.496527 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.496812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.514725 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.515100 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.515371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.515636 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.515775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.516183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.516459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.516727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.524112 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.525146 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.525818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.526096 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.526858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.527139 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.529154 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.529438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.529732 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.530020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.530192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.530297 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.530472 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.530761 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.531043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.531323 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.544240 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.544518 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.544809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.545093 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.545548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.545645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.545828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.545909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.546111 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.546191 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.546388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.546666 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.546949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.547238 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.564321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.565307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.567585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.568578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.570908 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.571882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.572538 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.573490 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.574174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.574461 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.574742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.575130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.575417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.575703 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.582699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.583599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.584317 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.585254 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.587531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.587819 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.588123 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.588404 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.588530 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.588771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.589053 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.589328 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.598147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.598431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.598709 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.599174 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.599505 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.599829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.606645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.606924 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.607203 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.607489 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.607743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 11:54:11.607869 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.608041 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.608180 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.608306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.608430 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.608580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.608706 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.608838 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.608964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.609115 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.609247 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.609449 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.609576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.609702 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.609825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.609957 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.610083 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.610215 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.610340 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.610465 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.610675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.610953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.611219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 11:54:11.649122 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555bdb3299c0 pid: 80190 (default app) May 19 11:54:11.650236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555bdb3299c0 pid: 80189 (default app) May 19 11:54:11.652439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c0cc0-896b-4518-b04f-71e9eae3b240 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:11.652736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c0cc0-896b-4518-b04f-71e9eae3b240 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:11.653019 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c0cc0-896b-4518-b04f-71e9eae3b240 None None] PATH_INFO: `/v3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:11.657231 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 791 bytes} [Thu May 19 11:54:11 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:19.537661 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4795b-17f4-47ec-bd0e-f0c9175b9c41 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:19.538206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4795b-17f4-47ec-bd0e-f0c9175b9c41 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:19.538206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4795b-17f4-47ec-bd0e-f0c9175b9c41 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:19.542507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1/2] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:54:19.548274 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcdf0c-09b1-4c76-9c7a-ba20ce2cb532 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:19.548694 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcdf0c-09b1-4c76-9c7a-ba20ce2cb532 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:19.548838 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcdf0c-09b1-4c76-9c7a-ba20ce2cb532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:19.616307 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: INFO dbcounter [None req-12bcdf0c-09b1-4c76-9c7a-ba20ce2cb532 None None] Registered counter for database keystone May 19 11:54:19.637546 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG oslo_db.sqlalchemy.engines [None req-12bcdf0c-09b1-4c76-9c7a-ba20ce2cb532 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 11:54:19.644294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writer thread running {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 11:54:19.818254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG passlib.handlers.bcrypt [None req-12bcdf0c-09b1-4c76-9c7a-ba20ce2cb532 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80190) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 11:54:19.818674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG passlib.handlers.bcrypt [None req-12bcdf0c-09b1-4c76-9c7a-ba20ce2cb532 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80190) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 11:54:19.873772 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-12bcdf0c-09b1-4c76-9c7a-ba20ce2cb532 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:19.875394 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-12bcdf0c-09b1-4c76-9c7a-ba20ce2cb532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:19.997962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 2/3] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 19 11:54:20.162087 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4795b-17f4-47ec-bd0e-f0c9175b9c41 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:20.231960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: INFO dbcounter [None req-fce4795b-17f4-47ec-bd0e-f0c9175b9c41 None None] Registered counter for database keystone May 19 11:54:20.250961 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG oslo_db.sqlalchemy.engines [None req-fce4795b-17f4-47ec-bd0e-f0c9175b9c41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 11:54:20.257688 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writer thread running {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 11:54:20.379578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4795b-17f4-47ec-bd0e-f0c9175b9c41 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:20.383778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13368544-c675-4a49-91df-9938030225ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:20.384475 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13368544-c675-4a49-91df-9938030225ba admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:20.384760 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13368544-c675-4a49-91df-9938030225ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:20.385035 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13368544-c675-4a49-91df-9938030225ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:20.393252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13368544-c675-4a49-91df-9938030225ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:20.444798 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: WARNING keystone.common.rbac_enforcer.enforcer [None req-13368544-c675-4a49-91df-9938030225ba admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 11:54:20.445137 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13368544-c675-4a49-91df-9938030225ba admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:20.454815 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 2/4] 10.222.0.73 () {58 vars in 1324 bytes} [Thu May 19 11:54:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 11:54:20.460766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcdf0c-09b1-4c76-9c7a-ba20ce2cb532 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:20.475076 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcdf0c-09b1-4c76-9c7a-ba20ce2cb532 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:20.479468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226781cb-55b5-40dd-beab-b8850dbe443f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:20.480621 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226781cb-55b5-40dd-beab-b8850dbe443f admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:20.480910 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226781cb-55b5-40dd-beab-b8850dbe443f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:20.481186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226781cb-55b5-40dd-beab-b8850dbe443f admin admin] PATH_INFO: `/v3/projects/df2a417664864d77b82ff77f60f05d0b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:20.482702 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226781cb-55b5-40dd-beab-b8850dbe443f admin admin] RBAC: Authorizing `identity:get_project(project_id=df2a417664864d77b82ff77f60f05d0b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:20.535056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: WARNING keystone.common.rbac_enforcer.enforcer [None req-226781cb-55b5-40dd-beab-b8850dbe443f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 11:54:20.535346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226781cb-55b5-40dd-beab-b8850dbe443f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:20.539836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 3/5] 10.222.0.73 () {56 vars in 1207 bytes} [Thu May 19 11:54:20 2022] GET /identity/v3/projects/df2a417664864d77b82ff77f60f05d0b => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:22.694016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897de4e9-113e-4239-aa1e-38c0b53a879d None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:22.694518 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897de4e9-113e-4239-aa1e-38c0b53a879d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:22.694518 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897de4e9-113e-4239-aa1e-38c0b53a879d None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:22.698577 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 3/6] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:22.703881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95721638-2171-49fd-a3b1-985e06c9e802 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:22.704278 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95721638-2171-49fd-a3b1-985e06c9e802 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:22.704483 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95721638-2171-49fd-a3b1-985e06c9e802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:22.724183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-95721638-2171-49fd-a3b1-985e06c9e802 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:22.725727 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-95721638-2171-49fd-a3b1-985e06c9e802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:22.733570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 4/7] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 11:54:22.754931 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897de4e9-113e-4239-aa1e-38c0b53a879d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:22.766933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897de4e9-113e-4239-aa1e-38c0b53a879d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:22.771682 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdf244-cb94-4437-bcfe-9e323618e32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:22.772351 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf244-cb94-4437-bcfe-9e323618e32e admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:22.772641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf244-cb94-4437-bcfe-9e323618e32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:22.772924 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf244-cb94-4437-bcfe-9e323618e32e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:22.780834 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdf244-cb94-4437-bcfe-9e323618e32e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:22.782621 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdf244-cb94-4437-bcfe-9e323618e32e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:22.792099 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 4/8] 10.222.0.73 () {58 vars in 1324 bytes} [Thu May 19 11:54:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 11:54:22.797394 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95721638-2171-49fd-a3b1-985e06c9e802 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:22.806194 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95721638-2171-49fd-a3b1-985e06c9e802 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:22.810568 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3ef8b-77e2-4062-92c4-b6c9ff61b0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:22.811421 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3ef8b-77e2-4062-92c4-b6c9ff61b0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:22.811712 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3ef8b-77e2-4062-92c4-b6c9ff61b0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:22.812031 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3ef8b-77e2-4062-92c4-b6c9ff61b0d8 admin admin] PATH_INFO: `/v3/users/dd72f905284743f09fbd1a8016bb1910` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:22.813453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3ef8b-77e2-4062-92c4-b6c9ff61b0d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=dd72f905284743f09fbd1a8016bb1910)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:22.815271 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3ef8b-77e2-4062-92c4-b6c9ff61b0d8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:22.816867 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 5/9] 10.222.0.73 () {56 vars in 1198 bytes} [Thu May 19 11:54:22 2022] GET /identity/v3/users/dd72f905284743f09fbd1a8016bb1910 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:25.061936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8b988-be78-4e6d-bcb7-0fb546ca2087 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:25.062469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8b988-be78-4e6d-bcb7-0fb546ca2087 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:25.062564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8b988-be78-4e6d-bcb7-0fb546ca2087 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:25.063859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 5/10] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:25.069502 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb76f1-d4ed-4c3f-ade9-35fddefa22a7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:25.069898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb76f1-d4ed-4c3f-ade9-35fddefa22a7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:25.070134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb76f1-d4ed-4c3f-ade9-35fddefa22a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:25.086355 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-45fb76f1-d4ed-4c3f-ade9-35fddefa22a7 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:25.087522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-45fb76f1-d4ed-4c3f-ade9-35fddefa22a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:25.119833 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a406af-b9ca-451e-9bac-ccfb57d2ea2a None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:25.120234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a406af-b9ca-451e-9bac-ccfb57d2ea2a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:25.120697 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a406af-b9ca-451e-9bac-ccfb57d2ea2a None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:25.122039 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 6/11] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:54:25.127120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c27bbc-df92-4cca-b7bb-774d645e3e83 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:25.127989 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c27bbc-df92-4cca-b7bb-774d645e3e83 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:25.128274 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c27bbc-df92-4cca-b7bb-774d645e3e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:25.166534 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG passlib.handlers.bcrypt [None req-52c27bbc-df92-4cca-b7bb-774d645e3e83 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80189) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 11:54:25.166958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG passlib.handlers.bcrypt [None req-52c27bbc-df92-4cca-b7bb-774d645e3e83 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80189) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 11:54:25.167671 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 6/12] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:54:25.192077 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb76f1-d4ed-4c3f-ade9-35fddefa22a7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:25.216799 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-52c27bbc-df92-4cca-b7bb-774d645e3e83 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:25.218376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:25.218509 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-52c27bbc-df92-4cca-b7bb-774d645e3e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:25.300123 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb76f1-d4ed-4c3f-ade9-35fddefa22a7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:25.319540 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 7/13] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:54:25.333854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427953e-1640-46a7-ad1f-8cf3d07f1aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:25.334655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427953e-1640-46a7-ad1f-8cf3d07f1aac None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:25.334939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427953e-1640-46a7-ad1f-8cf3d07f1aac None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:25.335216 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427953e-1640-46a7-ad1f-8cf3d07f1aac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:25.341074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c27bbc-df92-4cca-b7bb-774d645e3e83 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:25.346561 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427953e-1640-46a7-ad1f-8cf3d07f1aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:25.357721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-3427953e-1640-46a7-ad1f-8cf3d07f1aac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:54:25.357721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:25.357721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:25.357721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:25.357721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:25.357721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:25.357721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:25.357721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:25.357721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:25.357721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:25.357721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:25.357721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:25.357721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:25.357721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:25.357721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:25.357721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:25.358724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:25.358724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:25.358724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:25.358724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:25.358724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:25.358724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:25.358724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:25.358724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:25.358724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:25.358724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:25.358724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:25.358724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:54:25.358724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:25.358724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:25.358724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:25.358724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:25.359562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:25.359562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:25.359562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:25.359562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:25.359562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:25.359562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:25.359562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:25.359562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:25.359562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:25.359562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:25.359562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:54:25.359562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:54:25.359562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 7/14] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:54:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:54:25.365570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427953e-1640-46a7-ad1f-8cf3d07f1aac None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:25.557997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c27bbc-df92-4cca-b7bb-774d645e3e83 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:25.560316 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:25.563396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:25.583315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427953e-1640-46a7-ad1f-8cf3d07f1aac None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:25.596557 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f677201-66ff-4341-84c7-9e97ca2b342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:25.597516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f677201-66ff-4341-84c7-9e97ca2b342f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:25.598364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f677201-66ff-4341-84c7-9e97ca2b342f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:25.598645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f677201-66ff-4341-84c7-9e97ca2b342f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:25.617759 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ac0ad-6c9d-4b97-acde-1ba0b198eec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:25.618448 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ac0ad-6c9d-4b97-acde-1ba0b198eec7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:25.618731 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ac0ad-6c9d-4b97-acde-1ba0b198eec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:25.619011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ac0ad-6c9d-4b97-acde-1ba0b198eec7 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:25.619772 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ac0ad-6c9d-4b97-acde-1ba0b198eec7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:25.620105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ac0ad-6c9d-4b97-acde-1ba0b198eec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:25.621500 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ac0ad-6c9d-4b97-acde-1ba0b198eec7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:25.633156 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 8/15] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:54:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:54:25.638632 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ac0ad-6c9d-4b97-acde-1ba0b198eec7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:25.665961 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f677201-66ff-4341-84c7-9e97ca2b342f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:25.667503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f677201-66ff-4341-84c7-9e97ca2b342f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:25.735789 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ac0ad-6c9d-4b97-acde-1ba0b198eec7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:25.763358 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 8/16] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:54:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 11:54:25.768053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a8b83-6d20-4ff1-9ad6-3acf4c6c16a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:25.768931 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a8b83-6d20-4ff1-9ad6-3acf4c6c16a6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:25.769060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f677201-66ff-4341-84c7-9e97ca2b342f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:25.769220 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a8b83-6d20-4ff1-9ad6-3acf4c6c16a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:25.769991 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a8b83-6d20-4ff1-9ad6-3acf4c6c16a6 None admin] PATH_INFO: `/v3/users/dd72f905284743f09fbd1a8016bb1910` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:25.771291 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a8b83-6d20-4ff1-9ad6-3acf4c6c16a6 None admin] RBAC: Authorizing `identity:get_user(user_id=dd72f905284743f09fbd1a8016bb1910)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:25.772704 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:25.773099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a8b83-6d20-4ff1-9ad6-3acf4c6c16a6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:25.774945 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 9/17] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:25 2022] GET /identity/v3/users/dd72f905284743f09fbd1a8016bb1910 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:54:25.779850 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a8b83-6d20-4ff1-9ad6-3acf4c6c16a6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:25.795890 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:25.867032 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f677201-66ff-4341-84c7-9e97ca2b342f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:25.879647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a8b83-6d20-4ff1-9ad6-3acf4c6c16a6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:25.900005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff728eb-ec17-49ff-b12e-79d3de73a92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:25.900797 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff728eb-ec17-49ff-b12e-79d3de73a92b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:25.901084 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff728eb-ec17-49ff-b12e-79d3de73a92b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:25.901358 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff728eb-ec17-49ff-b12e-79d3de73a92b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:25.912791 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee4d4a-1154-472b-b67c-a1965ae16ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:25.913573 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee4d4a-1154-472b-b67c-a1965ae16ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:25.913858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee4d4a-1154-472b-b67c-a1965ae16ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:25.914131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee4d4a-1154-472b-b67c-a1965ae16ac6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:25.915303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee4d4a-1154-472b-b67c-a1965ae16ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:25.916768 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee4d4a-1154-472b-b67c-a1965ae16ac6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:25.918359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 10/18] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:54:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:54:25.920744 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff728eb-ec17-49ff-b12e-79d3de73a92b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:25.922186 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff728eb-ec17-49ff-b12e-79d3de73a92b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:25.924283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee4d4a-1154-472b-b67c-a1965ae16ac6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:25.944228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-eff728eb-ec17-49ff-b12e-79d3de73a92b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:54:25.944228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:25.944228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:25.944228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:25.944228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:25.944228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:25.944228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:25.944228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:25.944228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:25.944228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:25.944228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:25.944228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:25.944228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:54:25.944228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:54:25.944228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:54:25.945080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:54:25.945080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:25.945080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:25.945080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:25.945080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:25.945080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:25.945080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:25.945080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:25.945080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:54:25.945080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:25.945080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:25.945080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:25.945080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:25.945080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:25.945080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:25.945080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:25.945080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:25.945857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:54:25.945857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:54:25.945857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:54:25.945857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:54:25.945857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 9/19] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:54:25.951198 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff728eb-ec17-49ff-b12e-79d3de73a92b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:26.002988 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:26.006551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:26.023135 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee4d4a-1154-472b-b67c-a1965ae16ac6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:26.050252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff728eb-ec17-49ff-b12e-79d3de73a92b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:26.056009 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33f45b-a6cb-422e-8766-40767b4e5c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:26.056664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33f45b-a6cb-422e-8766-40767b4e5c53 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:26.056950 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33f45b-a6cb-422e-8766-40767b4e5c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:26.057241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33f45b-a6cb-422e-8766-40767b4e5c53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:26.058074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33f45b-a6cb-422e-8766-40767b4e5c53 None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.domain.id=default, user.id=dd72f905284743f09fbd1a8016bb1910) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:26.058383 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33f45b-a6cb-422e-8766-40767b4e5c53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:26.059819 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33f45b-a6cb-422e-8766-40767b4e5c53 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:26.067254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 11/20] 10.222.0.73 () {56 vars in 1322 bytes} [Thu May 19 11:54:25 2022] GET /identity/v3/role_assignments?user.id=dd72f905284743f09fbd1a8016bb1910&scope.domain.id=default&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:54:26.085148 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe221a8-cdc7-47de-9f85-a8634eb74cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:26.085851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe221a8-cdc7-47de-9f85-a8634eb74cba None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:26.086141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe221a8-cdc7-47de-9f85-a8634eb74cba None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:26.086426 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe221a8-cdc7-47de-9f85-a8634eb74cba None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:26.087191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe221a8-cdc7-47de-9f85-a8634eb74cba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:26.087509 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe221a8-cdc7-47de-9f85-a8634eb74cba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:26.089009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe221a8-cdc7-47de-9f85-a8634eb74cba None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:26.110409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 10/21] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:54:28.567377 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8503bab-470f-421e-8628-e453d79c2405 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:28.568311 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8503bab-470f-421e-8628-e453d79c2405 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:28.568736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8503bab-470f-421e-8628-e453d79c2405 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:28.570267 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 12/22] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:28.575599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0c27d-e570-4175-ab46-cb9d04718074 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:28.576374 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0c27d-e570-4175-ab46-cb9d04718074 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:28.576817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0c27d-e570-4175-ab46-cb9d04718074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:28.600162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5ee0c27d-e570-4175-ab46-cb9d04718074 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:28.601596 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5ee0c27d-e570-4175-ab46-cb9d04718074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:28.685307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 11/23] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:28.719418 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8503bab-470f-421e-8628-e453d79c2405 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:28.873928 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8503bab-470f-421e-8628-e453d79c2405 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:28.919058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6cdc1-1adf-4b4f-bbfe-4b7b5e9d1350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:28.919877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6cdc1-1adf-4b4f-bbfe-4b7b5e9d1350 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:28.924246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6cdc1-1adf-4b4f-bbfe-4b7b5e9d1350 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:28.924540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6cdc1-1adf-4b4f-bbfe-4b7b5e9d1350 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:28.936498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6cdc1-1adf-4b4f-bbfe-4b7b5e9d1350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:28.947614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f7f6cdc1-1adf-4b4f-bbfe-4b7b5e9d1350 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:54:28.947614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:28.947614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:28.947614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:28.947614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:28.947614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:28.947614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:28.947614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:28.947614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:28.947614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:28.947614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:28.947614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:28.947614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:28.947614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:28.947614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:28.947614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:28.948463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:28.948463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:28.948463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:28.948463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:28.948463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:28.948463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:28.948463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:28.948463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:28.948463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:28.948463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:28.948463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:28.948463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:54:28.948463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:28.948463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:28.948463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:28.948463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:28.949202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:28.949202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:28.949202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:28.949202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:28.949202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:28.949202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:28.949202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:28.949202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:28.949202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:28.949202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:28.949202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:54:28.949202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:54:28.950253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 13/24] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:54:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:28.954474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0c27d-e570-4175-ab46-cb9d04718074 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:29.011867 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8165a57-2378-42c0-90bd-098572874ca3 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:29.012547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8165a57-2378-42c0-90bd-098572874ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:29.013101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8165a57-2378-42c0-90bd-098572874ca3 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:29.016734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 14/25] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:29.023618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91fda5-3529-4e84-8d97-c9e1002e3cd1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:29.024177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91fda5-3529-4e84-8d97-c9e1002e3cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:29.024640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91fda5-3529-4e84-8d97-c9e1002e3cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:29.033282 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:29.036268 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:29.050742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-4b91fda5-3529-4e84-8d97-c9e1002e3cd1 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:29.052236 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4b91fda5-3529-4e84-8d97-c9e1002e3cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:29.099462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0c27d-e570-4175-ab46-cb9d04718074 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:29.130863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 15/26] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:29.157207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91fda5-3529-4e84-8d97-c9e1002e3cd1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:29.164668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98964860-0c10-495f-b323-d1944a5e9bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:29.165364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98964860-0c10-495f-b323-d1944a5e9bca None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:29.165648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98964860-0c10-495f-b323-d1944a5e9bca None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:29.165927 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98964860-0c10-495f-b323-d1944a5e9bca None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:29.166715 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98964860-0c10-495f-b323-d1944a5e9bca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:29.167013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98964860-0c10-495f-b323-d1944a5e9bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:29.168452 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98964860-0c10-495f-b323-d1944a5e9bca None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:29.181506 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 12/27] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:54:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:29.187159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98964860-0c10-495f-b323-d1944a5e9bca None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:29.301697 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98964860-0c10-495f-b323-d1944a5e9bca None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:29.312912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:29.328810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91fda5-3529-4e84-8d97-c9e1002e3cd1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:29.354737 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127c960-490d-43c9-a264-7b3d7f78c493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:29.355628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127c960-490d-43c9-a264-7b3d7f78c493 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:29.355940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127c960-490d-43c9-a264-7b3d7f78c493 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:29.356218 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127c960-490d-43c9-a264-7b3d7f78c493 None admin] PATH_INFO: `/v3/users/dd72f905284743f09fbd1a8016bb1910` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:29.358516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127c960-490d-43c9-a264-7b3d7f78c493 None admin] RBAC: Authorizing `identity:get_user(user_id=dd72f905284743f09fbd1a8016bb1910)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:29.360008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127c960-490d-43c9-a264-7b3d7f78c493 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:29.362023 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 13/28] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:29 2022] GET /identity/v3/users/dd72f905284743f09fbd1a8016bb1910 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:29.363762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5080c01-db88-4b46-8eb1-514f84d7e03e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:29.364098 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5080c01-db88-4b46-8eb1-514f84d7e03e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:29.364382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5080c01-db88-4b46-8eb1-514f84d7e03e None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:29.365793 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 14/29] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:29.382908 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d2ef4-2eed-420b-9de5-b2495b88900a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:29.383206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d2ef4-2eed-420b-9de5-b2495b88900a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:29.383494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d2ef4-2eed-420b-9de5-b2495b88900a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:29.407743 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a5115-3b92-4742-9963-6b53bebb30f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:29.408457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a5115-3b92-4742-9963-6b53bebb30f5 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:29.408745 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a5115-3b92-4742-9963-6b53bebb30f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:29.409023 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a5115-3b92-4742-9963-6b53bebb30f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:29.409804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a5115-3b92-4742-9963-6b53bebb30f5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:29.411265 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a5115-3b92-4742-9963-6b53bebb30f5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:29.414556 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-870d2ef4-2eed-420b-9de5-b2495b88900a None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:29.415771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-870d2ef4-2eed-420b-9de5-b2495b88900a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:29.418295 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:29.511638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 15/30] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:29.512554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d2ef4-2eed-420b-9de5-b2495b88900a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:29.621421 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 16/31] 10.222.0.73 () {60 vars in 1131 bytes} [Thu May 19 11:54:29 2022] POST /identity/v3/roles => generated 219 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:54:29.622974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f3115-955f-4b4d-bf1b-427119e4c045 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:29.623272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f3115-955f-4b4d-bf1b-427119e4c045 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:29.623557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f3115-955f-4b4d-bf1b-427119e4c045 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:29.626451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 17/32] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:29.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f3115-955f-4b4d-bf1b-427119e4c045 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:29.724758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d2ef4-2eed-420b-9de5-b2495b88900a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:29.741822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:29.806383 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f3115-955f-4b4d-bf1b-427119e4c045 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:29.830649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdabce9-a169-4508-9188-7ed7f49cf7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:29.831459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdabce9-a169-4508-9188-7ed7f49cf7cb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:29.831746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdabce9-a169-4508-9188-7ed7f49cf7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:29.832144 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdabce9-a169-4508-9188-7ed7f49cf7cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:29.833464 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdabce9-a169-4508-9188-7ed7f49cf7cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:29.834934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdabce9-a169-4508-9188-7ed7f49cf7cb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:29.836613 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 16/33] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:54:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:29.837972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7095d6-4270-4bb6-b192-4a969e4679c6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:29.838267 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7095d6-4270-4bb6-b192-4a969e4679c6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:29.838553 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7095d6-4270-4bb6-b192-4a969e4679c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:29.859901 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f961e-dcdf-4c35-bf35-6c645eb08e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:29.860429 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-dc7095d6-4270-4bb6-b192-4a969e4679c6 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:29.861326 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f961e-dcdf-4c35-bf35-6c645eb08e34 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:29.861665 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-dc7095d6-4270-4bb6-b192-4a969e4679c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:29.862055 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f961e-dcdf-4c35-bf35-6c645eb08e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:29.862570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f961e-dcdf-4c35-bf35-6c645eb08e34 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:29.864195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f961e-dcdf-4c35-bf35-6c645eb08e34 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:29.866128 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f961e-dcdf-4c35-bf35-6c645eb08e34 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:29.886401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 18/34] 10.222.0.73 () {60 vars in 1131 bytes} [Thu May 19 11:54:29 2022] POST /identity/v3/roles => generated 225 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:54:29.887536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f961e-dcdf-4c35-bf35-6c645eb08e34 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:29.968814 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:30.004512 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 17/35] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:30.024535 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f961e-dcdf-4c35-bf35-6c645eb08e34 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:30.052803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7095d6-4270-4bb6-b192-4a969e4679c6 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:30.066220 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb724d-79ed-4d66-9852-6f76c7ae57ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:30.068209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb724d-79ed-4d66-9852-6f76c7ae57ac None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:30.068811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb724d-79ed-4d66-9852-6f76c7ae57ac None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:30.069323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb724d-79ed-4d66-9852-6f76c7ae57ac None admin] PATH_INFO: `/v3/domains/default/users/dd72f905284743f09fbd1a8016bb1910/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:30.072002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb724d-79ed-4d66-9852-6f76c7ae57ac None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=dd72f905284743f09fbd1a8016bb1910, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:30.073809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb724d-79ed-4d66-9852-6f76c7ae57ac None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:30.096069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 19/36] 10.222.0.73 () {58 vars in 1361 bytes} [Thu May 19 11:54:29 2022] PUT /identity/v3/domains/default/users/dd72f905284743f09fbd1a8016bb1910/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:54:30.190574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43f0fa-c288-4b61-bf4a-dc66b8c091e2 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:30.190934 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43f0fa-c288-4b61-bf4a-dc66b8c091e2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:30.191165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43f0fa-c288-4b61-bf4a-dc66b8c091e2 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:30.192772 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 20/37] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:54:30.198688 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d70d3c-3182-443b-a244-4ef9a775914f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:30.198987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d70d3c-3182-443b-a244-4ef9a775914f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:30.199270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d70d3c-3182-443b-a244-4ef9a775914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:30.218169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a0d70d3c-3182-443b-a244-4ef9a775914f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:30.219755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a0d70d3c-3182-443b-a244-4ef9a775914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:30.220469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7095d6-4270-4bb6-b192-4a969e4679c6 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:30.225226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:30.267629 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521b9cf-c4cf-4381-b63c-a7b9c22d4fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:30.268859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521b9cf-c4cf-4381-b63c-a7b9c22d4fca None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:30.269388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521b9cf-c4cf-4381-b63c-a7b9c22d4fca None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:30.269870 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521b9cf-c4cf-4381-b63c-a7b9c22d4fca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:30.287634 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521b9cf-c4cf-4381-b63c-a7b9c22d4fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:30.291348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521b9cf-c4cf-4381-b63c-a7b9c22d4fca None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:30.317671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-1521b9cf-c4cf-4381-b63c-a7b9c22d4fca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:54:30.317671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:30.317671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:30.317671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:30.317671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:30.317671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:30.317671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:30.317671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:30.317671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:30.317671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:30.317671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:30.317671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:30.317671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:54:30.317671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:54:30.317671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:54:30.318499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:54:30.318499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:30.318499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:30.318499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:30.318499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:30.318499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:30.318499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:30.318499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:30.318499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:54:30.318499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:30.318499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:30.318499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:30.318499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:30.318499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:30.318499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:30.318499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:30.318499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:30.319291 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:54:30.319291 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:54:30.319291 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:54:30.319291 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:54:30.321107 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 18/38] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:54:30.327166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 21/39] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:54:30.329091 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521b9cf-c4cf-4381-b63c-a7b9c22d4fca None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:30.353077 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d70d3c-3182-443b-a244-4ef9a775914f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:30.409620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:30.467904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d70d3c-3182-443b-a244-4ef9a775914f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:30.473738 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521b9cf-c4cf-4381-b63c-a7b9c22d4fca None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:30.508521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570732b-6eac-4389-a29c-ec14f80fa5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:30.509648 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570732b-6eac-4389-a29c-ec14f80fa5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:30.509941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570732b-6eac-4389-a29c-ec14f80fa5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:30.510215 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570732b-6eac-4389-a29c-ec14f80fa5d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:30.511427 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570732b-6eac-4389-a29c-ec14f80fa5d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:30.512924 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570732b-6eac-4389-a29c-ec14f80fa5d6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:30.513318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7660a-abc4-4ab4-9c9a-8b02e62053e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:30.514054 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7660a-abc4-4ab4-9c9a-8b02e62053e1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:30.514403 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7660a-abc4-4ab4-9c9a-8b02e62053e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:30.514563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 22/40] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:54:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:54:30.514803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7660a-abc4-4ab4-9c9a-8b02e62053e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:30.515610 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7660a-abc4-4ab4-9c9a-8b02e62053e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:30.516024 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7660a-abc4-4ab4-9c9a-8b02e62053e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:30.517455 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7660a-abc4-4ab4-9c9a-8b02e62053e1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:30.520656 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570732b-6eac-4389-a29c-ec14f80fa5d6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:30.530510 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 19/41] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:30.535909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7660a-abc4-4ab4-9c9a-8b02e62053e1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:30.555288 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:30.639487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7660a-abc4-4ab4-9c9a-8b02e62053e1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:30.643408 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570732b-6eac-4389-a29c-ec14f80fa5d6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:30.658546 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:30.674959 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51729a68-17f9-4948-8892-85696dc7f236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:30.676266 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51729a68-17f9-4948-8892-85696dc7f236 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:30.676557 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51729a68-17f9-4948-8892-85696dc7f236 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:30.676953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51729a68-17f9-4948-8892-85696dc7f236 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:30.677687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51729a68-17f9-4948-8892-85696dc7f236 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:30.679141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51729a68-17f9-4948-8892-85696dc7f236 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:30.681745 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b4f08-8272-42c2-961c-2acd58082491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:30.682412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b4f08-8272-42c2-961c-2acd58082491 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:30.682702 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b4f08-8272-42c2-961c-2acd58082491 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:30.682987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b4f08-8272-42c2-961c-2acd58082491 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:30.683732 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b4f08-8272-42c2-961c-2acd58082491 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:30.685191 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b4f08-8272-42c2-961c-2acd58082491 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:30.716004 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 23/42] 10.222.0.73 () {60 vars in 1141 bytes} [Thu May 19 11:54:30 2022] POST /identity/v3/projects => generated 312 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:54:30.717671 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97257ac-d0ed-4c5d-b6dd-759db192dc2c None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:30.718213 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97257ac-d0ed-4c5d-b6dd-759db192dc2c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:30.718701 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97257ac-d0ed-4c5d-b6dd-759db192dc2c None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:30.720290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 24/43] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:30.729828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412fdff-d672-41bf-a056-762f41083203 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:30.730475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412fdff-d672-41bf-a056-762f41083203 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:30.730973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412fdff-d672-41bf-a056-762f41083203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:30.750832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f412fdff-d672-41bf-a056-762f41083203 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:30.752526 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f412fdff-d672-41bf-a056-762f41083203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:30.817626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 20/44] 10.222.0.73 () {60 vars in 1141 bytes} [Thu May 19 11:54:30 2022] POST /identity/v3/projects => generated 301 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:54:30.833294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 25/45] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:54:30.859613 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51729a68-17f9-4948-8892-85696dc7f236 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:30.947191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:30.992007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51729a68-17f9-4948-8892-85696dc7f236 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:31.029770 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340ffc5-1dfc-42c7-b18e-a4ddb644ae0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:31.030458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340ffc5-1dfc-42c7-b18e-a4ddb644ae0a None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:31.030751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340ffc5-1dfc-42c7-b18e-a4ddb644ae0a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:31.031037 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340ffc5-1dfc-42c7-b18e-a4ddb644ae0a None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:31.031816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340ffc5-1dfc-42c7-b18e-a4ddb644ae0a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:31.033413 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340ffc5-1dfc-42c7-b18e-a4ddb644ae0a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:31.050229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 21/46] 10.222.0.73 () {60 vars in 1131 bytes} [Thu May 19 11:54:30 2022] POST /identity/v3/roles => generated 223 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:54:32.433884 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe05ba-ed14-4ffb-a3f5-d629a722615f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:32.434381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe05ba-ed14-4ffb-a3f5-d629a722615f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:32.434486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe05ba-ed14-4ffb-a3f5-d629a722615f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:32.435834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 26/47] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:32.441212 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06188e8-5602-4042-b605-7757e72b5312 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:32.441590 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06188e8-5602-4042-b605-7757e72b5312 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:32.441789 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06188e8-5602-4042-b605-7757e72b5312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:32.458660 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c06188e8-5602-4042-b605-7757e72b5312 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:32.460226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c06188e8-5602-4042-b605-7757e72b5312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:32.525839 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 22/48] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:32.549248 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe05ba-ed14-4ffb-a3f5-d629a722615f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:32.643111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:32.651239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe05ba-ed14-4ffb-a3f5-d629a722615f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:32.685200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ee8fc-5808-428b-9635-6a534142ff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:32.686001 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ee8fc-5808-428b-9635-6a534142ff7f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:32.686286 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ee8fc-5808-428b-9635-6a534142ff7f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:32.686566 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ee8fc-5808-428b-9635-6a534142ff7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:32.696549 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ee8fc-5808-428b-9635-6a534142ff7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:32.704178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-901ee8fc-5808-428b-9635-6a534142ff7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:54:32.704178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:32.704178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:32.704178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:32.704178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:32.704178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:32.704178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:32.704178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:32.704178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:32.704178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:32.704178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:32.704178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:32.704178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:32.704178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:32.704178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:32.704178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:32.705153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:32.705153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:32.705153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:32.705153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:32.705153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:32.705153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:32.705153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:32.705153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:32.705153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:32.705153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:32.705153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:32.705153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:54:32.705153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:32.705153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:32.705153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:32.705153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:32.705967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:32.705967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:32.705967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:32.705967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:32.705967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:32.705967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:32.705967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:32.705967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:32.705967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:32.705967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:32.705967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:54:32.705967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:54:32.705967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 27/49] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:54:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:32.711484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06188e8-5602-4042-b605-7757e72b5312 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:32.767143 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:32.808260 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06188e8-5602-4042-b605-7757e72b5312 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:32.842716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0988ad0-05d2-49af-a327-71a40e288da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:32.843417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0988ad0-05d2-49af-a327-71a40e288da9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:32.843709 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0988ad0-05d2-49af-a327-71a40e288da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:32.844021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0988ad0-05d2-49af-a327-71a40e288da9 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:32.844814 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0988ad0-05d2-49af-a327-71a40e288da9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:32.845130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0988ad0-05d2-49af-a327-71a40e288da9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:32.846571 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0988ad0-05d2-49af-a327-71a40e288da9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:32.856750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 23/50] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:54:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:32.862398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ee8fc-5808-428b-9635-6a534142ff7f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:32.959572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ee8fc-5808-428b-9635-6a534142ff7f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:32.991652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a6eea-3c30-4a99-a411-54aaabc4c77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:32.992551 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a6eea-3c30-4a99-a411-54aaabc4c77b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:32.992836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a6eea-3c30-4a99-a411-54aaabc4c77b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:32.993110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a6eea-3c30-4a99-a411-54aaabc4c77b None admin] PATH_INFO: `/v3/users/dd72f905284743f09fbd1a8016bb1910` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:32.994296 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a6eea-3c30-4a99-a411-54aaabc4c77b None admin] RBAC: Authorizing `identity:get_user(user_id=dd72f905284743f09fbd1a8016bb1910)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:32.995754 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a6eea-3c30-4a99-a411-54aaabc4c77b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:32.997417 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 28/51] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:32 2022] GET /identity/v3/users/dd72f905284743f09fbd1a8016bb1910 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:33.002701 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0988ad0-05d2-49af-a327-71a40e288da9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:33.018647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d704607-a80a-42e4-babd-6ab48248fef8 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:33.018940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d704607-a80a-42e4-babd-6ab48248fef8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:33.019785 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d704607-a80a-42e4-babd-6ab48248fef8 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:33.021156 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 29/52] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:54:33.026160 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4d241-5b0e-4c91-ae00-a48c67621f6a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:33.026458 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4d241-5b0e-4c91-ae00-a48c67621f6a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:33.026745 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4d241-5b0e-4c91-ae00-a48c67621f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:33.043838 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6bd4d241-5b0e-4c91-ae00-a48c67621f6a None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:33.045061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6bd4d241-5b0e-4c91-ae00-a48c67621f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:33.061474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:33.107423 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0988ad0-05d2-49af-a327-71a40e288da9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:33.114395 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 30/53] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:54:33.126877 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:33.137849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4d241-5b0e-4c91-ae00-a48c67621f6a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:33.142362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de02ae8-fca4-403d-9742-9ca9aee3ca85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:33.143162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de02ae8-fca4-403d-9742-9ca9aee3ca85 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:33.143451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de02ae8-fca4-403d-9742-9ca9aee3ca85 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:33.143731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de02ae8-fca4-403d-9742-9ca9aee3ca85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:33.145415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de02ae8-fca4-403d-9742-9ca9aee3ca85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:33.146875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de02ae8-fca4-403d-9742-9ca9aee3ca85 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:33.148515 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 24/54] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:54:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:33.153917 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de02ae8-fca4-403d-9742-9ca9aee3ca85 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:33.233340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4d241-5b0e-4c91-ae00-a48c67621f6a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:33.252067 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de02ae8-fca4-403d-9742-9ca9aee3ca85 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:33.266344 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fba0d-61dd-44b7-899f-a4162d1d42f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:33.267135 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fba0d-61dd-44b7-899f-a4162d1d42f7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:33.267424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fba0d-61dd-44b7-899f-a4162d1d42f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:33.267706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fba0d-61dd-44b7-899f-a4162d1d42f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:33.268929 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fba0d-61dd-44b7-899f-a4162d1d42f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:33.270990 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fba0d-61dd-44b7-899f-a4162d1d42f7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:33.272629 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 31/55] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:54:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:54:33.277943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fba0d-61dd-44b7-899f-a4162d1d42f7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:33.285538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2503bb9-fa6a-471f-bc17-372408ba410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:33.286195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2503bb9-fa6a-471f-bc17-372408ba410e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:33.286491 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2503bb9-fa6a-471f-bc17-372408ba410e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:33.286807 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2503bb9-fa6a-471f-bc17-372408ba410e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:33.287894 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2503bb9-fa6a-471f-bc17-372408ba410e None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.domain.id=default, user.id=dd72f905284743f09fbd1a8016bb1910) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:33.287894 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2503bb9-fa6a-471f-bc17-372408ba410e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:33.289436 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2503bb9-fa6a-471f-bc17-372408ba410e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:33.301409 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:33.303424 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 25/56] 10.222.0.73 () {56 vars in 1322 bytes} [Thu May 19 11:54:33 2022] GET /identity/v3/role_assignments?user.id=dd72f905284743f09fbd1a8016bb1910&scope.domain.id=default&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:54:33.392358 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fba0d-61dd-44b7-899f-a4162d1d42f7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:33.429198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf65ee-b51e-4796-9910-9d5937223fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:33.429886 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf65ee-b51e-4796-9910-9d5937223fc6 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:33.430176 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf65ee-b51e-4796-9910-9d5937223fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:33.430455 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf65ee-b51e-4796-9910-9d5937223fc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:33.431186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf65ee-b51e-4796-9910-9d5937223fc6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:33.432710 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf65ee-b51e-4796-9910-9d5937223fc6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:33.459635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 32/57] 10.222.0.73 () {60 vars in 1140 bytes} [Thu May 19 11:54:33 2022] POST /identity/v3/projects => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:54:35.629581 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f2556-743a-47f2-8aa1-464a7d3d153b None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:35.630081 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f2556-743a-47f2-8aa1-464a7d3d153b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:35.630081 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f2556-743a-47f2-8aa1-464a7d3d153b None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:35.631438 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 26/58] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:35.636682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccac4b-b6d3-49a0-8c63-1c51aa44bfb3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:35.637045 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccac4b-b6d3-49a0-8c63-1c51aa44bfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:35.637252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccac4b-b6d3-49a0-8c63-1c51aa44bfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:35.654450 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-74ccac4b-b6d3-49a0-8c63-1c51aa44bfb3 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:35.655647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-74ccac4b-b6d3-49a0-8c63-1c51aa44bfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:35.721153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 33/59] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:35.745796 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f2556-743a-47f2-8aa1-464a7d3d153b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:35.799074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:35.845072 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f2556-743a-47f2-8aa1-464a7d3d153b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:35.877401 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf1efc-f8c4-48cb-9c7a-75ab488ddee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:35.878179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf1efc-f8c4-48cb-9c7a-75ab488ddee8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:35.878465 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf1efc-f8c4-48cb-9c7a-75ab488ddee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:35.878739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf1efc-f8c4-48cb-9c7a-75ab488ddee8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:35.879971 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf1efc-f8c4-48cb-9c7a-75ab488ddee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:35.881358 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf1efc-f8c4-48cb-9c7a-75ab488ddee8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:35.882963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 27/60] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:54:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:35.888339 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccac4b-b6d3-49a0-8c63-1c51aa44bfb3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:35.890528 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:35.984568 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccac4b-b6d3-49a0-8c63-1c51aa44bfb3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:36.016669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14692801-f662-454a-9e5d-4da847c8dd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:36.017337 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14692801-f662-454a-9e5d-4da847c8dd72 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:36.017622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14692801-f662-454a-9e5d-4da847c8dd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:36.017901 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14692801-f662-454a-9e5d-4da847c8dd72 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:36.018610 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14692801-f662-454a-9e5d-4da847c8dd72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:36.020633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14692801-f662-454a-9e5d-4da847c8dd72 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:36.045896 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 34/61] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:54:35 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:54:39.370475 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c561a-6422-40cc-8187-7b6f032a6b1e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:39.371039 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c561a-6422-40cc-8187-7b6f032a6b1e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:39.371039 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c561a-6422-40cc-8187-7b6f032a6b1e None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:39.374746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 28/62] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:39.380934 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e8861-1589-4442-b4d4-bd4bae959053 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:39.381742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e8861-1589-4442-b4d4-bd4bae959053 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:39.382172 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e8861-1589-4442-b4d4-bd4bae959053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:39.396978 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d2fb1-215e-4fe9-a3f5-218b7901b16a None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:39.397483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d2fb1-215e-4fe9-a3f5-218b7901b16a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:39.397911 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d2fb1-215e-4fe9-a3f5-218b7901b16a None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:39.399685 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 29/63] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:39.412116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039aba5-9764-4bc8-bdb5-cb58ead88055 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:39.412601 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039aba5-9764-4bc8-bdb5-cb58ead88055 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:39.413029 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039aba5-9764-4bc8-bdb5-cb58ead88055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:39.427772 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c08e8861-1589-4442-b4d4-bd4bae959053 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:39.430766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c08e8861-1589-4442-b4d4-bd4bae959053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:39.437685 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4039aba5-9764-4bc8-bdb5-cb58ead88055 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:39.444201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4039aba5-9764-4bc8-bdb5-cb58ead88055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:39.519842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:39.537401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 35/64] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:54:39.570611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e8861-1589-4442-b4d4-bd4bae959053 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:39.574271 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 30/65] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:54:39.597685 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039aba5-9764-4bc8-bdb5-cb58ead88055 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:39.700223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:39.742381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e8861-1589-4442-b4d4-bd4bae959053 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:39.782911 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039aba5-9764-4bc8-bdb5-cb58ead88055 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:39.798836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf7ed4-0274-490e-852d-f3f6993fa229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:39.799962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7ed4-0274-490e-852d-f3f6993fa229 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:39.801050 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7ed4-0274-490e-852d-f3f6993fa229 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:39.801885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7ed4-0274-490e-852d-f3f6993fa229 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:39.815010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf7ed4-0274-490e-852d-f3f6993fa229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:39.823766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cea5c-85cd-4862-b7d1-9f8f4655920d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:39.824596 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cea5c-85cd-4862-b7d1-9f8f4655920d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:39.824885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cea5c-85cd-4862-b7d1-9f8f4655920d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:39.825170 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cea5c-85cd-4862-b7d1-9f8f4655920d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:39.826029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-5ecf7ed4-0274-490e-852d-f3f6993fa229 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:54:39.826029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:39.826029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:39.826029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:39.826029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:39.826029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:39.826029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:39.826029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:39.826029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:39.826029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:39.826029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:39.826029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:39.826029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:39.826029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:39.826029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:39.826029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:39.826832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:39.826832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:39.826832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:39.826832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:39.826832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:39.826832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:39.826832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:39.826832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:39.826832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:39.826832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:39.826832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:39.826832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:54:39.826832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:39.826832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:39.826832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:39.826832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:39.827596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:39.827596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:39.827596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:39.827596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:39.827596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:39.827596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:39.827596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:39.827596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:39.827596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:39.827596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:39.827596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:54:39.827596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:54:39.829731 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 36/66] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:54:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:54:39.831477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aa6aa-24f2-4104-bf7c-d397e1035f4e None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:39.831934 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aa6aa-24f2-4104-bf7c-d397e1035f4e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:39.832362 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aa6aa-24f2-4104-bf7c-d397e1035f4e None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:39.834272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 37/67] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:39.835679 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7aa6aa-24f2-4104-bf7c-d397e1035f4e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:39.844458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cea5c-85cd-4862-b7d1-9f8f4655920d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:39.857166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-104cea5c-85cd-4862-b7d1-9f8f4655920d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:54:39.857166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:39.857166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:39.857166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:39.857166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:39.857166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:39.857166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:39.857166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:39.857166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:39.857166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:39.857166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:39.857166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:39.857166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:39.857166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:39.857166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:39.857166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:39.858051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:39.858051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:39.858051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:39.858051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:39.858051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:39.858051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:39.858051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:39.858051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:39.858051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:39.858051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:39.858051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:39.858051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:54:39.858051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:39.858051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:39.858051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:39.858051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:39.858784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:39.858784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:39.858784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:39.858784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:39.858784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:39.858784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:39.858784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:39.858784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:39.858784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:39.858784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:39.858784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:54:39.858784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:54:39.859363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 31/68] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:54:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:54:39.861058 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c0077-bfc1-4953-8143-d129ed7792d7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:39.861417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c0077-bfc1-4953-8143-d129ed7792d7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:39.861767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c0077-bfc1-4953-8143-d129ed7792d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:39.880540 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6d4c0077-bfc1-4953-8143-d129ed7792d7 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:39.882107 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6d4c0077-bfc1-4953-8143-d129ed7792d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:39.896387 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:39.958193 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7aa6aa-24f2-4104-bf7c-d397e1035f4e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:39.958704 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 32/69] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:39.959411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c0077-bfc1-4953-8143-d129ed7792d7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:40.003649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1e9ec-bc42-4873-9aed-2f4465b32827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:40.004346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1e9ec-bc42-4873-9aed-2f4465b32827 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:40.004634 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1e9ec-bc42-4873-9aed-2f4465b32827 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:40.004914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1e9ec-bc42-4873-9aed-2f4465b32827 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:40.005672 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1e9ec-bc42-4873-9aed-2f4465b32827 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:40.005799 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:40.005981 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1e9ec-bc42-4873-9aed-2f4465b32827 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:40.007480 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1e9ec-bc42-4873-9aed-2f4465b32827 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:40.016601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 38/70] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:54:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:40.018026 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf6e2f-71e3-4f37-b03a-266d3300dbe0 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:40.018321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf6e2f-71e3-4f37-b03a-266d3300dbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:40.018600 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf6e2f-71e3-4f37-b03a-266d3300dbe0 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:40.024188 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 39/71] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:40.024188 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf6e2f-71e3-4f37-b03a-266d3300dbe0 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:40.073882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c0077-bfc1-4953-8143-d129ed7792d7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:40.109714 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d152a57-5ad6-4ef2-9f5c-97fefb3c3016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:40.110387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d152a57-5ad6-4ef2-9f5c-97fefb3c3016 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:40.110676 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d152a57-5ad6-4ef2-9f5c-97fefb3c3016 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:40.110958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d152a57-5ad6-4ef2-9f5c-97fefb3c3016 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:40.111717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d152a57-5ad6-4ef2-9f5c-97fefb3c3016 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:40.112063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d152a57-5ad6-4ef2-9f5c-97fefb3c3016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:40.114007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d152a57-5ad6-4ef2-9f5c-97fefb3c3016 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:40.121958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 33/72] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:54:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:40.122738 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d152a57-5ad6-4ef2-9f5c-97fefb3c3016 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:40.130366 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf6e2f-71e3-4f37-b03a-266d3300dbe0 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:40.141823 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:40.165801 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a96400-70e3-4e0f-a383-9c062a7c9c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:40.166609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a96400-70e3-4e0f-a383-9c062a7c9c39 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:40.166896 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a96400-70e3-4e0f-a383-9c062a7c9c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:40.167173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a96400-70e3-4e0f-a383-9c062a7c9c39 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:40.178396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a96400-70e3-4e0f-a383-9c062a7c9c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:40.186440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-25a96400-70e3-4e0f-a383-9c062a7c9c39 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:54:40.186440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:40.186440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:40.186440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:40.186440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:40.186440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:40.186440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:40.186440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:40.186440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:40.186440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:40.186440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:40.186440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:40.186440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:40.186440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:40.186440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:40.186440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:40.187272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:40.187272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:40.187272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:40.187272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:40.187272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:40.187272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:40.187272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:40.187272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:40.187272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:40.187272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:40.187272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:40.187272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:54:40.187272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:40.187272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:40.187272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:40.187272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:40.192865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:40.192865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:40.192865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:40.192865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:40.192865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:40.192865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:40.192865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:40.192865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:40.192865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:40.192865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:40.192865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:54:40.192865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:54:40.192865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 40/73] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:54:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:40.192865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882220f1-c66c-4876-b1b0-ed3152e4c30a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:40.193510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882220f1-c66c-4876-b1b0-ed3152e4c30a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:40.193510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882220f1-c66c-4876-b1b0-ed3152e4c30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:40.207343 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-882220f1-c66c-4876-b1b0-ed3152e4c30a None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:40.208622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-882220f1-c66c-4876-b1b0-ed3152e4c30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:40.221369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d152a57-5ad6-4ef2-9f5c-97fefb3c3016 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:40.223649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:40.256414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eee43-32ad-48a7-ad88-fbc29f57d523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:40.257291 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eee43-32ad-48a7-ad88-fbc29f57d523 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:40.257592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eee43-32ad-48a7-ad88-fbc29f57d523 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:40.257875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eee43-32ad-48a7-ad88-fbc29f57d523 None admin] PATH_INFO: `/v3/users/dd72f905284743f09fbd1a8016bb1910` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:40.259092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eee43-32ad-48a7-ad88-fbc29f57d523 None admin] RBAC: Authorizing `identity:get_user(user_id=dd72f905284743f09fbd1a8016bb1910)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:40.260582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eee43-32ad-48a7-ad88-fbc29f57d523 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:40.262408 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 34/74] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:40 2022] GET /identity/v3/users/dd72f905284743f09fbd1a8016bb1910 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:40.263562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13df9a7-21a8-4d74-bf06-aabd3be23d7d None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:40.263857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13df9a7-21a8-4d74-bf06-aabd3be23d7d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:40.264241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13df9a7-21a8-4d74-bf06-aabd3be23d7d None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:40.265794 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 35/75] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:40.268718 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13df9a7-21a8-4d74-bf06-aabd3be23d7d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:40.274088 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 41/76] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:40.274932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882220f1-c66c-4876-b1b0-ed3152e4c30a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:40.380101 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13df9a7-21a8-4d74-bf06-aabd3be23d7d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:40.380796 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:40.384346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882220f1-c66c-4876-b1b0-ed3152e4c30a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:40.413906 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d2e27-63c6-4d5d-bde7-92873a895b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:40.414778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d2e27-63c6-4d5d-bde7-92873a895b50 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:40.415066 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d2e27-63c6-4d5d-bde7-92873a895b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:40.415345 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d2e27-63c6-4d5d-bde7-92873a895b50 None admin] PATH_INFO: `/v3/users/52e108f3ae264b08870ed1dfcfa54cbe` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:40.420066 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598d15e-739c-4e3f-bb86-24e113e34309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:40.420991 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598d15e-739c-4e3f-bb86-24e113e34309 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:40.421284 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598d15e-739c-4e3f-bb86-24e113e34309 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:40.421567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598d15e-739c-4e3f-bb86-24e113e34309 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:40.422322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598d15e-739c-4e3f-bb86-24e113e34309 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:40.422633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598d15e-739c-4e3f-bb86-24e113e34309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:40.424061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598d15e-739c-4e3f-bb86-24e113e34309 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:40.430536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d2e27-63c6-4d5d-bde7-92873a895b50 None admin] RBAC: Authorizing `identity:get_user(user_id=52e108f3ae264b08870ed1dfcfa54cbe)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:40.431908 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 42/77] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:54:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:40.432042 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d2e27-63c6-4d5d-bde7-92873a895b50 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:40.432738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598d15e-739c-4e3f-bb86-24e113e34309 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:40.437945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 36/78] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:40 2022] GET /identity/v3/users/52e108f3ae264b08870ed1dfcfa54cbe => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:40.437945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8063c-74fc-4662-9201-54ba96466eee None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:40.437945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8063c-74fc-4662-9201-54ba96466eee None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:40.437945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8063c-74fc-4662-9201-54ba96466eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:40.451242 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-cee8063c-74fc-4662-9201-54ba96466eee None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:40.452465 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cee8063c-74fc-4662-9201-54ba96466eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:40.475514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:40.518255 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 37/79] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:40.519567 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8063c-74fc-4662-9201-54ba96466eee None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:40.539352 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598d15e-739c-4e3f-bb86-24e113e34309 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:40.573669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dc40b-ca5c-4529-a81d-3b7ca101b252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:40.574328 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dc40b-ca5c-4529-a81d-3b7ca101b252 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:40.574619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dc40b-ca5c-4529-a81d-3b7ca101b252 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:40.574901 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dc40b-ca5c-4529-a81d-3b7ca101b252 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:40.604450 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:40.617745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8063c-74fc-4662-9201-54ba96466eee None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:40.642863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dc40b-ca5c-4529-a81d-3b7ca101b252 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:40.644923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dc40b-ca5c-4529-a81d-3b7ca101b252 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:40.651126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625166dc-6553-4692-8693-8609956e9960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:40.651939 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625166dc-6553-4692-8693-8609956e9960 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:40.652236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625166dc-6553-4692-8693-8609956e9960 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:40.652512 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625166dc-6553-4692-8693-8609956e9960 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:40.663072 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625166dc-6553-4692-8693-8609956e9960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:40.671130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-625166dc-6553-4692-8693-8609956e9960 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:54:40.671130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:40.671130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:40.671130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:40.671130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:40.671130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:40.671130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:40.671130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:40.671130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:40.671130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:40.671130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:40.671130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:40.671130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:40.671130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:40.671130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:40.671130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:40.672026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:40.672026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:40.672026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:40.672026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:40.672026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:40.672026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:40.672026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:40.672026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:40.672026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:40.672026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:40.672026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:40.672026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:54:40.672026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:40.672026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:40.672026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:40.672026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:40.672980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:40.672980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:40.672980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:40.672980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:40.672980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:40.672980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:40.672980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:40.672980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:40.672980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:40.672980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:40.672980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:54:40.672980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:54:40.672980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 38/80] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:54:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:40.673718 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625166dc-6553-4692-8693-8609956e9960 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:40.693173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:40.747586 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 43/81] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:54:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:54:40.748476 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dc40b-ca5c-4529-a81d-3b7ca101b252 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:40.777878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625166dc-6553-4692-8693-8609956e9960 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:40.807274 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:40.811126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2c615-ee08-4226-8a6d-bd49365c434f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:40.812045 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2c615-ee08-4226-8a6d-bd49365c434f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:40.812346 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2c615-ee08-4226-8a6d-bd49365c434f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:40.812630 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2c615-ee08-4226-8a6d-bd49365c434f None admin] PATH_INFO: `/v3/users/52e108f3ae264b08870ed1dfcfa54cbe` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:40.813854 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2c615-ee08-4226-8a6d-bd49365c434f None admin] RBAC: Authorizing `identity:get_user(user_id=52e108f3ae264b08870ed1dfcfa54cbe)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:40.815322 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2c615-ee08-4226-8a6d-bd49365c434f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:40.817543 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 39/82] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:40 2022] GET /identity/v3/users/52e108f3ae264b08870ed1dfcfa54cbe => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:40.818314 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2c615-ee08-4226-8a6d-bd49365c434f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:40.845950 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dc40b-ca5c-4529-a81d-3b7ca101b252 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:40.880120 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5d966-82c5-4d9d-897b-d2213dc92c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:40.880775 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5d966-82c5-4d9d-897b-d2213dc92c1f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:40.881064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5d966-82c5-4d9d-897b-d2213dc92c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:40.881349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5d966-82c5-4d9d-897b-d2213dc92c1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:40.902995 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:40.918298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2c615-ee08-4226-8a6d-bd49365c434f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:40.949997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5d966-82c5-4d9d-897b-d2213dc92c1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:40.951485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5d966-82c5-4d9d-897b-d2213dc92c1f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:40.952031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c1734-c35c-481b-9489-51482f02a80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:40.952824 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c1734-c35c-481b-9489-51482f02a80b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:40.953122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c1734-c35c-481b-9489-51482f02a80b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:40.953409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c1734-c35c-481b-9489-51482f02a80b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:40.954596 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c1734-c35c-481b-9489-51482f02a80b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:40.956067 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c1734-c35c-481b-9489-51482f02a80b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:40.957734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 40/83] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:54:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:40.958509 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c1734-c35c-481b-9489-51482f02a80b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:41.016392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:41.057495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 44/84] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:54:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:54:41.058327 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5d966-82c5-4d9d-897b-d2213dc92c1f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:41.061422 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c1734-c35c-481b-9489-51482f02a80b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:41.094734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531ee4b-04f6-4305-b7e6-beecaeef8a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:41.095406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531ee4b-04f6-4305-b7e6-beecaeef8a37 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:41.095696 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531ee4b-04f6-4305-b7e6-beecaeef8a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:41.096014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531ee4b-04f6-4305-b7e6-beecaeef8a37 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:41.096772 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531ee4b-04f6-4305-b7e6-beecaeef8a37 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:41.097114 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531ee4b-04f6-4305-b7e6-beecaeef8a37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:41.098501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531ee4b-04f6-4305-b7e6-beecaeef8a37 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:41.106483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 41/85] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:54:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:41.107272 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531ee4b-04f6-4305-b7e6-beecaeef8a37 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:41.126357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:41.156290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5d966-82c5-4d9d-897b-d2213dc92c1f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:41.190059 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc8cd1-868d-4311-a9e2-16ce53071fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:41.191446 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc8cd1-868d-4311-a9e2-16ce53071fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:41.191747 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc8cd1-868d-4311-a9e2-16ce53071fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:41.192058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc8cd1-868d-4311-a9e2-16ce53071fd9 None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:41.193260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc8cd1-868d-4311-a9e2-16ce53071fd9 None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:41.194713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc8cd1-868d-4311-a9e2-16ce53071fd9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:41.196442 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 45/86] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:41 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:41.197181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc8cd1-868d-4311-a9e2-16ce53071fd9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:41.207771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531ee4b-04f6-4305-b7e6-beecaeef8a37 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:41.227770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:41.241013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b855c45-c4c7-4366-864d-2c4c19417972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:41.241661 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b855c45-c4c7-4366-864d-2c4c19417972 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:41.241947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b855c45-c4c7-4366-864d-2c4c19417972 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:41.242227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b855c45-c4c7-4366-864d-2c4c19417972 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:41.297253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc8cd1-868d-4311-a9e2-16ce53071fd9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:41.309463 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b855c45-c4c7-4366-864d-2c4c19417972 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:41.310919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b855c45-c4c7-4366-864d-2c4c19417972 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:41.326999 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:41.331429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e64e2-9842-4fe1-a8a2-dcbf9105c7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:41.332142 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e64e2-9842-4fe1-a8a2-dcbf9105c7cb None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:41.332437 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e64e2-9842-4fe1-a8a2-dcbf9105c7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:41.332722 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e64e2-9842-4fe1-a8a2-dcbf9105c7cb None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:41.333438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e64e2-9842-4fe1-a8a2-dcbf9105c7cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:41.334877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e64e2-9842-4fe1-a8a2-dcbf9105c7cb None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:41.355169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 46/87] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:54:41 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:54:41.356778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e64e2-9842-4fe1-a8a2-dcbf9105c7cb None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:41.430492 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 42/88] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:54:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:54:41.431397 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b855c45-c4c7-4366-864d-2c4c19417972 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:41.469742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:41.490067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e64e2-9842-4fe1-a8a2-dcbf9105c7cb None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:41.528645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4f9cf-3d4c-4a4f-9ddf-67205b90f367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:41.529525 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4f9cf-3d4c-4a4f-9ddf-67205b90f367 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:41.529817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4f9cf-3d4c-4a4f-9ddf-67205b90f367 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:41.530104 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4f9cf-3d4c-4a4f-9ddf-67205b90f367 None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:41.531424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4f9cf-3d4c-4a4f-9ddf-67205b90f367 None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:41.532929 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4f9cf-3d4c-4a4f-9ddf-67205b90f367 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:41.535492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 47/89] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:41 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:41.536304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4f9cf-3d4c-4a4f-9ddf-67205b90f367 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:41.549276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b855c45-c4c7-4366-864d-2c4c19417972 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:41.567722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:41.591505 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f262c-79f3-442d-8e37-d08682653000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:41.592435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f262c-79f3-442d-8e37-d08682653000 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:41.592762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f262c-79f3-442d-8e37-d08682653000 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:41.593053 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f262c-79f3-442d-8e37-d08682653000 None admin] PATH_INFO: `/v3/users/52e108f3ae264b08870ed1dfcfa54cbe` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:41.594292 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f262c-79f3-442d-8e37-d08682653000 None admin] RBAC: Authorizing `identity:get_user(user_id=52e108f3ae264b08870ed1dfcfa54cbe)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:41.595757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f262c-79f3-442d-8e37-d08682653000 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:41.598288 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 43/90] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:41 2022] GET /identity/v3/users/52e108f3ae264b08870ed1dfcfa54cbe => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:41.599154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f262c-79f3-442d-8e37-d08682653000 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:41.654107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4f9cf-3d4c-4a4f-9ddf-67205b90f367 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:41.700321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a58792-cbf9-4c3f-b9b9-b55db7fccc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:41.700996 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a58792-cbf9-4c3f-b9b9-b55db7fccc22 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:41.701292 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a58792-cbf9-4c3f-b9b9-b55db7fccc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:41.701569 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a58792-cbf9-4c3f-b9b9-b55db7fccc22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:41.702436 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a58792-cbf9-4c3f-b9b9-b55db7fccc22 None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=c0e8ecfbb10647af9a7496598e58b208, user.id=dd72f905284743f09fbd1a8016bb1910) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:41.702764 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a58792-cbf9-4c3f-b9b9-b55db7fccc22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:41.704241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a58792-cbf9-4c3f-b9b9-b55db7fccc22 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:41.710751 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 48/91] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:54:41 2022] GET /identity/v3/role_assignments?user.id=dd72f905284743f09fbd1a8016bb1910&scope.project.id=c0e8ecfbb10647af9a7496598e58b208&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:41.711793 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a58792-cbf9-4c3f-b9b9-b55db7fccc22 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:41.732630 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f262c-79f3-442d-8e37-d08682653000 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:41.750822 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:41.772620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2714fcc-8195-4b17-9fe2-00136c8c9432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:41.773806 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2714fcc-8195-4b17-9fe2-00136c8c9432 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:41.774243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2714fcc-8195-4b17-9fe2-00136c8c9432 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:41.774697 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2714fcc-8195-4b17-9fe2-00136c8c9432 None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:41.776289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2714fcc-8195-4b17-9fe2-00136c8c9432 None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:41.777928 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2714fcc-8195-4b17-9fe2-00136c8c9432 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:41.779866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 44/92] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:41 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:41.780997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2714fcc-8195-4b17-9fe2-00136c8c9432 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:41.857953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a58792-cbf9-4c3f-b9b9-b55db7fccc22 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:41.900476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:41.911370 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db8788-06d5-426c-bc47-9f72483ac70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:41.912314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db8788-06d5-426c-bc47-9f72483ac70e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:41.912605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db8788-06d5-426c-bc47-9f72483ac70e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:41.912887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db8788-06d5-426c-bc47-9f72483ac70e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:41.914227 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db8788-06d5-426c-bc47-9f72483ac70e None admin] RBAC: Adding query filter params (role.id=0251662126f747ad9804858316f8573a, scope.project.id=c0e8ecfbb10647af9a7496598e58b208, user.id=52e108f3ae264b08870ed1dfcfa54cbe) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:41.914227 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db8788-06d5-426c-bc47-9f72483ac70e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:41.915750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db8788-06d5-426c-bc47-9f72483ac70e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:41.931320 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 49/93] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:54:41 2022] GET /identity/v3/role_assignments?user.id=52e108f3ae264b08870ed1dfcfa54cbe&scope.project.id=c0e8ecfbb10647af9a7496598e58b208&role.id=0251662126f747ad9804858316f8573a => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:41.932548 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db8788-06d5-426c-bc47-9f72483ac70e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:41.966594 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2714fcc-8195-4b17-9fe2-00136c8c9432 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:42.052711 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae290fc-8078-4663-9c0e-f22ea79e23f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:42.054351 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae290fc-8078-4663-9c0e-f22ea79e23f7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:42.054860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae290fc-8078-4663-9c0e-f22ea79e23f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:42.055335 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae290fc-8078-4663-9c0e-f22ea79e23f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:42.130167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:42.181381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db8788-06d5-426c-bc47-9f72483ac70e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:42.209897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae290fc-8078-4663-9c0e-f22ea79e23f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:42.211369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae290fc-8078-4663-9c0e-f22ea79e23f7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:42.262900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e0ffc-f076-4d78-be8a-015652bc4360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:42.263567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e0ffc-f076-4d78-be8a-015652bc4360 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:42.263852 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e0ffc-f076-4d78-be8a-015652bc4360 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:42.264153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e0ffc-f076-4d78-be8a-015652bc4360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:42.264996 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e0ffc-f076-4d78-be8a-015652bc4360 None admin] RBAC: Adding query filter params (role.id=a1fb3b01c7424cf18f71b9a2b8333f03, scope.project.id=c0e8ecfbb10647af9a7496598e58b208, user.id=52e108f3ae264b08870ed1dfcfa54cbe) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:42.265313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e0ffc-f076-4d78-be8a-015652bc4360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:42.266775 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e0ffc-f076-4d78-be8a-015652bc4360 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:42.289754 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 50/94] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:54:41 2022] GET /identity/v3/role_assignments?user.id=52e108f3ae264b08870ed1dfcfa54cbe&scope.project.id=c0e8ecfbb10647af9a7496598e58b208&role.id=a1fb3b01c7424cf18f71b9a2b8333f03 => generated 259 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:42.318801 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:42.403853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 45/95] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:54:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:54:42.409656 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e0ffc-f076-4d78-be8a-015652bc4360 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:42.557535 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e0ffc-f076-4d78-be8a-015652bc4360 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:42.613235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fe563-895f-4c23-8d8a-79f972452df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:42.614130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fe563-895f-4c23-8d8a-79f972452df1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:42.614417 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fe563-895f-4c23-8d8a-79f972452df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:42.614696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fe563-895f-4c23-8d8a-79f972452df1 None admin] PATH_INFO: `/v3/projects/7672a9b6a27040caac0e6f506d465588` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:42.615981 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fe563-895f-4c23-8d8a-79f972452df1 None admin] RBAC: Authorizing `identity:get_project(project_id=7672a9b6a27040caac0e6f506d465588)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:42.617443 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fe563-895f-4c23-8d8a-79f972452df1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:42.619467 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 51/96] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:42 2022] GET /identity/v3/projects/7672a9b6a27040caac0e6f506d465588 => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:42.624891 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae290fc-8078-4663-9c0e-f22ea79e23f7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:42.762910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae290fc-8078-4663-9c0e-f22ea79e23f7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:42.808501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f0369-4031-4bf9-a550-23f3efc24a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:42.809166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f0369-4031-4bf9-a550-23f3efc24a40 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:42.809456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f0369-4031-4bf9-a550-23f3efc24a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:42.809737 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f0369-4031-4bf9-a550-23f3efc24a40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:42.810582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f0369-4031-4bf9-a550-23f3efc24a40 None admin] RBAC: Adding query filter params (role.id=0251662126f747ad9804858316f8573a, scope.project.id=7672a9b6a27040caac0e6f506d465588, user.id=52e108f3ae264b08870ed1dfcfa54cbe) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:42.810898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f0369-4031-4bf9-a550-23f3efc24a40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:42.812374 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f0369-4031-4bf9-a550-23f3efc24a40 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:42.824521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 46/97] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:54:42 2022] GET /identity/v3/role_assignments?user.id=52e108f3ae264b08870ed1dfcfa54cbe&scope.project.id=7672a9b6a27040caac0e6f506d465588&role.id=0251662126f747ad9804858316f8573a => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:44.154816 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35bc2e-d01d-4656-a6ab-13566ddf7484 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:44.155382 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35bc2e-d01d-4656-a6ab-13566ddf7484 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:44.155382 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35bc2e-d01d-4656-a6ab-13566ddf7484 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:44.157036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 52/98] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:44.169911 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a6f8-17da-4c27-83a4-2d0b3fd1e717 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:44.170747 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a6f8-17da-4c27-83a4-2d0b3fd1e717 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:44.170747 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a6f8-17da-4c27-83a4-2d0b3fd1e717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:44.192163 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d823a6f8-17da-4c27-83a4-2d0b3fd1e717 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:44.193578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d823a6f8-17da-4c27-83a4-2d0b3fd1e717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:44.210179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:44.293172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 47/99] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:54:44.330173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35bc2e-d01d-4656-a6ab-13566ddf7484 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:44.345459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e325d18-994f-4a43-b901-5b2a93e4cb30 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:44.345459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e325d18-994f-4a43-b901-5b2a93e4cb30 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:44.345459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e325d18-994f-4a43-b901-5b2a93e4cb30 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:44.345459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 48/100] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:54:44.353588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe965300-7795-45bc-916e-943e1311f5c4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:44.354119 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe965300-7795-45bc-916e-943e1311f5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:44.354609 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe965300-7795-45bc-916e-943e1311f5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:44.357542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:44.374087 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fe965300-7795-45bc-916e-943e1311f5c4 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:44.376047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fe965300-7795-45bc-916e-943e1311f5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:44.454883 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 49/101] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:54:44.481007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe965300-7795-45bc-916e-943e1311f5c4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:44.564618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35bc2e-d01d-4656-a6ab-13566ddf7484 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:44.625570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf2fab-e8a9-4e1c-a1c4-202c2aed14c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:44.626516 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf2fab-e8a9-4e1c-a1c4-202c2aed14c6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:44.626880 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf2fab-e8a9-4e1c-a1c4-202c2aed14c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:44.627235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf2fab-e8a9-4e1c-a1c4-202c2aed14c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:44.632364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:44.644693 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf2fab-e8a9-4e1c-a1c4-202c2aed14c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:44.652830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-88bf2fab-e8a9-4e1c-a1c4-202c2aed14c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:54:44.652830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:44.652830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:44.652830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:44.652830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:44.652830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:44.652830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:44.652830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:44.652830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:44.652830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:44.652830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:44.652830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:44.652830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:44.652830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:44.652830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:44.652830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:44.653715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:44.653715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:44.653715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:44.653715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:44.653715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:44.653715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:44.653715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:44.653715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:44.653715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:44.653715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:44.653715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:44.653715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:54:44.653715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:44.653715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:44.653715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:44.653715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:44.654456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:44.654456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:44.654456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:44.654456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:44.654456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:44.654456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:44.654456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:44.654456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:44.654456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:44.654456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:44.654456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:54:44.654456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:54:44.656918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 53/102] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:54:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:44.665012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf2fab-e8a9-4e1c-a1c4-202c2aed14c6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:44.709086 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe965300-7795-45bc-916e-943e1311f5c4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:44.764906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:44.784834 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0eeffe-350f-40bf-b6a7-f2c5fb905fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:44.785925 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eeffe-350f-40bf-b6a7-f2c5fb905fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:44.786393 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eeffe-350f-40bf-b6a7-f2c5fb905fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:44.786972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eeffe-350f-40bf-b6a7-f2c5fb905fd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:44.790456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0eeffe-350f-40bf-b6a7-f2c5fb905fd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:44.792200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0eeffe-350f-40bf-b6a7-f2c5fb905fd6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:44.793625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf2fab-e8a9-4e1c-a1c4-202c2aed14c6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:44.795790 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 50/103] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:54:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:44.800377 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0eeffe-350f-40bf-b6a7-f2c5fb905fd6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:44.835413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfacfde-780b-4784-a979-02039184123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:44.836879 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfacfde-780b-4784-a979-02039184123e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:44.837372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfacfde-780b-4784-a979-02039184123e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:44.837837 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfacfde-780b-4784-a979-02039184123e None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:44.838805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfacfde-780b-4784-a979-02039184123e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:44.839298 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfacfde-780b-4784-a979-02039184123e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:44.841552 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfacfde-780b-4784-a979-02039184123e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:44.851928 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 54/104] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:54:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:44.857430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfacfde-780b-4784-a979-02039184123e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:44.978940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfacfde-780b-4784-a979-02039184123e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:44.997376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0eeffe-350f-40bf-b6a7-f2c5fb905fd6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:45.019767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8aa423-4b46-4e55-ad79-6fecab80c94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:45.021288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8aa423-4b46-4e55-ad79-6fecab80c94c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:45.021733 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8aa423-4b46-4e55-ad79-6fecab80c94c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:45.022184 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8aa423-4b46-4e55-ad79-6fecab80c94c None admin] PATH_INFO: `/v3/users/647894bd0bf945388be1fe8277e49550` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:45.026047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:45.038718 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8aa423-4b46-4e55-ad79-6fecab80c94c None admin] RBAC: Authorizing `identity:get_user(user_id=647894bd0bf945388be1fe8277e49550)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:45.040435 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8aa423-4b46-4e55-ad79-6fecab80c94c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:45.043051 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 55/105] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:44 2022] GET /identity/v3/users/647894bd0bf945388be1fe8277e49550 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:45.044612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987066e-440c-4edb-874c-7b8100152a65 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:45.045771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987066e-440c-4edb-874c-7b8100152a65 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:45.046201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987066e-440c-4edb-874c-7b8100152a65 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:45.047681 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 56/106] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:45.049260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987066e-440c-4edb-874c-7b8100152a65 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:45.081330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73295073-d856-4c60-84c2-757ff5002eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:45.082125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73295073-d856-4c60-84c2-757ff5002eb7 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:45.082428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73295073-d856-4c60-84c2-757ff5002eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:45.082721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73295073-d856-4c60-84c2-757ff5002eb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:45.083450 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73295073-d856-4c60-84c2-757ff5002eb7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:45.085077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73295073-d856-4c60-84c2-757ff5002eb7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:45.117651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:45.144197 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 51/107] 10.222.0.73 () {60 vars in 1141 bytes} [Thu May 19 11:54:44 2022] POST /identity/v3/projects => generated 302 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:54:45.145588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e207fc5-97ca-473a-a8a4-7fff0b8a1bff None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:45.145885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e207fc5-97ca-473a-a8a4-7fff0b8a1bff None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:45.146171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e207fc5-97ca-473a-a8a4-7fff0b8a1bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:45.169701 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2e207fc5-97ca-473a-a8a4-7fff0b8a1bff None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:45.171188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2e207fc5-97ca-473a-a8a4-7fff0b8a1bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:45.174330 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987066e-440c-4edb-874c-7b8100152a65 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:45.218325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b159b-c060-44a8-999c-87f180b49210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:45.219016 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b159b-c060-44a8-999c-87f180b49210 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:45.219313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b159b-c060-44a8-999c-87f180b49210 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:45.219606 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b159b-c060-44a8-999c-87f180b49210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:45.305467 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 52/108] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:45.328352 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:45.332494 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b159b-c060-44a8-999c-87f180b49210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:45.334630 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b159b-c060-44a8-999c-87f180b49210 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:45.335790 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a131e3-c2fe-4808-8f24-6063d73ce7db None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:45.336284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a131e3-c2fe-4808-8f24-6063d73ce7db None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:45.336782 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a131e3-c2fe-4808-8f24-6063d73ce7db None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:45.338615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 53/109] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:54:45.345079 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a131e3-c2fe-4808-8f24-6063d73ce7db None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:45.488990 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a131e3-c2fe-4808-8f24-6063d73ce7db None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:45.497850 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 57/110] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:54:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:54:45.499234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9614e-da94-4a6d-826e-2dbc8a345cb2 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:45.500015 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9614e-da94-4a6d-826e-2dbc8a345cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:45.500316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9614e-da94-4a6d-826e-2dbc8a345cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:45.519309 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:45.522991 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bfc9614e-da94-4a6d-826e-2dbc8a345cb2 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:45.524700 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bfc9614e-da94-4a6d-826e-2dbc8a345cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:45.530750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe79ad-078f-4bb3-8bdd-e2d6b31ee478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:45.531856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe79ad-078f-4bb3-8bdd-e2d6b31ee478 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:45.532379 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe79ad-078f-4bb3-8bdd-e2d6b31ee478 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:45.532886 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe79ad-078f-4bb3-8bdd-e2d6b31ee478 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:45.546406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe79ad-078f-4bb3-8bdd-e2d6b31ee478 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:45.555179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7cfe79ad-078f-4bb3-8bdd-e2d6b31ee478 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:54:45.555179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:45.555179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:45.555179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:45.555179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:45.555179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:45.555179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:45.555179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:45.555179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:45.555179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:45.555179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:45.555179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:45.555179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:45.555179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:45.555179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:45.555179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:45.556082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:45.556082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:45.556082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:45.556082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:45.556082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:45.556082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:45.556082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:45.556082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:45.556082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:45.556082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:45.556082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:45.556082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:54:45.556082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:45.556082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:45.556082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:45.556082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:45.556837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:45.556837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:45.556837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:45.556837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:45.556837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:45.556837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:45.556837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:45.556837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:45.556837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:45.556837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:45.556837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:54:45.556837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:54:45.559260 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 54/111] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:54:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:45.560269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe79ad-078f-4bb3-8bdd-e2d6b31ee478 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:45.613384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 58/112] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:45.614545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9614e-da94-4a6d-826e-2dbc8a345cb2 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:45.660171 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:45.692435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe79ad-078f-4bb3-8bdd-e2d6b31ee478 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:45.739792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b32e09-8132-4b3d-a12a-bd74c7b3f12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:45.745784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b32e09-8132-4b3d-a12a-bd74c7b3f12c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:45.745784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b32e09-8132-4b3d-a12a-bd74c7b3f12c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:45.745784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b32e09-8132-4b3d-a12a-bd74c7b3f12c None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:45.745784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b32e09-8132-4b3d-a12a-bd74c7b3f12c None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:45.745784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b32e09-8132-4b3d-a12a-bd74c7b3f12c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:45.746169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 55/113] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:45 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:45.746655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b32e09-8132-4b3d-a12a-bd74c7b3f12c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:45.762189 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9614e-da94-4a6d-826e-2dbc8a345cb2 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:45.813704 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:45.845207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84294d-b0b4-441d-bdb0-70ea4805eba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:45.845902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84294d-b0b4-441d-bdb0-70ea4805eba6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:45.846194 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84294d-b0b4-441d-bdb0-70ea4805eba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:45.846477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84294d-b0b4-441d-bdb0-70ea4805eba6 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:45.847815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84294d-b0b4-441d-bdb0-70ea4805eba6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:45.848160 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84294d-b0b4-441d-bdb0-70ea4805eba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:45.849577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84294d-b0b4-441d-bdb0-70ea4805eba6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:45.862739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 59/114] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:54:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:45.863892 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84294d-b0b4-441d-bdb0-70ea4805eba6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:45.866976 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b32e09-8132-4b3d-a12a-bd74c7b3f12c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:45.909002 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7b1be-58ec-4f07-8502-61e0837ac481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:45.910429 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7b1be-58ec-4f07-8502-61e0837ac481 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:45.910708 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7b1be-58ec-4f07-8502-61e0837ac481 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:45.910994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7b1be-58ec-4f07-8502-61e0837ac481 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:45.925826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7b1be-58ec-4f07-8502-61e0837ac481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:45.935861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b3f7b1be-58ec-4f07-8502-61e0837ac481 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:54:45.935861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:45.935861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:45.935861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:45.935861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:45.935861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:45.935861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:45.935861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:45.935861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:45.935861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:45.935861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:45.935861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:45.935861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:45.935861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:45.935861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:45.935861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:45.936878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:45.936878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:45.936878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:45.936878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:45.936878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:45.936878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:45.936878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:45.936878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:45.936878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:45.936878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:45.936878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:45.936878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:54:45.936878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:45.936878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:45.936878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:45.936878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:45.937615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:45.937615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:45.937615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:45.937615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:45.937615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:45.937615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:45.937615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:45.937615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:45.937615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:45.937615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:45.937615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:54:45.937615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:54:45.937615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 56/115] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:54:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:45.938746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7b1be-58ec-4f07-8502-61e0837ac481 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:46.053535 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:46.067975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7b1be-58ec-4f07-8502-61e0837ac481 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:46.085241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:46.087289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84294d-b0b4-441d-bdb0-70ea4805eba6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:46.111278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66bb09-542d-4243-92d6-ac48105e2ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:46.113408 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66bb09-542d-4243-92d6-ac48105e2ada None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:46.113701 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66bb09-542d-4243-92d6-ac48105e2ada None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:46.113984 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66bb09-542d-4243-92d6-ac48105e2ada None admin] PATH_INFO: `/v3/users/dd72f905284743f09fbd1a8016bb1910` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:46.115384 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66bb09-542d-4243-92d6-ac48105e2ada None admin] RBAC: Authorizing `identity:get_user(user_id=dd72f905284743f09fbd1a8016bb1910)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:46.116926 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66bb09-542d-4243-92d6-ac48105e2ada None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:46.123847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 57/116] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:45 2022] GET /identity/v3/users/dd72f905284743f09fbd1a8016bb1910 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:46.126696 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66bb09-542d-4243-92d6-ac48105e2ada None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:46.141771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1363c-1e69-4a97-ac57-10adfb26089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:46.143007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1363c-1e69-4a97-ac57-10adfb26089f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:46.144504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1363c-1e69-4a97-ac57-10adfb26089f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:46.145193 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1363c-1e69-4a97-ac57-10adfb26089f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:46.146376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1363c-1e69-4a97-ac57-10adfb26089f None admin] RBAC: Adding query filter params (role.id=75cb869182334e59ae0d8a7540e39b9b, scope.project.id=c0e8ecfbb10647af9a7496598e58b208, user.id=647894bd0bf945388be1fe8277e49550) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:46.147182 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1363c-1e69-4a97-ac57-10adfb26089f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:46.149318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1363c-1e69-4a97-ac57-10adfb26089f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:46.157940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 60/117] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:54:45 2022] GET /identity/v3/role_assignments?user.id=647894bd0bf945388be1fe8277e49550&scope.project.id=c0e8ecfbb10647af9a7496598e58b208&role.id=75cb869182334e59ae0d8a7540e39b9b => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:46.160086 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3908fdc-fb2d-4764-aa5a-7d589a6773b2 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:46.160611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3908fdc-fb2d-4764-aa5a-7d589a6773b2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:46.161154 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3908fdc-fb2d-4764-aa5a-7d589a6773b2 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:46.162716 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 61/118] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:46.163692 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3908fdc-fb2d-4764-aa5a-7d589a6773b2 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:46.291265 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3908fdc-fb2d-4764-aa5a-7d589a6773b2 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:46.354519 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66bb09-542d-4243-92d6-ac48105e2ada None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:46.360658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fc9bf-30eb-4348-9176-497ec040dd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:46.361553 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fc9bf-30eb-4348-9176-497ec040dd73 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:46.361843 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fc9bf-30eb-4348-9176-497ec040dd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:46.362116 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fc9bf-30eb-4348-9176-497ec040dd73 None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:46.368737 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fc9bf-30eb-4348-9176-497ec040dd73 None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:46.368737 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fc9bf-30eb-4348-9176-497ec040dd73 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:46.370385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 62/119] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:46 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:46.373961 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c8998-20b4-4c3f-b7f1-676730f0ba04 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:46.373961 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c8998-20b4-4c3f-b7f1-676730f0ba04 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:46.373961 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c8998-20b4-4c3f-b7f1-676730f0ba04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:46.413044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1c7c8998-20b4-4c3f-b7f1-676730f0ba04 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:46.414795 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1c7c8998-20b4-4c3f-b7f1-676730f0ba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:46.425422 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fcdc1-d75d-461b-8a03-57e9e17af7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:46.426106 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fcdc1-d75d-461b-8a03-57e9e17af7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:46.426394 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fcdc1-d75d-461b-8a03-57e9e17af7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:46.426675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fcdc1-d75d-461b-8a03-57e9e17af7b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:46.427450 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fcdc1-d75d-461b-8a03-57e9e17af7b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:46.427762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fcdc1-d75d-461b-8a03-57e9e17af7b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:46.430921 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fcdc1-d75d-461b-8a03-57e9e17af7b8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:46.433823 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:46.444591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 58/120] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:54:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:46.445418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fcdc1-d75d-461b-8a03-57e9e17af7b8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:46.501193 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 63/121] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:46.502635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c8998-20b4-4c3f-b7f1-676730f0ba04 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:46.505979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:46.591198 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fcdc1-d75d-461b-8a03-57e9e17af7b8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:46.631320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283a7a9-7d26-4fce-9c16-916bfcc1ad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:46.632600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283a7a9-7d26-4fce-9c16-916bfcc1ad92 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:46.633096 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283a7a9-7d26-4fce-9c16-916bfcc1ad92 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:46.633620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283a7a9-7d26-4fce-9c16-916bfcc1ad92 None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208/users/dd72f905284743f09fbd1a8016bb1910/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:46.636125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283a7a9-7d26-4fce-9c16-916bfcc1ad92 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0e8ecfbb10647af9a7496598e58b208, user_id=dd72f905284743f09fbd1a8016bb1910, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:46.637962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283a7a9-7d26-4fce-9c16-916bfcc1ad92 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:46.644416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c8998-20b4-4c3f-b7f1-676730f0ba04 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:46.654194 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 59/122] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:54:46 2022] PUT /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208/users/dd72f905284743f09fbd1a8016bb1910/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:54:46.655481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283a7a9-7d26-4fce-9c16-916bfcc1ad92 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:46.683846 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caf1dc-de44-43cb-9c9e-19c3d17750bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:46.684893 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caf1dc-de44-43cb-9c9e-19c3d17750bf None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:46.685227 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caf1dc-de44-43cb-9c9e-19c3d17750bf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:46.685568 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caf1dc-de44-43cb-9c9e-19c3d17750bf None admin] PATH_INFO: `/v3/users/52e108f3ae264b08870ed1dfcfa54cbe` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:46.687151 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caf1dc-de44-43cb-9c9e-19c3d17750bf None admin] RBAC: Authorizing `identity:get_user(user_id=52e108f3ae264b08870ed1dfcfa54cbe)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:46.688827 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caf1dc-de44-43cb-9c9e-19c3d17750bf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:46.691386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 64/123] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:46 2022] GET /identity/v3/users/52e108f3ae264b08870ed1dfcfa54cbe => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:46.697064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a00370-3ea6-4cde-9329-219412eb4e04 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:46.697360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a00370-3ea6-4cde-9329-219412eb4e04 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:46.697654 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a00370-3ea6-4cde-9329-219412eb4e04 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:46.699351 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 65/124] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:46.700187 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a00370-3ea6-4cde-9329-219412eb4e04 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:46.724739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:46.780577 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283a7a9-7d26-4fce-9c16-916bfcc1ad92 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:46.783452 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:46.821685 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191f6fa-64e7-4658-9f24-70090c373447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:46.822706 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191f6fa-64e7-4658-9f24-70090c373447 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:46.823004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191f6fa-64e7-4658-9f24-70090c373447 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:46.823317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191f6fa-64e7-4658-9f24-70090c373447 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:46.824293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a00370-3ea6-4cde-9329-219412eb4e04 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:46.838522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191f6fa-64e7-4658-9f24-70090c373447 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:46.848791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-1191f6fa-64e7-4658-9f24-70090c373447 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:54:46.848791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:46.848791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:46.848791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:46.848791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:46.848791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:46.848791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:46.848791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:46.848791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:46.848791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:46.848791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:46.848791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:46.848791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:46.848791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:46.848791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:46.848791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:46.849885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:46.849885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:46.849885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:46.849885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:46.849885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:46.849885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:46.849885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:46.849885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:46.849885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:46.849885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:46.849885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:46.849885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:54:46.849885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:46.849885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:46.849885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:46.849885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:46.850740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:46.850740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:46.850740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:46.850740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:46.850740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:46.850740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:46.850740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:46.850740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:46.850740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:46.850740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:46.850740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:54:46.850740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:54:46.850740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 60/125] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:54:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:46.850740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9aef07-db0a-4355-a9f1-bdf71590869c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:46.851481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9aef07-db0a-4355-a9f1-bdf71590869c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:46.851481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9aef07-db0a-4355-a9f1-bdf71590869c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:46.867203 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d8d75-304b-42e7-b49b-1a6931631f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:46.868368 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d8d75-304b-42e7-b49b-1a6931631f3c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:46.868817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d8d75-304b-42e7-b49b-1a6931631f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:46.869317 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d8d75-304b-42e7-b49b-1a6931631f3c None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:46.869987 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7d9aef07-db0a-4355-a9f1-bdf71590869c None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:46.870788 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d8d75-304b-42e7-b49b-1a6931631f3c None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:46.871197 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7d9aef07-db0a-4355-a9f1-bdf71590869c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:46.872656 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d8d75-304b-42e7-b49b-1a6931631f3c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:46.874555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 66/126] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:46 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:46.875477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d8d75-304b-42e7-b49b-1a6931631f3c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:46.949013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 61/127] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:46.949809 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9aef07-db0a-4355-a9f1-bdf71590869c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:46.980230 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:47.009390 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d8d75-304b-42e7-b49b-1a6931631f3c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:47.047674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb15fc-e944-404f-b1e5-307e591bc34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:47.048381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb15fc-e944-404f-b1e5-307e591bc34f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:47.048671 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb15fc-e944-404f-b1e5-307e591bc34f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:47.048953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb15fc-e944-404f-b1e5-307e591bc34f None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:47.049713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb15fc-e944-404f-b1e5-307e591bc34f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:47.050084 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb15fc-e944-404f-b1e5-307e591bc34f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:47.051992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb15fc-e944-404f-b1e5-307e591bc34f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:47.059796 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:47.060466 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 67/128] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:54:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:47.061505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb15fc-e944-404f-b1e5-307e591bc34f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:47.068492 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9aef07-db0a-4355-a9f1-bdf71590869c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:47.107828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388f5d8-88cb-4cd7-8d2b-8ccdae37bb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:47.109094 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388f5d8-88cb-4cd7-8d2b-8ccdae37bb58 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:47.109523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388f5d8-88cb-4cd7-8d2b-8ccdae37bb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:47.109969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388f5d8-88cb-4cd7-8d2b-8ccdae37bb58 None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208/users/52e108f3ae264b08870ed1dfcfa54cbe/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:47.112450 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388f5d8-88cb-4cd7-8d2b-8ccdae37bb58 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0e8ecfbb10647af9a7496598e58b208, user_id=52e108f3ae264b08870ed1dfcfa54cbe, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:47.114812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388f5d8-88cb-4cd7-8d2b-8ccdae37bb58 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:47.134878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 62/129] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:54:46 2022] PUT /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208/users/52e108f3ae264b08870ed1dfcfa54cbe/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:54:47.135940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388f5d8-88cb-4cd7-8d2b-8ccdae37bb58 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:47.177743 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb15fc-e944-404f-b1e5-307e591bc34f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:47.217293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031491d8-e1b5-4a0f-af46-7bacd135284c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:47.218167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031491d8-e1b5-4a0f-af46-7bacd135284c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:47.218745 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031491d8-e1b5-4a0f-af46-7bacd135284c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:47.218857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031491d8-e1b5-4a0f-af46-7bacd135284c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:47.231279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031491d8-e1b5-4a0f-af46-7bacd135284c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:47.240276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-031491d8-e1b5-4a0f-af46-7bacd135284c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:54:47.240276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:47.240276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:47.240276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:47.240276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:47.240276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:47.240276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:47.240276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:47.240276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:47.240276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:47.240276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:47.240276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:47.240276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:47.240276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:47.240276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:47.240276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:47.241468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:47.241468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:47.241468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:47.241468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:47.241468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:47.241468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:47.241468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:47.241468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:47.241468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:47.241468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:47.241468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:47.241468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:54:47.241468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:47.241468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:47.241468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:47.241468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:47.242300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:47.242300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:47.242300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:47.242300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:47.242300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:47.242300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:47.242300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:47.242300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:47.242300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:47.242300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:47.242300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:54:47.242300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:54:47.242300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 68/130] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:54:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:47.247854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031491d8-e1b5-4a0f-af46-7bacd135284c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:47.259949 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:47.284114 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388f5d8-88cb-4cd7-8d2b-8ccdae37bb58 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:47.336358 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de28de-e639-4b2e-a1f6-35958de4f625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:47.337531 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de28de-e639-4b2e-a1f6-35958de4f625 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:47.337983 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de28de-e639-4b2e-a1f6-35958de4f625 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:47.339112 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de28de-e639-4b2e-a1f6-35958de4f625 None admin] PATH_INFO: `/v3/users/52e108f3ae264b08870ed1dfcfa54cbe` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:47.341152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de28de-e639-4b2e-a1f6-35958de4f625 None admin] RBAC: Authorizing `identity:get_user(user_id=52e108f3ae264b08870ed1dfcfa54cbe)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:47.343575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de28de-e639-4b2e-a1f6-35958de4f625 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:47.346654 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 63/131] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:47 2022] GET /identity/v3/users/52e108f3ae264b08870ed1dfcfa54cbe => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:47.353020 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de28de-e639-4b2e-a1f6-35958de4f625 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:47.395892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:47.409983 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031491d8-e1b5-4a0f-af46-7bacd135284c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:47.493896 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a0acd-d61e-49e8-ab16-cb126ccce39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:47.494936 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a0acd-d61e-49e8-ab16-cb126ccce39c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:47.495618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a0acd-d61e-49e8-ab16-cb126ccce39c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:47.496106 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a0acd-d61e-49e8-ab16-cb126ccce39c None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:47.497028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a0acd-d61e-49e8-ab16-cb126ccce39c None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:47.497985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a0acd-d61e-49e8-ab16-cb126ccce39c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:47.499599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a0acd-d61e-49e8-ab16-cb126ccce39c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:47.509885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 69/132] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:54:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:54:47.512740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de28de-e639-4b2e-a1f6-35958de4f625 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:47.520474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a0acd-d61e-49e8-ab16-cb126ccce39c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:47.577930 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627007df-ba97-443a-b614-0fe846a44066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:47.578803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627007df-ba97-443a-b614-0fe846a44066 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:47.579091 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627007df-ba97-443a-b614-0fe846a44066 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:47.579373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627007df-ba97-443a-b614-0fe846a44066 None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:47.580596 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627007df-ba97-443a-b614-0fe846a44066 None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:47.582202 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627007df-ba97-443a-b614-0fe846a44066 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:47.585943 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 64/133] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:47 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:47.590633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627007df-ba97-443a-b614-0fe846a44066 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:47.604412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:47.671048 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a0acd-d61e-49e8-ab16-cb126ccce39c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:47.746787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabed7c-2bbf-4815-804a-468ceaccc8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:47.748049 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabed7c-2bbf-4815-804a-468ceaccc8fd None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:47.748562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabed7c-2bbf-4815-804a-468ceaccc8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:47.749052 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabed7c-2bbf-4815-804a-468ceaccc8fd None admin] PATH_INFO: `/v3/users/52e108f3ae264b08870ed1dfcfa54cbe` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:47.753871 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:47.754810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabed7c-2bbf-4815-804a-468ceaccc8fd None admin] RBAC: Authorizing `identity:get_user(user_id=52e108f3ae264b08870ed1dfcfa54cbe)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:47.756733 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabed7c-2bbf-4815-804a-468ceaccc8fd None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:47.758627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 70/134] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:47 2022] GET /identity/v3/users/52e108f3ae264b08870ed1dfcfa54cbe => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:47.763818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabed7c-2bbf-4815-804a-468ceaccc8fd None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:47.766621 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627007df-ba97-443a-b614-0fe846a44066 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:47.804806 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595ac7f-6778-4741-909e-c6802fcde469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:47.805975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595ac7f-6778-4741-909e-c6802fcde469 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:47.806400 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595ac7f-6778-4741-909e-c6802fcde469 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:47.806821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595ac7f-6778-4741-909e-c6802fcde469 None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208/users/52e108f3ae264b08870ed1dfcfa54cbe/roles/a1fb3b01c7424cf18f71b9a2b8333f03` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:47.809469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595ac7f-6778-4741-909e-c6802fcde469 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0e8ecfbb10647af9a7496598e58b208, user_id=52e108f3ae264b08870ed1dfcfa54cbe, role_id=a1fb3b01c7424cf18f71b9a2b8333f03)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:47.811141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595ac7f-6778-4741-909e-c6802fcde469 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:47.838383 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 65/135] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:54:47 2022] PUT /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208/users/52e108f3ae264b08870ed1dfcfa54cbe/roles/a1fb3b01c7424cf18f71b9a2b8333f03 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:54:47.943401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabed7c-2bbf-4815-804a-468ceaccc8fd None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:47.991878 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72691cea-34f2-42d2-a277-7c5152ee7106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:47.991878 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72691cea-34f2-42d2-a277-7c5152ee7106 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:47.991878 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72691cea-34f2-42d2-a277-7c5152ee7106 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:47.991878 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72691cea-34f2-42d2-a277-7c5152ee7106 None admin] PATH_INFO: `/v3/projects/7672a9b6a27040caac0e6f506d465588` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:47.998124 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72691cea-34f2-42d2-a277-7c5152ee7106 None admin] RBAC: Authorizing `identity:get_project(project_id=7672a9b6a27040caac0e6f506d465588)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:48.007939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72691cea-34f2-42d2-a277-7c5152ee7106 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:48.007939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 71/136] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:47 2022] GET /identity/v3/projects/7672a9b6a27040caac0e6f506d465588 => generated 312 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:54:48.015180 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595ac7f-6778-4741-909e-c6802fcde469 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:48.273226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595ac7f-6778-4741-909e-c6802fcde469 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:48.336884 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ed456-4706-463f-ae0c-12e6f20c3015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:48.337833 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ed456-4706-463f-ae0c-12e6f20c3015 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:48.338124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ed456-4706-463f-ae0c-12e6f20c3015 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:48.338405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ed456-4706-463f-ae0c-12e6f20c3015 None admin] PATH_INFO: `/v3/projects/7672a9b6a27040caac0e6f506d465588/users/52e108f3ae264b08870ed1dfcfa54cbe/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:48.348914 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ed456-4706-463f-ae0c-12e6f20c3015 None admin] RBAC: Authorizing `identity:create_grant(project_id=7672a9b6a27040caac0e6f506d465588, user_id=52e108f3ae264b08870ed1dfcfa54cbe, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:48.350407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ed456-4706-463f-ae0c-12e6f20c3015 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:48.384576 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 66/137] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:54:48 2022] PUT /identity/v3/projects/7672a9b6a27040caac0e6f506d465588/users/52e108f3ae264b08870ed1dfcfa54cbe/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:54:48.689830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6ee95-fb8a-4e33-9b0a-e192be7a2c54 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:48.690372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6ee95-fb8a-4e33-9b0a-e192be7a2c54 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:48.690372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6ee95-fb8a-4e33-9b0a-e192be7a2c54 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:48.692427 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 72/138] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:48.706128 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a754a3-2b7a-4a14-a3e3-3a5725faaafb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:48.707329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a754a3-2b7a-4a14-a3e3-3a5725faaafb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:48.707329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a754a3-2b7a-4a14-a3e3-3a5725faaafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:48.730671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-68a754a3-2b7a-4a14-a3e3-3a5725faaafb None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:48.731875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-68a754a3-2b7a-4a14-a3e3-3a5725faaafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:48.734932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:48.822278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 67/139] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:48.870030 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6ee95-fb8a-4e33-9b0a-e192be7a2c54 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:48.873958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:49.007038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6ee95-fb8a-4e33-9b0a-e192be7a2c54 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:49.052654 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe0716-65db-45b7-aa16-f85e5ecc2bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:49.053467 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe0716-65db-45b7-aa16-f85e5ecc2bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:49.053757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe0716-65db-45b7-aa16-f85e5ecc2bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:49.054050 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe0716-65db-45b7-aa16-f85e5ecc2bf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:49.055285 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe0716-65db-45b7-aa16-f85e5ecc2bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:49.056749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe0716-65db-45b7-aa16-f85e5ecc2bf9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:49.058532 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 73/140] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:54:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:49.063812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a754a3-2b7a-4a14-a3e3-3a5725faaafb None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:49.208459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a754a3-2b7a-4a14-a3e3-3a5725faaafb None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:49.251663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653787d6-0567-44f7-ae06-6f633addd4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:49.252428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653787d6-0567-44f7-ae06-6f633addd4e0 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:49.252721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653787d6-0567-44f7-ae06-6f633addd4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:49.253005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653787d6-0567-44f7-ae06-6f633addd4e0 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:49.253820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653787d6-0567-44f7-ae06-6f633addd4e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:49.255304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653787d6-0567-44f7-ae06-6f633addd4e0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:49.280431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:49.294582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 68/141] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:54:49 2022] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:54:49.484282 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21632c-4bfc-4aca-bb9b-a29d667a2e18 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:49.484948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21632c-4bfc-4aca-bb9b-a29d667a2e18 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:49.485428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21632c-4bfc-4aca-bb9b-a29d667a2e18 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:49.487253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 74/142] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:49.496249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26049290-5a4b-43b1-8ff7-a86fa5aba0b6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:49.496881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26049290-5a4b-43b1-8ff7-a86fa5aba0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:49.497360 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26049290-5a4b-43b1-8ff7-a86fa5aba0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:49.517622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-26049290-5a4b-43b1-8ff7-a86fa5aba0b6 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:49.519185 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-26049290-5a4b-43b1-8ff7-a86fa5aba0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:49.610723 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 69/143] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:49.632865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21632c-4bfc-4aca-bb9b-a29d667a2e18 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:49.736396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:49.780561 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21632c-4bfc-4aca-bb9b-a29d667a2e18 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:49.827765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e83985-db37-4b99-aa46-fab434f61ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:49.828609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e83985-db37-4b99-aa46-fab434f61ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:49.828898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e83985-db37-4b99-aa46-fab434f61ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:49.829177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e83985-db37-4b99-aa46-fab434f61ca6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:49.844476 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e83985-db37-4b99-aa46-fab434f61ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:49.852941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f7e83985-db37-4b99-aa46-fab434f61ca6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:54:49.852941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:49.852941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:49.852941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:49.852941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:49.852941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:49.852941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:49.852941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:49.852941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:49.852941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:49.852941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:49.852941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:49.852941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:49.852941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:49.852941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:49.852941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:49.853885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:49.853885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:49.853885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:49.853885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:49.853885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:49.853885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:49.853885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:49.853885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:49.853885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:49.853885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:49.853885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:49.853885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:54:49.853885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:49.853885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:49.853885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:49.853885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:49.855054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:49.855054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:49.855054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:49.855054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:49.855054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:49.855054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:49.855054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:49.855054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:49.855054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:49.855054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:49.855054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:54:49.855054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:54:49.855054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 75/144] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:54:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:49.860075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26049290-5a4b-43b1-8ff7-a86fa5aba0b6 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:49.982996 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26049290-5a4b-43b1-8ff7-a86fa5aba0b6 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:50.011829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:50.021420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f3fee-36cd-40f0-96fc-0e0ff8e53a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:50.022165 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f3fee-36cd-40f0-96fc-0e0ff8e53a4c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:50.022660 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f3fee-36cd-40f0-96fc-0e0ff8e53a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:50.022952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f3fee-36cd-40f0-96fc-0e0ff8e53a4c None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:50.023730 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f3fee-36cd-40f0-96fc-0e0ff8e53a4c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:50.024082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f3fee-36cd-40f0-96fc-0e0ff8e53a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:50.025494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f3fee-36cd-40f0-96fc-0e0ff8e53a4c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:50.034335 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 70/145] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:54:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:54:50.039662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e83985-db37-4b99-aa46-fab434f61ca6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:50.156487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e83985-db37-4b99-aa46-fab434f61ca6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:50.192283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:50.200655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee036edf-464f-4a70-9312-c514ef0ecbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:50.201542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee036edf-464f-4a70-9312-c514ef0ecbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:50.201825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee036edf-464f-4a70-9312-c514ef0ecbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:50.202098 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee036edf-464f-4a70-9312-c514ef0ecbd8 None admin] PATH_INFO: `/v3/users/647894bd0bf945388be1fe8277e49550` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:50.203305 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee036edf-464f-4a70-9312-c514ef0ecbd8 None admin] RBAC: Authorizing `identity:get_user(user_id=647894bd0bf945388be1fe8277e49550)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:50.204776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee036edf-464f-4a70-9312-c514ef0ecbd8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:50.207304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 76/146] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:50 2022] GET /identity/v3/users/647894bd0bf945388be1fe8277e49550 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:50.212576 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f3fee-36cd-40f0-96fc-0e0ff8e53a4c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:50.356487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04752b-65d7-4933-8826-6cc12a11f453 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:50.356771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04752b-65d7-4933-8826-6cc12a11f453 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:50.357305 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04752b-65d7-4933-8826-6cc12a11f453 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:50.359220 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 77/147] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:50.362929 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f3fee-36cd-40f0-96fc-0e0ff8e53a4c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:50.388225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bc567-f42c-4cec-bb51-f2e96a2147af None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:50.388836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bc567-f42c-4cec-bb51-f2e96a2147af None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:50.389334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bc567-f42c-4cec-bb51-f2e96a2147af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:50.401487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f17979-d86b-4fcf-a889-26016c67afda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:50.402378 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f17979-d86b-4fcf-a889-26016c67afda None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:50.402676 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f17979-d86b-4fcf-a889-26016c67afda None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:50.402964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f17979-d86b-4fcf-a889-26016c67afda None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:50.404244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f17979-d86b-4fcf-a889-26016c67afda None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:50.405712 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f17979-d86b-4fcf-a889-26016c67afda None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:50.407757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 71/148] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:50 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:54:50.413052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f17979-d86b-4fcf-a889-26016c67afda None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:50.415759 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-483bc567-f42c-4cec-bb51-f2e96a2147af None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:50.417200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-483bc567-f42c-4cec-bb51-f2e96a2147af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:50.509915 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:50.522994 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 78/149] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:50.558083 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bc567-f42c-4cec-bb51-f2e96a2147af None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:50.589922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f17979-d86b-4fcf-a889-26016c67afda None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:50.674594 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c180e-5d56-459c-a194-c9a7ee6af014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:50.676004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c180e-5d56-459c-a194-c9a7ee6af014 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:50.676298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c180e-5d56-459c-a194-c9a7ee6af014 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:50.676580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c180e-5d56-459c-a194-c9a7ee6af014 None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208/users/647894bd0bf945388be1fe8277e49550/roles/75cb869182334e59ae0d8a7540e39b9b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:50.679436 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c180e-5d56-459c-a194-c9a7ee6af014 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0e8ecfbb10647af9a7496598e58b208, user_id=647894bd0bf945388be1fe8277e49550, role_id=75cb869182334e59ae0d8a7540e39b9b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:50.680954 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c180e-5d56-459c-a194-c9a7ee6af014 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:50.714252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 72/150] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:54:50 2022] PUT /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208/users/647894bd0bf945388be1fe8277e49550/roles/75cb869182334e59ae0d8a7540e39b9b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:54:50.746780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bc567-f42c-4cec-bb51-f2e96a2147af None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:50.786640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:50.794333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4781c-6bc4-4fdf-aa31-b8a88e2a2729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:50.795143 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4781c-6bc4-4fdf-aa31-b8a88e2a2729 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:50.795694 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4781c-6bc4-4fdf-aa31-b8a88e2a2729 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:50.795988 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4781c-6bc4-4fdf-aa31-b8a88e2a2729 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:50.817708 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4781c-6bc4-4fdf-aa31-b8a88e2a2729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:50.825492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b6e4781c-6bc4-4fdf-aa31-b8a88e2a2729 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:54:50.825492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:50.825492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:50.825492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:50.825492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:50.825492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:50.825492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:50.825492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:50.825492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:50.825492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:50.825492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:50.825492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:50.825492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:50.825492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:50.825492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:50.825492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:50.826329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:50.826329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:50.826329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:50.826329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:50.826329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:50.826329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:50.826329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:50.826329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:50.826329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:50.826329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:50.826329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:50.826329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:54:50.826329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:50.826329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:50.826329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:50.826329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:50.827069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:50.827069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:50.827069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:50.827069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:50.827069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:50.827069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:50.827069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:50.827069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:50.827069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:50.827069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:50.827069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:54:50.827069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:54:50.827069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 79/151] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:54:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:54:50.833139 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c180e-5d56-459c-a194-c9a7ee6af014 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:51.001727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c180e-5d56-459c-a194-c9a7ee6af014 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:51.012657 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d2fa3-df65-4ac9-bd1a-19954f347508 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:51.012966 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d2fa3-df65-4ac9-bd1a-19954f347508 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:51.013223 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d2fa3-df65-4ac9-bd1a-19954f347508 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:51.015037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 80/152] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:51.020790 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596ba71-da01-4855-b9c1-0c2864128ef2 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:51.021081 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596ba71-da01-4855-b9c1-0c2864128ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:51.021360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596ba71-da01-4855-b9c1-0c2864128ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:51.028952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:51.055865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1596ba71-da01-4855-b9c1-0c2864128ef2 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:51.057139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1596ba71-da01-4855-b9c1-0c2864128ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:51.068110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f366570-e070-4fa6-ac6b-b52e5bb59629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:51.068811 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f366570-e070-4fa6-ac6b-b52e5bb59629 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:51.069103 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f366570-e070-4fa6-ac6b-b52e5bb59629 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:51.069390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f366570-e070-4fa6-ac6b-b52e5bb59629 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:51.070167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f366570-e070-4fa6-ac6b-b52e5bb59629 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:51.070483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f366570-e070-4fa6-ac6b-b52e5bb59629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:51.071882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f366570-e070-4fa6-ac6b-b52e5bb59629 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:51.089407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 73/153] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:54:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:51.102350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f366570-e070-4fa6-ac6b-b52e5bb59629 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:51.196899 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 81/154] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:54:51.259273 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a0705-707f-45be-8cac-50f161aeacda None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:51.259877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a0705-707f-45be-8cac-50f161aeacda None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:51.260401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a0705-707f-45be-8cac-50f161aeacda None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:51.262443 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 82/155] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:51.267475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20093-2940-4d7d-9f2f-d26f8034e578 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:51.268071 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20093-2940-4d7d-9f2f-d26f8034e578 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:51.268642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20093-2940-4d7d-9f2f-d26f8034e578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:51.284641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f366570-e070-4fa6-ac6b-b52e5bb59629 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:51.296136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d1e20093-2940-4d7d-9f2f-d26f8034e578 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:51.297630 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d1e20093-2940-4d7d-9f2f-d26f8034e578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:51.332127 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d6e37-2b91-4cfa-95c7-865ccec496f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:51.333011 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d6e37-2b91-4cfa-95c7-865ccec496f7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:51.333298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d6e37-2b91-4cfa-95c7-865ccec496f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:51.333577 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d6e37-2b91-4cfa-95c7-865ccec496f7 None admin] PATH_INFO: `/v3/users/dd72f905284743f09fbd1a8016bb1910` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:51.335767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d6e37-2b91-4cfa-95c7-865ccec496f7 None admin] RBAC: Authorizing `identity:get_user(user_id=dd72f905284743f09fbd1a8016bb1910)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:51.337271 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d6e37-2b91-4cfa-95c7-865ccec496f7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:51.339095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 74/156] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:51 2022] GET /identity/v3/users/dd72f905284743f09fbd1a8016bb1910 => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:51.339702 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d6e37-2b91-4cfa-95c7-865ccec496f7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:51.433646 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 83/157] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:51.434305 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:51.434525 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e20093-2940-4d7d-9f2f-d26f8034e578 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:51.524000 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d6e37-2b91-4cfa-95c7-865ccec496f7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:51.536338 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:51.617256 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078421a4-71cd-4abd-8a60-7ff38a9bedad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:51.618090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078421a4-71cd-4abd-8a60-7ff38a9bedad None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:51.618386 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078421a4-71cd-4abd-8a60-7ff38a9bedad None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:51.618673 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078421a4-71cd-4abd-8a60-7ff38a9bedad None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:51.627811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e20093-2940-4d7d-9f2f-d26f8034e578 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:51.633514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078421a4-71cd-4abd-8a60-7ff38a9bedad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:51.645663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-078421a4-71cd-4abd-8a60-7ff38a9bedad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:54:51.645663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:51.645663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:51.645663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:51.645663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:51.645663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:51.645663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:51.645663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:51.645663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:51.645663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:51.645663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:51.645663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:51.645663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:51.645663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:51.645663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:51.645663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:51.646592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:51.646592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:51.646592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:51.646592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:51.646592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:51.646592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:51.646592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:51.646592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:51.646592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:51.646592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:51.646592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:51.646592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:54:51.646592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:51.646592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:51.646592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:51.646592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:51.647350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:51.647350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:51.647350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:51.647350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:51.647350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:51.647350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:51.647350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:51.647350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:51.647350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:51.647350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:51.647350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:54:51.647350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:54:51.647350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 75/158] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:54:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:51.648043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078421a4-71cd-4abd-8a60-7ff38a9bedad None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:51.695803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e972758-fad9-4bd5-a642-2152ec4633dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:51.696958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e972758-fad9-4bd5-a642-2152ec4633dd None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:51.697459 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e972758-fad9-4bd5-a642-2152ec4633dd None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:51.697981 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e972758-fad9-4bd5-a642-2152ec4633dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:51.823165 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078421a4-71cd-4abd-8a60-7ff38a9bedad None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:51.832194 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e972758-fad9-4bd5-a642-2152ec4633dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:51.833557 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:51.835423 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e972758-fad9-4bd5-a642-2152ec4633dd None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:51.882539 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af3308-611c-4fb5-95e2-a697212afedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:51.883363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af3308-611c-4fb5-95e2-a697212afedf None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:51.883652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af3308-611c-4fb5-95e2-a697212afedf None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:51.883947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af3308-611c-4fb5-95e2-a697212afedf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:51.911946 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af3308-611c-4fb5-95e2-a697212afedf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:51.917417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-92af3308-611c-4fb5-95e2-a697212afedf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:54:51.917417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:51.917417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:51.917417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:51.917417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:51.917417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:51.917417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:51.917417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:51.917417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:51.917417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:51.917417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:51.917417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:51.917417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:51.917417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:51.917417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:51.917417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:51.918283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:51.918283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:51.918283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:51.918283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:51.918283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:51.918283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:51.918283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:51.918283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:51.918283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:51.918283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:51.918283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:51.918283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:54:51.918283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:51.918283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:51.918283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:51.918283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:51.919109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:51.919109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:51.919109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:51.919109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:51.919109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:51.919109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:51.919109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:51.919109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:51.919109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:51.919109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:51.919109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:54:51.919109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:54:51.928540 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 76/159] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:54:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:51.929550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af3308-611c-4fb5-95e2-a697212afedf None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:51.940276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:52.059168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 84/160] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:54:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:54:52.061023 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e972758-fad9-4bd5-a642-2152ec4633dd None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:52.156009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af3308-611c-4fb5-95e2-a697212afedf None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:52.230220 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff166c8-bb7b-4de9-86c4-d29faf210c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:52.231055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff166c8-bb7b-4de9-86c4-d29faf210c55 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:52.231349 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff166c8-bb7b-4de9-86c4-d29faf210c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:52.231627 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff166c8-bb7b-4de9-86c4-d29faf210c55 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:52.232440 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff166c8-bb7b-4de9-86c4-d29faf210c55 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:52.232752 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff166c8-bb7b-4de9-86c4-d29faf210c55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:52.234306 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff166c8-bb7b-4de9-86c4-d29faf210c55 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:52.250496 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 77/161] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:54:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:52.252241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff166c8-bb7b-4de9-86c4-d29faf210c55 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:52.284754 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e972758-fad9-4bd5-a642-2152ec4633dd None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:52.308523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:52.385540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85486b-671b-4b3a-9743-c37597487544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:52.386487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85486b-671b-4b3a-9743-c37597487544 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:52.386999 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85486b-671b-4b3a-9743-c37597487544 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:52.387491 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85486b-671b-4b3a-9743-c37597487544 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:52.388483 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85486b-671b-4b3a-9743-c37597487544 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:52.389014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85486b-671b-4b3a-9743-c37597487544 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:52.390609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85486b-671b-4b3a-9743-c37597487544 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:52.414659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff166c8-bb7b-4de9-86c4-d29faf210c55 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:52.421690 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 85/162] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:54:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:52.422908 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85486b-671b-4b3a-9743-c37597487544 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:52.475622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc265ff-d8a0-4fed-a73e-7d0f5b95be28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:52.476273 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:52.476540 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc265ff-d8a0-4fed-a73e-7d0f5b95be28 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:52.476833 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc265ff-d8a0-4fed-a73e-7d0f5b95be28 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:52.477120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc265ff-d8a0-4fed-a73e-7d0f5b95be28 None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:52.478379 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc265ff-d8a0-4fed-a73e-7d0f5b95be28 None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:52.479841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc265ff-d8a0-4fed-a73e-7d0f5b95be28 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:52.481605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 78/163] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:52 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:52.482382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc265ff-d8a0-4fed-a73e-7d0f5b95be28 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:52.609832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85486b-671b-4b3a-9743-c37597487544 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:52.652312 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:52.663213 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc265ff-d8a0-4fed-a73e-7d0f5b95be28 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:52.668316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b165b-a74c-4ef4-880c-ef0002b4c2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:52.669186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b165b-a74c-4ef4-880c-ef0002b4c2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:52.669481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b165b-a74c-4ef4-880c-ef0002b4c2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:52.669755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b165b-a74c-4ef4-880c-ef0002b4c2c9 None admin] PATH_INFO: `/v3/users/52e108f3ae264b08870ed1dfcfa54cbe` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:52.671238 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b165b-a74c-4ef4-880c-ef0002b4c2c9 None admin] RBAC: Authorizing `identity:get_user(user_id=52e108f3ae264b08870ed1dfcfa54cbe)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:52.672715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b165b-a74c-4ef4-880c-ef0002b4c2c9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:52.674566 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 86/164] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:52 2022] GET /identity/v3/users/52e108f3ae264b08870ed1dfcfa54cbe => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:52.675147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b165b-a74c-4ef4-880c-ef0002b4c2c9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:52.738755 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0eddf-5c93-4986-a0cd-6aa280337931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:52.744192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0eddf-5c93-4986-a0cd-6aa280337931 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:52.744774 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0eddf-5c93-4986-a0cd-6aa280337931 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:52.745288 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0eddf-5c93-4986-a0cd-6aa280337931 None admin] PATH_INFO: `/v3/users/52e108f3ae264b08870ed1dfcfa54cbe` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:52.747589 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0eddf-5c93-4986-a0cd-6aa280337931 None admin] RBAC: Authorizing `identity:get_user(user_id=52e108f3ae264b08870ed1dfcfa54cbe)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:52.749314 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0eddf-5c93-4986-a0cd-6aa280337931 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:52.758912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 79/165] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:52 2022] GET /identity/v3/users/52e108f3ae264b08870ed1dfcfa54cbe => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:52.760059 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0eddf-5c93-4986-a0cd-6aa280337931 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:52.854619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:52.887282 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b165b-a74c-4ef4-880c-ef0002b4c2c9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:52.945300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ba15b-bfc2-4ddd-afc6-e4bd3151d903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:52.946378 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ba15b-bfc2-4ddd-afc6-e4bd3151d903 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:52.946886 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ba15b-bfc2-4ddd-afc6-e4bd3151d903 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:52.947374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ba15b-bfc2-4ddd-afc6-e4bd3151d903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:52.948475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ba15b-bfc2-4ddd-afc6-e4bd3151d903 None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=c0e8ecfbb10647af9a7496598e58b208, user.id=dd72f905284743f09fbd1a8016bb1910) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:52.949016 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ba15b-bfc2-4ddd-afc6-e4bd3151d903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:52.950903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ba15b-bfc2-4ddd-afc6-e4bd3151d903 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:52.957829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0eddf-5c93-4986-a0cd-6aa280337931 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:52.963169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 87/166] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:54:52 2022] GET /identity/v3/role_assignments?user.id=dd72f905284743f09fbd1a8016bb1910&scope.project.id=c0e8ecfbb10647af9a7496598e58b208&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:52.964267 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ba15b-bfc2-4ddd-afc6-e4bd3151d903 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:53.017699 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb3063-5899-4fb2-a72f-61ed00094e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:53.018366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb3063-5899-4fb2-a72f-61ed00094e6f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:53.018720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb3063-5899-4fb2-a72f-61ed00094e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:53.019504 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb3063-5899-4fb2-a72f-61ed00094e6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:53.079273 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:53.161246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb3063-5899-4fb2-a72f-61ed00094e6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:53.162876 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb3063-5899-4fb2-a72f-61ed00094e6f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:53.167757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ba15b-bfc2-4ddd-afc6-e4bd3151d903 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:53.252875 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5ad81-5b35-4afc-9731-9793a639a7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:53.254540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5ad81-5b35-4afc-9731-9793a639a7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:53.255037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5ad81-5b35-4afc-9731-9793a639a7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:53.255531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5ad81-5b35-4afc-9731-9793a639a7c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:53.296302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:53.387687 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5ad81-5b35-4afc-9731-9793a639a7c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:53.389277 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5ad81-5b35-4afc-9731-9793a639a7c5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:53.415098 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 80/167] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:54:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:54:53.416530 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091313d-b142-4cf9-af39-c5162b93ddf5 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:53.416826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091313d-b142-4cf9-af39-c5162b93ddf5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:53.417106 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091313d-b142-4cf9-af39-c5162b93ddf5 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:53.418458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 81/168] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:53.424682 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c8c73-429c-463f-ae43-4e3cfb9b3d9b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:53.425538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c8c73-429c-463f-ae43-4e3cfb9b3d9b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:53.425809 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c8c73-429c-463f-ae43-4e3cfb9b3d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:53.460979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2d1c8c73-429c-463f-ae43-4e3cfb9b3d9b None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:53.462201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2d1c8c73-429c-463f-ae43-4e3cfb9b3d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:53.546373 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 88/169] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:54:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:54:53.547310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5ad81-5b35-4afc-9731-9793a639a7c5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:53.602860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:53.615422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:53.619568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 82/170] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:53.620534 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c8c73-429c-463f-ae43-4e3cfb9b3d9b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:53.673681 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5ad81-5b35-4afc-9731-9793a639a7c5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:53.710459 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fc9e9-af5b-44ac-ab8a-0586dc792152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:53.711323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fc9e9-af5b-44ac-ab8a-0586dc792152 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:53.711607 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fc9e9-af5b-44ac-ab8a-0586dc792152 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:53.711884 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fc9e9-af5b-44ac-ab8a-0586dc792152 None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:53.713116 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88fc9e9-af5b-44ac-ab8a-0586dc792152 None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:53.714575 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88fc9e9-af5b-44ac-ab8a-0586dc792152 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:53.716327 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 89/171] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:53 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:53.717102 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fc9e9-af5b-44ac-ab8a-0586dc792152 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:53.822298 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fc9e9-af5b-44ac-ab8a-0586dc792152 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:53.836440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:53.849956 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c8c73-429c-463f-ae43-4e3cfb9b3d9b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:53.859452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c207e-67d9-4b07-928c-dc98421d1cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:53.860283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c207e-67d9-4b07-928c-dc98421d1cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:53.860566 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c207e-67d9-4b07-928c-dc98421d1cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:53.860841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c207e-67d9-4b07-928c-dc98421d1cb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:53.872431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c207e-67d9-4b07-928c-dc98421d1cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:53.880264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-dc1c207e-67d9-4b07-928c-dc98421d1cb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:54:53.880264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:53.880264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:53.880264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:53.880264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:53.880264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:53.880264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:53.880264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:53.880264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:53.880264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:53.880264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:53.880264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:53.880264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:53.880264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:53.880264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:53.880264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:53.882413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:53.882413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:53.882413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:53.882413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:53.882413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:53.882413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:53.882413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:53.882413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:53.882413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:53.882413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:53.882413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:53.882413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:54:53.882413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:53.882413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:53.882413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:53.882413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:53.884544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:53.884544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:53.884544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:53.884544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:53.884544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:53.884544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:53.884544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:53.884544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:53.884544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:53.884544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:53.884544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:54:53.884544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:54:53.884544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 90/172] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:54:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:53.884544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c207e-67d9-4b07-928c-dc98421d1cb9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:53.903383 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6acf20-c6e6-4133-a18c-0fe7237fc525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:53.904330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6acf20-c6e6-4133-a18c-0fe7237fc525 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:53.904581 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6acf20-c6e6-4133-a18c-0fe7237fc525 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:53.904861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6acf20-c6e6-4133-a18c-0fe7237fc525 None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:53.906100 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6acf20-c6e6-4133-a18c-0fe7237fc525 None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:53.907570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6acf20-c6e6-4133-a18c-0fe7237fc525 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:53.910099 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 83/173] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:53 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:53.910711 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6acf20-c6e6-4133-a18c-0fe7237fc525 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:53.992204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c207e-67d9-4b07-928c-dc98421d1cb9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:54.013595 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:54.027417 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930a227-671c-447e-9a42-79316760ac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:54.028132 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930a227-671c-447e-9a42-79316760ac60 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:54.028420 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930a227-671c-447e-9a42-79316760ac60 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:54.028698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930a227-671c-447e-9a42-79316760ac60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:54.029549 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930a227-671c-447e-9a42-79316760ac60 None admin] RBAC: Adding query filter params (role.id=0251662126f747ad9804858316f8573a, scope.project.id=c0e8ecfbb10647af9a7496598e58b208, user.id=52e108f3ae264b08870ed1dfcfa54cbe) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:54.029921 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930a227-671c-447e-9a42-79316760ac60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:54.031318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930a227-671c-447e-9a42-79316760ac60 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:54.038486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 91/174] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:54:53 2022] GET /identity/v3/role_assignments?user.id=52e108f3ae264b08870ed1dfcfa54cbe&scope.project.id=c0e8ecfbb10647af9a7496598e58b208&role.id=0251662126f747ad9804858316f8573a => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:54.039113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930a227-671c-447e-9a42-79316760ac60 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:54.080394 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:54.103489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6acf20-c6e6-4133-a18c-0fe7237fc525 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:54.156350 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930a227-671c-447e-9a42-79316760ac60 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:54.180959 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cae97-26ed-4df0-ad38-367b875e735f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:54.182242 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cae97-26ed-4df0-ad38-367b875e735f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:54.182675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cae97-26ed-4df0-ad38-367b875e735f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:54.183117 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cae97-26ed-4df0-ad38-367b875e735f None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:54.184212 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cae97-26ed-4df0-ad38-367b875e735f None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:54.184669 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cae97-26ed-4df0-ad38-367b875e735f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:54.186279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cae97-26ed-4df0-ad38-367b875e735f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:54.195209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68c97e-3376-453a-bd28-33aed395bac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:54.195935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68c97e-3376-453a-bd28-33aed395bac6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:54.196251 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68c97e-3376-453a-bd28-33aed395bac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:54.196761 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68c97e-3376-453a-bd28-33aed395bac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:54.197987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68c97e-3376-453a-bd28-33aed395bac6 None admin] RBAC: Adding query filter params (role.id=a1fb3b01c7424cf18f71b9a2b8333f03, scope.project.id=c0e8ecfbb10647af9a7496598e58b208, user.id=52e108f3ae264b08870ed1dfcfa54cbe) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:54.198378 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68c97e-3376-453a-bd28-33aed395bac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:54.199895 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68c97e-3376-453a-bd28-33aed395bac6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:54.207886 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 92/175] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:54:54 2022] GET /identity/v3/role_assignments?user.id=52e108f3ae264b08870ed1dfcfa54cbe&scope.project.id=c0e8ecfbb10647af9a7496598e58b208&role.id=a1fb3b01c7424cf18f71b9a2b8333f03 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:54.214629 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 84/176] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:54:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:54.220807 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68c97e-3376-453a-bd28-33aed395bac6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:54.346394 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1f99a-442c-4e3a-90dd-deae6f97a1f6 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:54.347033 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1f99a-442c-4e3a-90dd-deae6f97a1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:54.348040 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1f99a-442c-4e3a-90dd-deae6f97a1f6 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:54.353810 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 85/177] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:54.355549 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe388097-001a-437c-83e3-c0c056c8c6a0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:54.356050 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe388097-001a-437c-83e3-c0c056c8c6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:54.356530 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe388097-001a-437c-83e3-c0c056c8c6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:54.363943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:54.363943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68c97e-3376-453a-bd28-33aed395bac6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:54.404105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fe388097-001a-437c-83e3-c0c056c8c6a0 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:54.405140 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fb834-73f7-41aa-ac6f-95cf95d8e0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:54.405382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fe388097-001a-437c-83e3-c0c056c8c6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:54.406065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fb834-73f7-41aa-ac6f-95cf95d8e0bc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:54.406351 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fb834-73f7-41aa-ac6f-95cf95d8e0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:54.406633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fb834-73f7-41aa-ac6f-95cf95d8e0bc None admin] PATH_INFO: `/v3/users/52e108f3ae264b08870ed1dfcfa54cbe` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:54.408388 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fb834-73f7-41aa-ac6f-95cf95d8e0bc None admin] RBAC: Authorizing `identity:get_user(user_id=52e108f3ae264b08870ed1dfcfa54cbe)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:54.410567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fb834-73f7-41aa-ac6f-95cf95d8e0bc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:54.412601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 93/178] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:54 2022] GET /identity/v3/users/52e108f3ae264b08870ed1dfcfa54cbe => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:54.431816 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fb834-73f7-41aa-ac6f-95cf95d8e0bc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:54.577742 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 86/179] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:54.636181 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe388097-001a-437c-83e3-c0c056c8c6a0 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:54.662922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fb834-73f7-41aa-ac6f-95cf95d8e0bc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:54.705481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c80d9e-f4e0-4fc8-b6d8-8b7a754de870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:54.707188 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80d9e-f4e0-4fc8-b6d8-8b7a754de870 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:54.707471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80d9e-f4e0-4fc8-b6d8-8b7a754de870 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:54.707746 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80d9e-f4e0-4fc8-b6d8-8b7a754de870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:54.732840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:54.755609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:54.782742 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe388097-001a-437c-83e3-c0c056c8c6a0 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:54.797081 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c80d9e-f4e0-4fc8-b6d8-8b7a754de870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:54.800716 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c80d9e-f4e0-4fc8-b6d8-8b7a754de870 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:54.829114 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c81f5-1f2f-4a23-9047-1ffc0a6e03ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:54.829114 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c81f5-1f2f-4a23-9047-1ffc0a6e03ca None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:54.829424 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c81f5-1f2f-4a23-9047-1ffc0a6e03ca None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:54.829708 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c81f5-1f2f-4a23-9047-1ffc0a6e03ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:54.842364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c81f5-1f2f-4a23-9047-1ffc0a6e03ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:54.850293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-5e9c81f5-1f2f-4a23-9047-1ffc0a6e03ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:54:54.850293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:54.850293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:54.850293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:54.850293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:54.850293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:54.850293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:54.850293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:54.850293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:54.850293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:54.850293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:54.850293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:54.850293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:54.850293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:54.850293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:54.850293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:54.851176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:54.851176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:54.851176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:54.851176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:54.851176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:54.851176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:54.851176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:54.851176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:54.851176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:54.851176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:54.851176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:54.851176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:54:54.851176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:54.851176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:54.851176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:54.851176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:54.851974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:54.851974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:54.851974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:54.851974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:54.851974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:54.851974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:54.851974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:54.851974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:54.851974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:54.851974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:54.851974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:54:54.851974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:54:54.851974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 87/180] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:54:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:54.857971 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f435d-4b0c-4989-b999-175f1981a8a0 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:54.858262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f435d-4b0c-4989-b999-175f1981a8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:54.858545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f435d-4b0c-4989-b999-175f1981a8a0 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:54.860201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 88/181] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:54.860927 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f435d-4b0c-4989-b999-175f1981a8a0 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:54.929996 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 94/182] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:54:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:54:54.931241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a2268-58a1-4ca3-a41a-9f33136af3c4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:54.931534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a2268-58a1-4ca3-a41a-9f33136af3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:54.931808 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a2268-58a1-4ca3-a41a-9f33136af3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:54.948989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9b6a2268-58a1-4ca3-a41a-9f33136af3c4 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:54.950149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9b6a2268-58a1-4ca3-a41a-9f33136af3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:54.982406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f435d-4b0c-4989-b999-175f1981a8a0 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:54.997506 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:55.019055 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:55.021636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfea927-7b52-418e-a378-0aee60b93e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:55.022319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfea927-7b52-418e-a378-0aee60b93e78 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:55.022693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfea927-7b52-418e-a378-0aee60b93e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:55.022977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfea927-7b52-418e-a378-0aee60b93e78 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:55.023739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfea927-7b52-418e-a378-0aee60b93e78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:55.024076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfea927-7b52-418e-a378-0aee60b93e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:55.025002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 95/183] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:55.025464 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfea927-7b52-418e-a378-0aee60b93e78 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:55.031594 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6ea09-db63-4401-936f-34559e1b29d8 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:55.031888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6ea09-db63-4401-936f-34559e1b29d8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:55.032200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6ea09-db63-4401-936f-34559e1b29d8 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:55.033505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 96/184] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:55.034230 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6ea09-db63-4401-936f-34559e1b29d8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:55.034620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 89/185] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:54:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:55.035859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88438982-078b-42ff-a5f5-ce09d0bdc734 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:55.036185 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88438982-078b-42ff-a5f5-ce09d0bdc734 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:55.036469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88438982-078b-42ff-a5f5-ce09d0bdc734 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:55.037849 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 90/186] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:55.042716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffbcdd-97b7-4c11-bbbf-95c0393bcf04 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:55.043011 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffbcdd-97b7-4c11-bbbf-95c0393bcf04 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:55.043297 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffbcdd-97b7-4c11-bbbf-95c0393bcf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:55.060128 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-62ffbcdd-97b7-4c11-bbbf-95c0393bcf04 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:55.061340 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-62ffbcdd-97b7-4c11-bbbf-95c0393bcf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:55.125944 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 91/187] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:55.126775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffbcdd-97b7-4c11-bbbf-95c0393bcf04 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:55.152939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6ea09-db63-4401-936f-34559e1b29d8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:55.187992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53df77-2911-47df-b697-d75b996ea187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:55.188793 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53df77-2911-47df-b697-d75b996ea187 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:55.189089 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53df77-2911-47df-b697-d75b996ea187 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:55.189369 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53df77-2911-47df-b697-d75b996ea187 None admin] PATH_INFO: `/v3/projects/7672a9b6a27040caac0e6f506d465588` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:55.191108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53df77-2911-47df-b697-d75b996ea187 None admin] RBAC: Authorizing `identity:get_project(project_id=7672a9b6a27040caac0e6f506d465588)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:55.192593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53df77-2911-47df-b697-d75b996ea187 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:55.194295 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 97/188] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:55 2022] GET /identity/v3/projects/7672a9b6a27040caac0e6f506d465588 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:55.195423 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee421a-61a8-41e9-9e70-d8d774f492ad None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:55.195708 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee421a-61a8-41e9-9e70-d8d774f492ad None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:55.196017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee421a-61a8-41e9-9e70-d8d774f492ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:55.212112 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e3ee421a-61a8-41e9-9e70-d8d774f492ad None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:55.213298 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e3ee421a-61a8-41e9-9e70-d8d774f492ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:55.229064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffbcdd-97b7-4c11-bbbf-95c0393bcf04 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:55.236161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:55.263240 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbec67-f31e-40d1-82a4-b9b99c9e9db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:55.264144 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbec67-f31e-40d1-82a4-b9b99c9e9db8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:55.264430 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbec67-f31e-40d1-82a4-b9b99c9e9db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:55.264707 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbec67-f31e-40d1-82a4-b9b99c9e9db8 None admin] PATH_INFO: `/v3/users/647894bd0bf945388be1fe8277e49550` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:55.266010 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbec67-f31e-40d1-82a4-b9b99c9e9db8 None admin] RBAC: Authorizing `identity:get_user(user_id=647894bd0bf945388be1fe8277e49550)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:55.267445 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbec67-f31e-40d1-82a4-b9b99c9e9db8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:55.269206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 92/189] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:55 2022] GET /identity/v3/users/647894bd0bf945388be1fe8277e49550 => generated 289 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:55.269206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbec67-f31e-40d1-82a4-b9b99c9e9db8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:55.274019 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:55.279756 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 98/190] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:55.288827 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee421a-61a8-41e9-9e70-d8d774f492ad None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:55.373025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbec67-f31e-40d1-82a4-b9b99c9e9db8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:55.387402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee421a-61a8-41e9-9e70-d8d774f492ad None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:55.406346 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18adf50-6c9f-42b4-9755-663a7762f2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:55.407133 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18adf50-6c9f-42b4-9755-663a7762f2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:55.407416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18adf50-6c9f-42b4-9755-663a7762f2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:55.407690 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18adf50-6c9f-42b4-9755-663a7762f2e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:55.418040 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18adf50-6c9f-42b4-9755-663a7762f2e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:55.420576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9236399-ab0e-470a-8d46-8d37d425b9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:55.421363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9236399-ab0e-470a-8d46-8d37d425b9ad None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:55.421646 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9236399-ab0e-470a-8d46-8d37d425b9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:55.421920 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9236399-ab0e-470a-8d46-8d37d425b9ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:55.423080 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9236399-ab0e-470a-8d46-8d37d425b9ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:55.424556 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9236399-ab0e-470a-8d46-8d37d425b9ad None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:55.426369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d18adf50-6c9f-42b4-9755-663a7762f2e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:54:55.426369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:55.426369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:55.426369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:55.426369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:55.426369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:55.426369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:55.426369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:55.426369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:55.426369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:55.426369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:55.426369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:55.426369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:55.426369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:55.426369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:55.426369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:55.427357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:55.427357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:55.427357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:55.427357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:55.427357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:55.427357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:55.427357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:55.427357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:55.427357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:55.427357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:55.427357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:55.427357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:54:55.427357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:55.427357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:55.427357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:55.427357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:55.432922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:55.432922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:55.432922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:55.432922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:55.432922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:55.432922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:55.432922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:55.432922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:55.432922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:55.432922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:55.432922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:54:55.432922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:54:55.433670 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 99/191] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:54:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:55.433760 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 93/192] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:54:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:55.433838 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9236399-ab0e-470a-8d46-8d37d425b9ad None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:55.433915 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18adf50-6c9f-42b4-9755-663a7762f2e4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:55.468174 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:55.494578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:55.531572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9236399-ab0e-470a-8d46-8d37d425b9ad None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:55.534771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18adf50-6c9f-42b4-9755-663a7762f2e4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:55.566299 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd1d42-27d4-43d9-97a2-f756944a9858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:55.566957 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd1d42-27d4-43d9-97a2-f756944a9858 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:55.567241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd1d42-27d4-43d9-97a2-f756944a9858 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:55.567515 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd1d42-27d4-43d9-97a2-f756944a9858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:55.568449 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd1d42-27d4-43d9-97a2-f756944a9858 None admin] RBAC: Adding query filter params (role.id=0251662126f747ad9804858316f8573a, scope.project.id=7672a9b6a27040caac0e6f506d465588, user.id=52e108f3ae264b08870ed1dfcfa54cbe) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:55.568698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd1d42-27d4-43d9-97a2-f756944a9858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:55.569010 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb0d25-c09d-42a4-9817-6b797403fb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:55.569655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb0d25-c09d-42a4-9817-6b797403fb1a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:55.569937 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb0d25-c09d-42a4-9817-6b797403fb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:55.570143 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd1d42-27d4-43d9-97a2-f756944a9858 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:55.570236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb0d25-c09d-42a4-9817-6b797403fb1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:55.576083 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 100/193] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:54:55 2022] GET /identity/v3/role_assignments?user.id=52e108f3ae264b08870ed1dfcfa54cbe&scope.project.id=7672a9b6a27040caac0e6f506d465588&role.id=0251662126f747ad9804858316f8573a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:55.576865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd1d42-27d4-43d9-97a2-f756944a9858 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:55.668415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb0d25-c09d-42a4-9817-6b797403fb1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:55.670045 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb0d25-c09d-42a4-9817-6b797403fb1a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:55.692350 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd1d42-27d4-43d9-97a2-f756944a9858 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:55.708907 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:55.723183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:55.732270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e195d-aef9-472c-97f4-ce3e405417ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:55.733099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e195d-aef9-472c-97f4-ce3e405417ba None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:55.733381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e195d-aef9-472c-97f4-ce3e405417ba None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:55.733656 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e195d-aef9-472c-97f4-ce3e405417ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:55.746246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e195d-aef9-472c-97f4-ce3e405417ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:55.755195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-de7e195d-aef9-472c-97f4-ce3e405417ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:54:55.755195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:55.755195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:55.755195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:55.755195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:55.755195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:55.755195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:55.755195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:55.755195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:55.755195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:55.755195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:55.755195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:55.755195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:55.755195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:55.755195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:55.755195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:55.756173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:55.756173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:55.756173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:55.756173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:55.756173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:55.756173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:55.756173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:55.756173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:55.756173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:55.756173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:55.756173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:55.756173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:54:55.756173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:55.756173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:55.756173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:55.756173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:55.756975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:55.756975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:55.756975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:55.756975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:55.756975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:55.756975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:55.756975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:55.756975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:55.756975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:55.756975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:55.756975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:54:55.756975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:54:55.756975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 101/194] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:54:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:54:55.757631 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e195d-aef9-472c-97f4-ce3e405417ba None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:55.795712 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 94/195] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:54:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:54:55.797517 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb0d25-c09d-42a4-9817-6b797403fb1a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:55.882211 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e195d-aef9-472c-97f4-ce3e405417ba None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:55.900206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb0d25-c09d-42a4-9817-6b797403fb1a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:55.913708 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c9afe-2afe-4641-987b-68f0050b319e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:55.914370 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c9afe-2afe-4641-987b-68f0050b319e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:55.914655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c9afe-2afe-4641-987b-68f0050b319e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:55.914930 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c9afe-2afe-4641-987b-68f0050b319e None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:55.915677 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c9afe-2afe-4641-987b-68f0050b319e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:55.916009 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c9afe-2afe-4641-987b-68f0050b319e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:55.917375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c9afe-2afe-4641-987b-68f0050b319e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:55.925938 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 102/196] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:54:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:55.926707 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c9afe-2afe-4641-987b-68f0050b319e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:55.933511 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f3746-9dcc-4dc7-bb08-57df9e76fd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:55.934177 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f3746-9dcc-4dc7-bb08-57df9e76fd6c None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:55.934462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f3746-9dcc-4dc7-bb08-57df9e76fd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:55.934740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f3746-9dcc-4dc7-bb08-57df9e76fd6c None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:55.935449 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f3746-9dcc-4dc7-bb08-57df9e76fd6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:55.936905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f3746-9dcc-4dc7-bb08-57df9e76fd6c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:55.944152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:55.957915 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 95/197] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:54:55 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:54:55.958706 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f3746-9dcc-4dc7-bb08-57df9e76fd6c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:55.992473 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:56.042647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c9afe-2afe-4641-987b-68f0050b319e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:56.070819 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f3746-9dcc-4dc7-bb08-57df9e76fd6c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:56.084328 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0faa25-e3f8-429b-9977-aa0564e0254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:56.085024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0faa25-e3f8-429b-9977-aa0564e0254f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:56.085313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0faa25-e3f8-429b-9977-aa0564e0254f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:56.085597 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0faa25-e3f8-429b-9977-aa0564e0254f None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:56.086384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0faa25-e3f8-429b-9977-aa0564e0254f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:56.086747 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0faa25-e3f8-429b-9977-aa0564e0254f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:56.088130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0faa25-e3f8-429b-9977-aa0564e0254f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:56.098289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 103/198] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:54:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:56.099084 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0faa25-e3f8-429b-9977-aa0564e0254f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:56.117140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fc6f6-49e1-46ea-88bb-a15f88d2165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:56.118032 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fc6f6-49e1-46ea-88bb-a15f88d2165e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:56.118315 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fc6f6-49e1-46ea-88bb-a15f88d2165e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:56.118590 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fc6f6-49e1-46ea-88bb-a15f88d2165e None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:56.119846 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fc6f6-49e1-46ea-88bb-a15f88d2165e None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:56.121380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fc6f6-49e1-46ea-88bb-a15f88d2165e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:56.127971 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 96/199] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:55 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:56.127971 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fc6f6-49e1-46ea-88bb-a15f88d2165e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:56.195150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:56.229636 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0faa25-e3f8-429b-9977-aa0564e0254f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:56.245974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fc6f6-49e1-46ea-88bb-a15f88d2165e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:56.247761 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:56.280221 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766cfab-415a-4410-a066-4a759baf5bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:56.281107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766cfab-415a-4410-a066-4a759baf5bae None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:56.281393 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766cfab-415a-4410-a066-4a759baf5bae None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:56.281669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766cfab-415a-4410-a066-4a759baf5bae None admin] PATH_INFO: `/v3/users/dee5ef6b04b740aeb5f4123d0a488036` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:56.291360 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3aa4db-ca22-4662-93cb-78872fd10bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:56.293014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aa4db-ca22-4662-93cb-78872fd10bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:56.293014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aa4db-ca22-4662-93cb-78872fd10bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:56.293014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aa4db-ca22-4662-93cb-78872fd10bc9 None admin] PATH_INFO: `/v3/users/dee5ef6b04b740aeb5f4123d0a488036` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:56.298490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766cfab-415a-4410-a066-4a759baf5bae None admin] RBAC: Authorizing `identity:get_user(user_id=dee5ef6b04b740aeb5f4123d0a488036)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:56.299785 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766cfab-415a-4410-a066-4a759baf5bae None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:56.302316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 104/200] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:56 2022] GET /identity/v3/users/dee5ef6b04b740aeb5f4123d0a488036 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:56.304414 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766cfab-415a-4410-a066-4a759baf5bae None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:56.310523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3aa4db-ca22-4662-93cb-78872fd10bc9 None admin] RBAC: Authorizing `identity:get_user(user_id=dee5ef6b04b740aeb5f4123d0a488036)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:56.312055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3aa4db-ca22-4662-93cb-78872fd10bc9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:56.313857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 97/201] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:56 2022] GET /identity/v3/users/dee5ef6b04b740aeb5f4123d0a488036 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:56.314631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3aa4db-ca22-4662-93cb-78872fd10bc9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:56.446163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766cfab-415a-4410-a066-4a759baf5bae None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:56.451470 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3aa4db-ca22-4662-93cb-78872fd10bc9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:56.475125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:56.498837 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50672c3c-30ac-4dce-83f6-640d282a7df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:56.499799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50672c3c-30ac-4dce-83f6-640d282a7df4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:56.500256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50672c3c-30ac-4dce-83f6-640d282a7df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:56.500605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50672c3c-30ac-4dce-83f6-640d282a7df4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:56.500833 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd9125-b881-41f7-abef-6670a76cbd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:56.501627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50672c3c-30ac-4dce-83f6-640d282a7df4 None admin] RBAC: Adding query filter params (role.id=75cb869182334e59ae0d8a7540e39b9b, scope.project.id=c0e8ecfbb10647af9a7496598e58b208, user.id=647894bd0bf945388be1fe8277e49550) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:56.501875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd9125-b881-41f7-abef-6670a76cbd34 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:56.502019 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50672c3c-30ac-4dce-83f6-640d282a7df4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:56.502472 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd9125-b881-41f7-abef-6670a76cbd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:56.503465 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd9125-b881-41f7-abef-6670a76cbd34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:56.504399 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50672c3c-30ac-4dce-83f6-640d282a7df4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:56.512069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 105/202] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:54:56 2022] GET /identity/v3/role_assignments?user.id=647894bd0bf945388be1fe8277e49550&scope.project.id=c0e8ecfbb10647af9a7496598e58b208&role.id=75cb869182334e59ae0d8a7540e39b9b => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:56.516145 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50672c3c-30ac-4dce-83f6-640d282a7df4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:56.557260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:56.644642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50672c3c-30ac-4dce-83f6-640d282a7df4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:56.686812 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df715e68-4bad-4d37-ac19-ed89e51df2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:56.687484 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df715e68-4bad-4d37-ac19-ed89e51df2ae None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:56.687767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df715e68-4bad-4d37-ac19-ed89e51df2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:56.688181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df715e68-4bad-4d37-ac19-ed89e51df2ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:56.709130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd9125-b881-41f7-abef-6670a76cbd34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:56.710632 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd9125-b881-41f7-abef-6670a76cbd34 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:56.792897 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df715e68-4bad-4d37-ac19-ed89e51df2ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:56.795747 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df715e68-4bad-4d37-ac19-ed89e51df2ae None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:56.837651 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:56.893924 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 98/203] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:54:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:54:56.895953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd9125-b881-41f7-abef-6670a76cbd34 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:56.924241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:56.937752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 106/204] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:54:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:54:56.943153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df715e68-4bad-4d37-ac19-ed89e51df2ae None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:57.049327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd9125-b881-41f7-abef-6670a76cbd34 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:57.073289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df715e68-4bad-4d37-ac19-ed89e51df2ae None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:57.101525 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e3bd3-570b-4a84-891d-882391641eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:57.102978 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e3bd3-570b-4a84-891d-882391641eda None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:57.104542 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e3bd3-570b-4a84-891d-882391641eda None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:57.105359 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e3bd3-570b-4a84-891d-882391641eda None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:57.108287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e3bd3-570b-4a84-891d-882391641eda None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:57.110238 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e3bd3-570b-4a84-891d-882391641eda None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:57.113565 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 99/205] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:56 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:54:57.121782 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e3bd3-570b-4a84-891d-882391641eda None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:57.130019 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5e90d-103b-44ce-a996-75ef67fd384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:57.130770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5e90d-103b-44ce-a996-75ef67fd384c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:57.131050 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5e90d-103b-44ce-a996-75ef67fd384c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:57.131343 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5e90d-103b-44ce-a996-75ef67fd384c None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:57.137354 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5e90d-103b-44ce-a996-75ef67fd384c None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:57.139153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5e90d-103b-44ce-a996-75ef67fd384c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:57.144373 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 107/206] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:56 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:57.150313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5e90d-103b-44ce-a996-75ef67fd384c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:57.154002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:57.225040 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:57.243559 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e3bd3-570b-4a84-891d-882391641eda None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:57.282793 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de02a7-2aef-41d2-8f2a-57a645332b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:57.284908 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de02a7-2aef-41d2-8f2a-57a645332b78 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:57.285430 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de02a7-2aef-41d2-8f2a-57a645332b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:57.285910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de02a7-2aef-41d2-8f2a-57a645332b78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:57.286963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de02a7-2aef-41d2-8f2a-57a645332b78 None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8, user.id=dee5ef6b04b740aeb5f4123d0a488036) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:57.287514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de02a7-2aef-41d2-8f2a-57a645332b78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:57.289276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de02a7-2aef-41d2-8f2a-57a645332b78 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:57.295878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 100/207] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:54:57 2022] GET /identity/v3/role_assignments?user.id=dee5ef6b04b740aeb5f4123d0a488036&scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:57.306369 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5e90d-103b-44ce-a996-75ef67fd384c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:57.347650 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedec177-2722-47cb-aad8-838c74ca2b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:57.348786 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedec177-2722-47cb-aad8-838c74ca2b92 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:57.349292 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedec177-2722-47cb-aad8-838c74ca2b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:57.349789 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedec177-2722-47cb-aad8-838c74ca2b92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:57.350868 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedec177-2722-47cb-aad8-838c74ca2b92 None admin] RBAC: Adding query filter params (role.id=a1fb3b01c7424cf18f71b9a2b8333f03, scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8, user.id=dee5ef6b04b740aeb5f4123d0a488036) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:57.351407 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedec177-2722-47cb-aad8-838c74ca2b92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:57.353117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedec177-2722-47cb-aad8-838c74ca2b92 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:57.360192 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 108/208] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:54:57 2022] GET /identity/v3/role_assignments?user.id=dee5ef6b04b740aeb5f4123d0a488036&scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8&role.id=a1fb3b01c7424cf18f71b9a2b8333f03 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:58.450245 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bc3bf-83a8-41aa-a962-ae0f5ff1ff26 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:58.450761 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bc3bf-83a8-41aa-a962-ae0f5ff1ff26 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:58.450833 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bc3bf-83a8-41aa-a962-ae0f5ff1ff26 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:58.452260 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 101/209] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:58.458589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533055eb-1520-461f-87f7-77c9cd1e28dc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:58.459062 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533055eb-1520-461f-87f7-77c9cd1e28dc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:58.459138 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533055eb-1520-461f-87f7-77c9cd1e28dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:58.476247 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-533055eb-1520-461f-87f7-77c9cd1e28dc None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:58.477515 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-533055eb-1520-461f-87f7-77c9cd1e28dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:58.541838 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:58.551098 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 109/210] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:54:58.559785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2285aa4-a6f3-44d3-96ec-885a78b3b095 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:58.560113 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2285aa4-a6f3-44d3-96ec-885a78b3b095 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:58.560402 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2285aa4-a6f3-44d3-96ec-885a78b3b095 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:58.561783 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 102/211] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:58.567544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce603f17-3c95-4fd3-b73f-ee12c6634450 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:58.567847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce603f17-3c95-4fd3-b73f-ee12c6634450 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:58.568162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce603f17-3c95-4fd3-b73f-ee12c6634450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:58.575608 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2285aa4-a6f3-44d3-96ec-885a78b3b095 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:58.585726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ce603f17-3c95-4fd3-b73f-ee12c6634450 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:58.586916 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ce603f17-3c95-4fd3-b73f-ee12c6634450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:58.663810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 110/212] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:54:58.687990 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce603f17-3c95-4fd3-b73f-ee12c6634450 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:58.705165 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2285aa4-a6f3-44d3-96ec-885a78b3b095 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:58.751158 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630c0bd-3b51-4d49-8067-a282cfbbe1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:58.752104 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c0bd-3b51-4d49-8067-a282cfbbe1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:58.752631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c0bd-3b51-4d49-8067-a282cfbbe1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:58.753541 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c0bd-3b51-4d49-8067-a282cfbbe1f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:58.768713 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630c0bd-3b51-4d49-8067-a282cfbbe1f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:54:58.778721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-0630c0bd-3b51-4d49-8067-a282cfbbe1f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:54:58.778721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:54:58.778721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:54:58.778721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:54:58.778721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:54:58.778721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:54:58.778721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:54:58.778721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:54:58.778721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:54:58.778721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:54:58.778721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:54:58.778721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:54:58.778721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:54:58.778721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:54:58.778721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:54:58.778721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:54:58.780520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:54:58.780520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:54:58.780520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:54:58.780520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:54:58.780520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:54:58.780520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:54:58.780520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:54:58.780520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:54:58.780520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:54:58.780520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:54:58.780520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:54:58.780520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:54:58.780520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:54:58.780520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:54:58.780520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:54:58.780520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:54:58.781932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:54:58.781932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:54:58.781932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:54:58.781932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:54:58.781932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:54:58.781932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:54:58.781932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:54:58.781932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:54:58.781932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:54:58.781932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:54:58.781932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:54:58.781932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:54:58.781932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 103/213] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:54:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:54:58.785793 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630c0bd-3b51-4d49-8067-a282cfbbe1f5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:58.797483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:58.802987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce603f17-3c95-4fd3-b73f-ee12c6634450 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:58.830275 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:58.840398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74389d6-ba00-4df4-924c-32ae2c53c674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:58.841420 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74389d6-ba00-4df4-924c-32ae2c53c674 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:58.841709 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74389d6-ba00-4df4-924c-32ae2c53c674 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:58.841979 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74389d6-ba00-4df4-924c-32ae2c53c674 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:58.843200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74389d6-ba00-4df4-924c-32ae2c53c674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:58.844833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74389d6-ba00-4df4-924c-32ae2c53c674 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:58.846472 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 111/214] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:54:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:54:58.851820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74389d6-ba00-4df4-924c-32ae2c53c674 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:58.897561 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630c0bd-3b51-4d49-8067-a282cfbbe1f5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:58.933779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800fa84-f974-4832-b35f-3d80fe17531c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:58.934373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800fa84-f974-4832-b35f-3d80fe17531c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:58.934657 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800fa84-f974-4832-b35f-3d80fe17531c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:58.935043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800fa84-f974-4832-b35f-3d80fe17531c None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:58.935803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800fa84-f974-4832-b35f-3d80fe17531c None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:58.936142 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800fa84-f974-4832-b35f-3d80fe17531c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:58.937633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800fa84-f974-4832-b35f-3d80fe17531c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:58.951675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 104/215] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:54:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:54:58.952712 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800fa84-f974-4832-b35f-3d80fe17531c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:58.958044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74389d6-ba00-4df4-924c-32ae2c53c674 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:58.995753 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1887676-c5ef-4cd4-9711-3c4bd120e92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:58.996473 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1887676-c5ef-4cd4-9711-3c4bd120e92f None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:58.996812 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1887676-c5ef-4cd4-9711-3c4bd120e92f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:58.997087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1887676-c5ef-4cd4-9711-3c4bd120e92f None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:58.997871 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1887676-c5ef-4cd4-9711-3c4bd120e92f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:58.999431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1887676-c5ef-4cd4-9711-3c4bd120e92f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:59.026068 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 112/216] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:54:58 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:54:59.032822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:59.073774 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800fa84-f974-4832-b35f-3d80fe17531c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:59.114356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adc57b-daa7-41d3-bdbb-cc39c32f2ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:59.115257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adc57b-daa7-41d3-bdbb-cc39c32f2ffe None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:59.115541 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adc57b-daa7-41d3-bdbb-cc39c32f2ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:59.115816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adc57b-daa7-41d3-bdbb-cc39c32f2ffe None admin] PATH_INFO: `/v3/users/f12dd478705d4175ac917f60a1a9090e` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:59.132156 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adc57b-daa7-41d3-bdbb-cc39c32f2ffe None admin] RBAC: Authorizing `identity:get_user(user_id=f12dd478705d4175ac917f60a1a9090e)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:59.133683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adc57b-daa7-41d3-bdbb-cc39c32f2ffe None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:59.135513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 105/217] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:54:58 2022] GET /identity/v3/users/f12dd478705d4175ac917f60a1a9090e => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:59.141159 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1887676-c5ef-4cd4-9711-3c4bd120e92f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:59.197955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:59.254108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1887676-c5ef-4cd4-9711-3c4bd120e92f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:59.290982 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b75a5-b670-42c2-9c11-a5507908db57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:59.291641 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b75a5-b670-42c2-9c11-a5507908db57 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:59.291939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b75a5-b670-42c2-9c11-a5507908db57 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:59.292234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b75a5-b670-42c2-9c11-a5507908db57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:59.367363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b75a5-b670-42c2-9c11-a5507908db57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:59.368891 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b75a5-b670-42c2-9c11-a5507908db57 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:59.429803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:59.496305 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 113/218] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:54:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:54:59.502392 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adc57b-daa7-41d3-bdbb-cc39c32f2ffe None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:59.607804 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adc57b-daa7-41d3-bdbb-cc39c32f2ffe None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:59.636958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:59.645744 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1b793-b867-4685-8eb3-53d8c10cf6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:59.646629 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1b793-b867-4685-8eb3-53d8c10cf6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:59.647133 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1b793-b867-4685-8eb3-53d8c10cf6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:59.647701 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1b793-b867-4685-8eb3-53d8c10cf6d4 None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:59.653478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1b793-b867-4685-8eb3-53d8c10cf6d4 None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:59.655760 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c815a9-c1a6-409a-8965-dc922f00c7d8 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:59.656286 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c815a9-c1a6-409a-8965-dc922f00c7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:59.656567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c815a9-c1a6-409a-8965-dc922f00c7d8 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:59.657327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1b793-b867-4685-8eb3-53d8c10cf6d4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:59.658211 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 114/219] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:54:59.659775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 106/220] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:54:59 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:59.659990 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d13b5-9520-4792-86c8-d7fcb72d51d6 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:59.660235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d13b5-9520-4792-86c8-d7fcb72d51d6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:59.660508 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d13b5-9520-4792-86c8-d7fcb72d51d6 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:59.661938 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 115/221] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:54:59.663718 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234e0d4-80f2-4bb4-a6b2-e477eaa0bfc8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:59.664040 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234e0d4-80f2-4bb4-a6b2-e477eaa0bfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:59.664329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234e0d4-80f2-4bb4-a6b2-e477eaa0bfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:59.667175 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d13b5-9520-4792-86c8-d7fcb72d51d6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:59.683167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b234e0d4-80f2-4bb4-a6b2-e477eaa0bfc8 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:59.684722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b234e0d4-80f2-4bb4-a6b2-e477eaa0bfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:59.769660 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 107/222] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:59.775991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840557d0-27fd-47e8-a181-51a910f05bd8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:59.775991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840557d0-27fd-47e8-a181-51a910f05bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:59.775991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840557d0-27fd-47e8-a181-51a910f05bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:59.800231 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d13b5-9520-4792-86c8-d7fcb72d51d6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:54:59.801342 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-840557d0-27fd-47e8-a181-51a910f05bd8 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:54:59.804043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-840557d0-27fd-47e8-a181-51a910f05bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:54:59.838450 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adc347-67c3-47d7-a963-cc65fe4b9d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:54:59.839116 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adc347-67c3-47d7-a963-cc65fe4b9d01 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:54:59.839397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adc347-67c3-47d7-a963-cc65fe4b9d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:54:59.839677 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adc347-67c3-47d7-a963-cc65fe4b9d01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:54:59.840574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adc347-67c3-47d7-a963-cc65fe4b9d01 None admin] RBAC: Adding query filter params (role.id=0251662126f747ad9804858316f8573a, scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8, user.id=f12dd478705d4175ac917f60a1a9090e) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:54:59.840887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adc347-67c3-47d7-a963-cc65fe4b9d01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:54:59.842578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adc347-67c3-47d7-a963-cc65fe4b9d01 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:54:59.848994 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 116/223] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:54:59 2022] GET /identity/v3/role_assignments?user.id=f12dd478705d4175ac917f60a1a9090e&scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8&role.id=0251662126f747ad9804858316f8573a => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:54:59.849787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adc347-67c3-47d7-a963-cc65fe4b9d01 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:54:59.894398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:54:59.896247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 108/224] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:54:59.923725 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840557d0-27fd-47e8-a181-51a910f05bd8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:00.020329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:00.086665 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840557d0-27fd-47e8-a181-51a910f05bd8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:00.116247 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adc347-67c3-47d7-a963-cc65fe4b9d01 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:00.129932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb755fe-5bbf-4c52-bc8b-fd10eb9999c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:00.130754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb755fe-5bbf-4c52-bc8b-fd10eb9999c8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:00.131041 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb755fe-5bbf-4c52-bc8b-fd10eb9999c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:00.131320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb755fe-5bbf-4c52-bc8b-fd10eb9999c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:00.152710 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb755fe-5bbf-4c52-bc8b-fd10eb9999c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:00.169547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-1fb755fe-5bbf-4c52-bc8b-fd10eb9999c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:00.169547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:00.169547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:00.169547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:00.169547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:00.169547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:00.169547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:00.169547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:00.169547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:00.169547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:00.169547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:00.169547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:00.169547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:00.169547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:00.169547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:00.169547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:00.170724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:00.170724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:00.170724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:00.170724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:00.170724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:00.170724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:00.170724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:00.170724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:00.170724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:00.170724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:00.170724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:00.170724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:00.170724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:00.170724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:00.170724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:00.170724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:00.171771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:00.171771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:00.171771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:00.171771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:00.171771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:00.171771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:00.171771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:00.171771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:00.171771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:00.171771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:00.171771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:00.171771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:00.171771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 109/225] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:54:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:00.180614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb755fe-5bbf-4c52-bc8b-fd10eb9999c8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:00.185789 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844b2b1-ec4d-4907-a77e-5354077b30da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:00.186594 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844b2b1-ec4d-4907-a77e-5354077b30da None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:00.186879 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844b2b1-ec4d-4907-a77e-5354077b30da None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:00.187156 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844b2b1-ec4d-4907-a77e-5354077b30da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:00.208734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844b2b1-ec4d-4907-a77e-5354077b30da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:00.216457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-4844b2b1-ec4d-4907-a77e-5354077b30da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:00.216457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:00.216457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:00.216457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:00.216457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:00.216457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:00.216457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:00.216457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:00.216457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:00.216457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:00.216457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:00.216457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:00.216457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:00.216457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:00.216457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:00.216457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:00.217304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:00.217304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:00.217304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:00.217304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:00.217304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:00.217304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:00.217304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:00.217304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:00.217304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:00.217304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:00.217304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:00.217304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:00.217304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:00.217304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:00.217304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:00.217304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:00.218087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:00.218087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:00.218087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:00.218087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:00.218087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:00.218087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:00.218087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:00.218087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:00.218087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:00.218087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:00.218087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:00.218087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:00.218087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 117/226] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:54:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:00.229239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844b2b1-ec4d-4907-a77e-5354077b30da None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:00.325752 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb755fe-5bbf-4c52-bc8b-fd10eb9999c8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:00.342744 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:00.362576 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035f086-fa3f-4806-836b-83fb77a09926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:00.363264 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035f086-fa3f-4806-836b-83fb77a09926 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:00.363545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035f086-fa3f-4806-836b-83fb77a09926 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:00.363820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035f086-fa3f-4806-836b-83fb77a09926 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:00.364710 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d035f086-fa3f-4806-836b-83fb77a09926 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:00.365028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d035f086-fa3f-4806-836b-83fb77a09926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:00.366414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d035f086-fa3f-4806-836b-83fb77a09926 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:00.375559 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 110/227] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:00.381873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035f086-fa3f-4806-836b-83fb77a09926 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:00.406210 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:00.482093 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844b2b1-ec4d-4907-a77e-5354077b30da None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:00.488300 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035f086-fa3f-4806-836b-83fb77a09926 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:00.523070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe957d-c679-44b4-99bf-2270269edf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:00.523999 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe957d-c679-44b4-99bf-2270269edf4e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:00.524315 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe957d-c679-44b4-99bf-2270269edf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:00.524575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe957d-c679-44b4-99bf-2270269edf4e None admin] PATH_INFO: `/v3/users/dee5ef6b04b740aeb5f4123d0a488036` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:00.525881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe957d-c679-44b4-99bf-2270269edf4e None admin] RBAC: Authorizing `identity:get_user(user_id=dee5ef6b04b740aeb5f4123d0a488036)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:00.527482 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe957d-c679-44b4-99bf-2270269edf4e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:00.529602 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 111/228] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:55:00 2022] GET /identity/v3/users/dee5ef6b04b740aeb5f4123d0a488036 => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:00.535667 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe957d-c679-44b4-99bf-2270269edf4e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:00.586978 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:00.588674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b44941-1333-4e66-a2dc-1d395b202e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:00.589365 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b44941-1333-4e66-a2dc-1d395b202e4c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:00.589646 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b44941-1333-4e66-a2dc-1d395b202e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:00.589951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b44941-1333-4e66-a2dc-1d395b202e4c None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:00.590713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b44941-1333-4e66-a2dc-1d395b202e4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:00.591028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b44941-1333-4e66-a2dc-1d395b202e4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:00.592571 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b44941-1333-4e66-a2dc-1d395b202e4c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:00.611400 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 118/229] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:00.617558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b44941-1333-4e66-a2dc-1d395b202e4c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:00.648710 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe957d-c679-44b4-99bf-2270269edf4e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:00.686263 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6174e0b-af90-4c96-95a5-217f7e273ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:00.687188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6174e0b-af90-4c96-95a5-217f7e273ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:00.687479 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6174e0b-af90-4c96-95a5-217f7e273ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:00.687816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6174e0b-af90-4c96-95a5-217f7e273ed7 None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:00.689052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6174e0b-af90-4c96-95a5-217f7e273ed7 None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:00.690643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6174e0b-af90-4c96-95a5-217f7e273ed7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:00.692718 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 112/230] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:00 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:00.698149 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6174e0b-af90-4c96-95a5-217f7e273ed7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:00.759463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b44941-1333-4e66-a2dc-1d395b202e4c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:00.811545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6174e0b-af90-4c96-95a5-217f7e273ed7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:00.826341 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:00.828627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25244b-7c24-4c8a-bd2f-040d54d39fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:00.829610 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25244b-7c24-4c8a-bd2f-040d54d39fad None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:00.831399 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25244b-7c24-4c8a-bd2f-040d54d39fad None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:00.831399 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25244b-7c24-4c8a-bd2f-040d54d39fad None admin] PATH_INFO: `/v3/users/dee5ef6b04b740aeb5f4123d0a488036` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:00.832082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25244b-7c24-4c8a-bd2f-040d54d39fad None admin] RBAC: Authorizing `identity:get_user(user_id=dee5ef6b04b740aeb5f4123d0a488036)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:00.833657 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25244b-7c24-4c8a-bd2f-040d54d39fad None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:00.835314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 119/231] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:55:00 2022] GET /identity/v3/users/dee5ef6b04b740aeb5f4123d0a488036 => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:00.841290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25244b-7c24-4c8a-bd2f-040d54d39fad None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:00.847872 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:00.850369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7092a3-c34c-4ede-929e-c6724943d14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:00.851282 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7092a3-c34c-4ede-929e-c6724943d14b None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:00.851571 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7092a3-c34c-4ede-929e-c6724943d14b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:00.851859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7092a3-c34c-4ede-929e-c6724943d14b None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8/users/dee5ef6b04b740aeb5f4123d0a488036/roles/a1fb3b01c7424cf18f71b9a2b8333f03` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:00.854944 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7092a3-c34c-4ede-929e-c6724943d14b None admin] RBAC: Authorizing `identity:create_grant(project_id=2df7204786d44ef282e29fc4ad4ecfa8, user_id=dee5ef6b04b740aeb5f4123d0a488036, role_id=a1fb3b01c7424cf18f71b9a2b8333f03)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:00.856543 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7092a3-c34c-4ede-929e-c6724943d14b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:00.874659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 113/232] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:55:00 2022] PUT /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8/users/dee5ef6b04b740aeb5f4123d0a488036/roles/a1fb3b01c7424cf18f71b9a2b8333f03 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:55:00.960055 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25244b-7c24-4c8a-bd2f-040d54d39fad None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:00.997783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc16c3e-664d-47b5-92c7-e9236814df45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:00.998657 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc16c3e-664d-47b5-92c7-e9236814df45 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:00.998941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc16c3e-664d-47b5-92c7-e9236814df45 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:00.999219 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc16c3e-664d-47b5-92c7-e9236814df45 None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:01.000475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc16c3e-664d-47b5-92c7-e9236814df45 None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:01.002085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc16c3e-664d-47b5-92c7-e9236814df45 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:01.004245 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 120/233] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:00 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:01.009990 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7092a3-c34c-4ede-929e-c6724943d14b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:01.151735 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7092a3-c34c-4ede-929e-c6724943d14b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:01.187581 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197f83d-a3ad-49ee-9db6-299839b1c27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:01.188517 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f83d-a3ad-49ee-9db6-299839b1c27b None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:01.188815 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f83d-a3ad-49ee-9db6-299839b1c27b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:01.189090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f83d-a3ad-49ee-9db6-299839b1c27b None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8/users/dee5ef6b04b740aeb5f4123d0a488036/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:01.191639 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197f83d-a3ad-49ee-9db6-299839b1c27b None admin] RBAC: Authorizing `identity:create_grant(project_id=2df7204786d44ef282e29fc4ad4ecfa8, user_id=dee5ef6b04b740aeb5f4123d0a488036, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:01.193126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197f83d-a3ad-49ee-9db6-299839b1c27b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:01.213417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 114/234] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:55:01 2022] PUT /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8/users/dee5ef6b04b740aeb5f4123d0a488036/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:55:01.953177 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626c74-311e-4f99-8e12-2dff06572cf9 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:01.955339 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1883577-4974-4511-b4d9-c1f7f59dcb01 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:01.956179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1883577-4974-4511-b4d9-c1f7f59dcb01 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:01.956692 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626c74-311e-4f99-8e12-2dff06572cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:01.957162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1883577-4974-4511-b4d9-c1f7f59dcb01 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:01.957629 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626c74-311e-4f99-8e12-2dff06572cf9 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:01.960967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 121/235] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:01.961357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 115/236] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:01.966236 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f898d2-4c85-405b-95d6-4a2ff770f3e1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:01.966766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f898d2-4c85-405b-95d6-4a2ff770f3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:01.967242 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f898d2-4c85-405b-95d6-4a2ff770f3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:01.986670 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aba39e-90c8-4fb1-8a16-8d294ea8e4df None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:01.987861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aba39e-90c8-4fb1-8a16-8d294ea8e4df None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:01.988385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aba39e-90c8-4fb1-8a16-8d294ea8e4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:01.994176 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-98f898d2-4c85-405b-95d6-4a2ff770f3e1 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:01.996430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-98f898d2-4c85-405b-95d6-4a2ff770f3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:02.014643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d4aba39e-90c8-4fb1-8a16-8d294ea8e4df None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:02.015879 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d4aba39e-90c8-4fb1-8a16-8d294ea8e4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:02.066830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:02.125115 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 122/237] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:02.135363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 116/238] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:02.151298 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f898d2-4c85-405b-95d6-4a2ff770f3e1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:02.160250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:02.172621 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aba39e-90c8-4fb1-8a16-8d294ea8e4df None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:02.342278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aba39e-90c8-4fb1-8a16-8d294ea8e4df None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:02.365436 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f898d2-4c85-405b-95d6-4a2ff770f3e1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:02.388373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e797b-cf2d-4394-90da-454717fe8e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:02.389176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e797b-cf2d-4394-90da-454717fe8e19 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:02.389457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e797b-cf2d-4394-90da-454717fe8e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:02.389728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e797b-cf2d-4394-90da-454717fe8e19 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:02.413357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e797b-cf2d-4394-90da-454717fe8e19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:02.421356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-0f7e797b-cf2d-4394-90da-454717fe8e19 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:55:02.421356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:02.421356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:02.421356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:02.421356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:02.421356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:02.421356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:02.421356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:02.421356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:02.421356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:02.421356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:02.421356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:02.421356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:02.421356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:02.421356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:02.421356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:02.422243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:02.422243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:02.422243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:02.422243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:02.422243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:02.422243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:02.422243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:02.422243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:02.422243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:02.422243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:02.422243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:02.422243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:02.422243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:02.422243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:02.422243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:02.422243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:02.423001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:02.423001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:02.423001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:02.423001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:02.423001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:02.423001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:02.423001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:02.423001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:02.423001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:02.423001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:02.423001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:55:02.423001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:02.425046 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 117/239] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:02.439031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e797b-cf2d-4394-90da-454717fe8e19 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:02.454100 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d353c-901b-428c-86b8-48b8c0e05281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:02.458039 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d353c-901b-428c-86b8-48b8c0e05281 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:02.458329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d353c-901b-428c-86b8-48b8c0e05281 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:02.458609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d353c-901b-428c-86b8-48b8c0e05281 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:02.461698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d353c-901b-428c-86b8-48b8c0e05281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:02.463162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d353c-901b-428c-86b8-48b8c0e05281 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:02.465643 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 123/240] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:02.472487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d606d-2652-43bf-80df-bb3d4413e043 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:02.472777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d606d-2652-43bf-80df-bb3d4413e043 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:02.473055 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d606d-2652-43bf-80df-bb3d4413e043 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:02.474388 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 124/241] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:55:02.475082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d606d-2652-43bf-80df-bb3d4413e043 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:02.493756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:02.567333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:02.575987 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e797b-cf2d-4394-90da-454717fe8e19 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:02.604671 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d606d-2652-43bf-80df-bb3d4413e043 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:02.615909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa01ba1-63b2-4185-adc3-618a94b98f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:02.616692 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa01ba1-63b2-4185-adc3-618a94b98f52 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:02.617053 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa01ba1-63b2-4185-adc3-618a94b98f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:02.617405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa01ba1-63b2-4185-adc3-618a94b98f52 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:02.618240 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa01ba1-63b2-4185-adc3-618a94b98f52 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:02.618624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa01ba1-63b2-4185-adc3-618a94b98f52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:02.620105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa01ba1-63b2-4185-adc3-618a94b98f52 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:02.629617 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 118/242] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:55:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:02.631040 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e21c-6e55-4561-863f-2b387b39ec60 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:02.631480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e21c-6e55-4561-863f-2b387b39ec60 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:02.631863 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e21c-6e55-4561-863f-2b387b39ec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:02.640088 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8295d8-5131-4809-a2ba-0152fc1c1beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:02.640765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8295d8-5131-4809-a2ba-0152fc1c1beb None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:02.641054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8295d8-5131-4809-a2ba-0152fc1c1beb None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:02.641333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8295d8-5131-4809-a2ba-0152fc1c1beb None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:02.642056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8295d8-5131-4809-a2ba-0152fc1c1beb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:02.644087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8295d8-5131-4809-a2ba-0152fc1c1beb None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:02.650182 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6ec1e21c-6e55-4561-863f-2b387b39ec60 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:02.651565 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6ec1e21c-6e55-4561-863f-2b387b39ec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:02.665811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 125/243] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:55:02 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:55:02.666646 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8295d8-5131-4809-a2ba-0152fc1c1beb None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:02.746632 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 119/244] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:02.771961 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1e21c-6e55-4561-863f-2b387b39ec60 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:02.792089 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:02.794659 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8295d8-5131-4809-a2ba-0152fc1c1beb None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:02.828555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:02.859489 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15c558-93f0-4776-a8a0-eab793684c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:02.860348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15c558-93f0-4776-a8a0-eab793684c7d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:02.860641 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15c558-93f0-4776-a8a0-eab793684c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:02.860922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15c558-93f0-4776-a8a0-eab793684c7d None admin] PATH_INFO: `/v3/users/e249f47733124ce9a0a219d2cea9ff12` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:02.899024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15c558-93f0-4776-a8a0-eab793684c7d None admin] RBAC: Authorizing `identity:get_user(user_id=e249f47733124ce9a0a219d2cea9ff12)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:02.900620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15c558-93f0-4776-a8a0-eab793684c7d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:02.904869 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 126/245] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:55:02 2022] GET /identity/v3/users/e249f47733124ce9a0a219d2cea9ff12 => generated 297 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:02.912346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15c558-93f0-4776-a8a0-eab793684c7d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:02.934154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1e21c-6e55-4561-863f-2b387b39ec60 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:02.984254 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d1937-b3ca-4ebf-9ede-ad83fc1a28a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:02.985348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d1937-b3ca-4ebf-9ede-ad83fc1a28a8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:02.985800 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d1937-b3ca-4ebf-9ede-ad83fc1a28a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:02.986223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d1937-b3ca-4ebf-9ede-ad83fc1a28a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:03.001192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d1937-b3ca-4ebf-9ede-ad83fc1a28a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:03.012522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-c97d1937-b3ca-4ebf-9ede-ad83fc1a28a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:03.012522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:03.012522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:03.012522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:03.012522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:03.012522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:03.012522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:03.012522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:03.012522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:03.012522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:03.012522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:03.012522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:03.012522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:03.012522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:03.012522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:03.012522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:03.013582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:03.013582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:03.013582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:03.013582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:03.013582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:03.013582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:03.013582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:03.013582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:03.013582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:03.013582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:03.013582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:03.013582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:03.013582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:03.013582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:03.013582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:03.013582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:03.014578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:03.014578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:03.014578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:03.014578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:03.014578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:03.014578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:03.014578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:03.014578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:03.014578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:03.014578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:03.014578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:03.014578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:03.018784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 120/246] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:03.028136 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d1937-b3ca-4ebf-9ede-ad83fc1a28a8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:03.055415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15c558-93f0-4776-a8a0-eab793684c7d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:03.100778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b023a60-4d97-47e3-aa43-6c5e911f4fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:03.101524 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b023a60-4d97-47e3-aa43-6c5e911f4fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:03.101888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b023a60-4d97-47e3-aa43-6c5e911f4fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:03.102143 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b023a60-4d97-47e3-aa43-6c5e911f4fa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:03.141733 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:03.171665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:03.178473 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d1937-b3ca-4ebf-9ede-ad83fc1a28a8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:03.190586 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b023a60-4d97-47e3-aa43-6c5e911f4fa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:03.192229 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b023a60-4d97-47e3-aa43-6c5e911f4fa3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:03.224764 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038a528-606e-4ae9-9d47-45f823b05c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:03.225453 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038a528-606e-4ae9-9d47-45f823b05c30 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:03.225742 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038a528-606e-4ae9-9d47-45f823b05c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:03.226023 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038a528-606e-4ae9-9d47-45f823b05c30 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:03.226792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038a528-606e-4ae9-9d47-45f823b05c30 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:03.227808 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038a528-606e-4ae9-9d47-45f823b05c30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:03.229407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038a528-606e-4ae9-9d47-45f823b05c30 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:03.246022 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 121/247] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:55:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:03.252847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038a528-606e-4ae9-9d47-45f823b05c30 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:03.327583 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 127/248] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 11:55:03.333031 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b023a60-4d97-47e3-aa43-6c5e911f4fa3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:03.366191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038a528-606e-4ae9-9d47-45f823b05c30 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:03.404829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c540b6b-03aa-41e0-b14a-782624c36aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:03.405643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c540b6b-03aa-41e0-b14a-782624c36aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:03.405926 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c540b6b-03aa-41e0-b14a-782624c36aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:03.406204 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c540b6b-03aa-41e0-b14a-782624c36aa9 None admin] PATH_INFO: `/v3/users/f12dd478705d4175ac917f60a1a9090e` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:03.407505 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c540b6b-03aa-41e0-b14a-782624c36aa9 None admin] RBAC: Authorizing `identity:get_user(user_id=f12dd478705d4175ac917f60a1a9090e)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:03.409637 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c540b6b-03aa-41e0-b14a-782624c36aa9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:03.411474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 122/249] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:55:03 2022] GET /identity/v3/users/f12dd478705d4175ac917f60a1a9090e => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:03.416846 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c540b6b-03aa-41e0-b14a-782624c36aa9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:03.429555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:03.432284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:03.451982 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b023a60-4d97-47e3-aa43-6c5e911f4fa3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:03.490510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab258b5-58f1-452e-8a98-71dc22a4dce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:03.491502 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab258b5-58f1-452e-8a98-71dc22a4dce6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:03.491792 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab258b5-58f1-452e-8a98-71dc22a4dce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:03.492111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab258b5-58f1-452e-8a98-71dc22a4dce6 None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:03.493435 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab258b5-58f1-452e-8a98-71dc22a4dce6 None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:03.495021 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab258b5-58f1-452e-8a98-71dc22a4dce6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:03.497129 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 128/250] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:03 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:03.503420 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab258b5-58f1-452e-8a98-71dc22a4dce6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:03.535328 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c540b6b-03aa-41e0-b14a-782624c36aa9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:03.572300 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e57b0b-0047-43b0-a501-2c3883bfe9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:03.573227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e57b0b-0047-43b0-a501-2c3883bfe9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:03.573517 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e57b0b-0047-43b0-a501-2c3883bfe9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:03.573849 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e57b0b-0047-43b0-a501-2c3883bfe9a0 None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:03.575068 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e57b0b-0047-43b0-a501-2c3883bfe9a0 None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:03.576571 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e57b0b-0047-43b0-a501-2c3883bfe9a0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:03.583635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 123/251] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:03 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:03.584947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e57b0b-0047-43b0-a501-2c3883bfe9a0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:03.616665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab258b5-58f1-452e-8a98-71dc22a4dce6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:03.656234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b862a99-2a6a-4a97-b540-d1f15886791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:03.656831 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b862a99-2a6a-4a97-b540-d1f15886791e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:03.657121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b862a99-2a6a-4a97-b540-d1f15886791e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:03.657401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b862a99-2a6a-4a97-b540-d1f15886791e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:03.658256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b862a99-2a6a-4a97-b540-d1f15886791e None admin] RBAC: Adding query filter params (role.id=75cb869182334e59ae0d8a7540e39b9b, scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8, user.id=e249f47733124ce9a0a219d2cea9ff12) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:03.658677 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b862a99-2a6a-4a97-b540-d1f15886791e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:03.660355 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b862a99-2a6a-4a97-b540-d1f15886791e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:03.665040 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:03.668050 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 129/252] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:55:03 2022] GET /identity/v3/role_assignments?user.id=e249f47733124ce9a0a219d2cea9ff12&scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8&role.id=75cb869182334e59ae0d8a7540e39b9b => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:03.698254 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e57b0b-0047-43b0-a501-2c3883bfe9a0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:03.739850 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2887008-3183-42f0-9c95-57268ae7a72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:03.740808 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2887008-3183-42f0-9c95-57268ae7a72a None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:03.741098 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2887008-3183-42f0-9c95-57268ae7a72a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:03.741385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2887008-3183-42f0-9c95-57268ae7a72a None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8/users/f12dd478705d4175ac917f60a1a9090e/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:03.749720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2887008-3183-42f0-9c95-57268ae7a72a None admin] RBAC: Authorizing `identity:create_grant(project_id=2df7204786d44ef282e29fc4ad4ecfa8, user_id=f12dd478705d4175ac917f60a1a9090e, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:03.751261 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2887008-3183-42f0-9c95-57268ae7a72a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:03.779136 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 124/253] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:55:03 2022] PUT /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8/users/f12dd478705d4175ac917f60a1a9090e/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:55:03.990007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6b24c-5946-4970-be23-0fcb7b886890 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:03.990351 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6b24c-5946-4970-be23-0fcb7b886890 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:03.990522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6b24c-5946-4970-be23-0fcb7b886890 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:03.991973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 130/254] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:03.997858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa65a98-df31-4819-8bc9-2d27c23dc755 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:03.998362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa65a98-df31-4819-8bc9-2d27c23dc755 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:03.998433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa65a98-df31-4819-8bc9-2d27c23dc755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:04.016032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbcb67-3aee-46c3-a71a-4498820f6225 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:04.016361 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbcb67-3aee-46c3-a71a-4498820f6225 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:04.016599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbcb67-3aee-46c3-a71a-4498820f6225 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:04.018321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 131/255] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:04.024207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac229-58fd-486d-affa-ab85938cd226 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:04.024487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac229-58fd-486d-affa-ab85938cd226 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:04.024762 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac229-58fd-486d-affa-ab85938cd226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:04.029584 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-aaa65a98-df31-4819-8bc9-2d27c23dc755 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:04.030821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-aaa65a98-df31-4819-8bc9-2d27c23dc755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:04.043804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-670ac229-58fd-486d-affa-ab85938cd226 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:04.045757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-670ac229-58fd-486d-affa-ab85938cd226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:04.059478 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:04.165538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 125/257] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:04.165948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 132/257] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:04.192942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa65a98-df31-4819-8bc9-2d27c23dc755 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:04.202585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ac229-58fd-486d-affa-ab85938cd226 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:04.307401 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:04.385645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa65a98-df31-4819-8bc9-2d27c23dc755 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:04.389383 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ac229-58fd-486d-affa-ab85938cd226 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:04.449423 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38356fbd-d1ee-4be2-a40e-c6b9056025b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:04.450367 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5dd93-8fbd-4a4f-a002-ab5ff9b75eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:04.451404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5dd93-8fbd-4a4f-a002-ab5ff9b75eeb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:04.452416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38356fbd-d1ee-4be2-a40e-c6b9056025b9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:04.452893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5dd93-8fbd-4a4f-a002-ab5ff9b75eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:04.453363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5dd93-8fbd-4a4f-a002-ab5ff9b75eeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:04.454315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38356fbd-d1ee-4be2-a40e-c6b9056025b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:04.454957 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38356fbd-d1ee-4be2-a40e-c6b9056025b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:04.474323 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5dd93-8fbd-4a4f-a002-ab5ff9b75eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:04.482283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b4a5dd93-8fbd-4a4f-a002-ab5ff9b75eeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:04.482283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:04.482283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:04.482283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:04.482283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:04.482283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:04.482283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:04.482283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:04.482283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:04.482283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:04.482283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:04.482283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:04.482283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:04.482283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:04.482283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:04.482283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:04.483122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:04.483122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:04.483122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:04.483122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:04.483122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:04.483122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:04.483122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:04.483122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:04.483122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:04.483122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:04.483122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:04.483122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:04.483122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:04.483122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:04.483122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:04.483122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:04.483881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:04.483881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:04.483881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:04.483881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:04.483881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:04.483881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:04.483881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:04.483881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:04.483881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:04.483881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:04.483881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:04.483881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:04.485488 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38356fbd-d1ee-4be2-a40e-c6b9056025b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:04.494376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-38356fbd-d1ee-4be2-a40e-c6b9056025b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:04.494376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:04.494376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:04.494376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:04.494376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:04.494376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:04.494376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:04.494376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:04.494376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:04.494376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:04.494376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:04.494376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:04.494376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:04.494376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:04.494376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:04.494376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:04.495209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:04.495209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:04.495209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:04.495209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:04.495209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:04.495209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:04.495209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:04.495209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:04.495209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:04.495209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:04.495209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:04.495209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:04.495209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:04.495209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:04.495209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:04.495209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:04.496017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:04.496017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:04.496017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:04.496017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:04.496017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:04.496017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:04.496017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:04.496017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:04.496017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:04.496017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:04.496017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:04.496017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:04.498668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 126/258] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:55:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:04.504204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 133/259] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:55:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:04.505903 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5dd93-8fbd-4a4f-a002-ab5ff9b75eeb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:04.509647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38356fbd-d1ee-4be2-a40e-c6b9056025b9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:04.524772 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:04.682528 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38356fbd-d1ee-4be2-a40e-c6b9056025b9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:04.687441 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5dd93-8fbd-4a4f-a002-ab5ff9b75eeb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:04.728415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:04.747332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beae18f-4ac0-44fe-92c3-87357b369fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:04.748036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beae18f-4ac0-44fe-92c3-87357b369fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:04.748324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beae18f-4ac0-44fe-92c3-87357b369fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:04.748601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beae18f-4ac0-44fe-92c3-87357b369fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:04.749655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beae18f-4ac0-44fe-92c3-87357b369fd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:04.749971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beae18f-4ac0-44fe-92c3-87357b369fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:04.751451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beae18f-4ac0-44fe-92c3-87357b369fd1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:04.761599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d957fc7-1f23-490f-86e5-d75990b14d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:04.762282 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d957fc7-1f23-490f-86e5-d75990b14d28 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:04.762566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d957fc7-1f23-490f-86e5-d75990b14d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:04.762844 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d957fc7-1f23-490f-86e5-d75990b14d28 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:04.763605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d957fc7-1f23-490f-86e5-d75990b14d28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:04.763925 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d957fc7-1f23-490f-86e5-d75990b14d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:04.765307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d957fc7-1f23-490f-86e5-d75990b14d28 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:04.774197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 134/260] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:04.779467 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beae18f-4ac0-44fe-92c3-87357b369fd1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:04.783126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 127/261] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:04.788973 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d957fc7-1f23-490f-86e5-d75990b14d28 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:04.917133 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d957fc7-1f23-490f-86e5-d75990b14d28 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:04.944386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:04.985179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e051665-0073-470b-b324-b031b6818aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:04.986106 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e051665-0073-470b-b324-b031b6818aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:04.986391 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e051665-0073-470b-b324-b031b6818aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:04.986663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e051665-0073-470b-b324-b031b6818aa5 None admin] PATH_INFO: `/v3/users/dee5ef6b04b740aeb5f4123d0a488036` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:04.988955 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e051665-0073-470b-b324-b031b6818aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=dee5ef6b04b740aeb5f4123d0a488036)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:04.991127 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e051665-0073-470b-b324-b031b6818aa5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:04.993626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 128/262] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:55:04 2022] GET /identity/v3/users/dee5ef6b04b740aeb5f4123d0a488036 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:04.999741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e051665-0073-470b-b324-b031b6818aa5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:05.007640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beae18f-4ac0-44fe-92c3-87357b369fd1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:05.057585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516acab-8dd1-4cc2-81a2-c28a446a696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:05.058470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516acab-8dd1-4cc2-81a2-c28a446a696f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:05.058754 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516acab-8dd1-4cc2-81a2-c28a446a696f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:05.059032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516acab-8dd1-4cc2-81a2-c28a446a696f None admin] PATH_INFO: `/v3/users/dee5ef6b04b740aeb5f4123d0a488036` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:05.063387 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516acab-8dd1-4cc2-81a2-c28a446a696f None admin] RBAC: Authorizing `identity:get_user(user_id=dee5ef6b04b740aeb5f4123d0a488036)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:05.066362 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516acab-8dd1-4cc2-81a2-c28a446a696f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:05.071586 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 135/263] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:55:04 2022] GET /identity/v3/users/dee5ef6b04b740aeb5f4123d0a488036 => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:05.078218 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516acab-8dd1-4cc2-81a2-c28a446a696f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:05.109247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:05.160331 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e051665-0073-470b-b324-b031b6818aa5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:05.197260 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc011c3-2e8d-41c2-a2e7-1dbd911e03cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:05.198316 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc011c3-2e8d-41c2-a2e7-1dbd911e03cf None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:05.198775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc011c3-2e8d-41c2-a2e7-1dbd911e03cf None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:05.199245 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc011c3-2e8d-41c2-a2e7-1dbd911e03cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:05.229555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516acab-8dd1-4cc2-81a2-c28a446a696f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:05.278188 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc36b4-ebe3-4d9c-bf93-724c27081909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:05.278866 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc36b4-ebe3-4d9c-bf93-724c27081909 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:05.279391 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc36b4-ebe3-4d9c-bf93-724c27081909 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:05.279544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc36b4-ebe3-4d9c-bf93-724c27081909 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:05.286305 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc011c3-2e8d-41c2-a2e7-1dbd911e03cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:05.286843 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:05.288267 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc011c3-2e8d-41c2-a2e7-1dbd911e03cf None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:05.365466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:05.417707 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 129/264] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:05.423641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc011c3-2e8d-41c2-a2e7-1dbd911e03cf None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:05.428990 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc36b4-ebe3-4d9c-bf93-724c27081909 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:05.430584 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc36b4-ebe3-4d9c-bf93-724c27081909 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:05.527336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc011c3-2e8d-41c2-a2e7-1dbd911e03cf None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:05.567105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a3ea2-94ab-4aab-b23c-69db4117b1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:05.568537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a3ea2-94ab-4aab-b23c-69db4117b1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:05.568997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a3ea2-94ab-4aab-b23c-69db4117b1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:05.569443 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a3ea2-94ab-4aab-b23c-69db4117b1b9 None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:05.570796 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a3ea2-94ab-4aab-b23c-69db4117b1b9 None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:05.574277 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a3ea2-94ab-4aab-b23c-69db4117b1b9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:05.576195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 130/265] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:05 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:05.582129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a3ea2-94ab-4aab-b23c-69db4117b1b9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:05.610454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:05.650026 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 136/266] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:05.654995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc36b4-ebe3-4d9c-bf93-724c27081909 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:05.702247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a3ea2-94ab-4aab-b23c-69db4117b1b9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:05.722971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:05.747665 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46461b54-c1c5-4aa1-ab5c-de8efe6b2f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:05.749074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46461b54-c1c5-4aa1-ab5c-de8efe6b2f57 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:05.749656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46461b54-c1c5-4aa1-ab5c-de8efe6b2f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:05.750278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46461b54-c1c5-4aa1-ab5c-de8efe6b2f57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:05.751967 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46461b54-c1c5-4aa1-ab5c-de8efe6b2f57 None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8, user.id=dee5ef6b04b740aeb5f4123d0a488036) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:05.752412 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46461b54-c1c5-4aa1-ab5c-de8efe6b2f57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:05.754264 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46461b54-c1c5-4aa1-ab5c-de8efe6b2f57 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:05.760952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 131/267] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:55:05 2022] GET /identity/v3/role_assignments?user.id=dee5ef6b04b740aeb5f4123d0a488036&scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:05.850787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc36b4-ebe3-4d9c-bf93-724c27081909 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:05.891308 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d1fbb-59e4-4c04-8f01-198789ac0426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:05.892210 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d1fbb-59e4-4c04-8f01-198789ac0426 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:05.892492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d1fbb-59e4-4c04-8f01-198789ac0426 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:05.892771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d1fbb-59e4-4c04-8f01-198789ac0426 None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:05.894021 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d1fbb-59e4-4c04-8f01-198789ac0426 None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:05.895469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d1fbb-59e4-4c04-8f01-198789ac0426 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:05.897646 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 137/268] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:05 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:05.902982 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46461b54-c1c5-4aa1-ab5c-de8efe6b2f57 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:06.009081 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:06.025330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46461b54-c1c5-4aa1-ab5c-de8efe6b2f57 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:06.064605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a467dce-74ae-491b-8119-e1edb84d8339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:06.065316 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a467dce-74ae-491b-8119-e1edb84d8339 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:06.065670 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a467dce-74ae-491b-8119-e1edb84d8339 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:06.065962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a467dce-74ae-491b-8119-e1edb84d8339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:06.066804 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a467dce-74ae-491b-8119-e1edb84d8339 None admin] RBAC: Adding query filter params (role.id=a1fb3b01c7424cf18f71b9a2b8333f03, scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8, user.id=dee5ef6b04b740aeb5f4123d0a488036) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:06.067118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a467dce-74ae-491b-8119-e1edb84d8339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:06.068611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a467dce-74ae-491b-8119-e1edb84d8339 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:06.075712 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 132/269] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:55:05 2022] GET /identity/v3/role_assignments?user.id=dee5ef6b04b740aeb5f4123d0a488036&scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8&role.id=a1fb3b01c7424cf18f71b9a2b8333f03 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:06.405811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fadb3-d02f-4cc2-a55f-2804908fb118 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:06.406774 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fadb3-d02f-4cc2-a55f-2804908fb118 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:06.407253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fadb3-d02f-4cc2-a55f-2804908fb118 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:06.408968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 138/270] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:06.414629 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b8a95-0d02-4450-8661-e11fca9b9e1f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:06.414921 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b8a95-0d02-4450-8661-e11fca9b9e1f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:06.415200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b8a95-0d02-4450-8661-e11fca9b9e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:06.436997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f76b8a95-0d02-4450-8661-e11fca9b9e1f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:06.438214 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f76b8a95-0d02-4450-8661-e11fca9b9e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:06.518126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 133/271] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:06.543115 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fadb3-d02f-4cc2-a55f-2804908fb118 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:06.672952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fadb3-d02f-4cc2-a55f-2804908fb118 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:06.678334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:06.722623 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59cbac-18db-4fc7-894d-ad7af9e8d642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:06.723794 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59cbac-18db-4fc7-894d-ad7af9e8d642 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:06.724402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59cbac-18db-4fc7-894d-ad7af9e8d642 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:06.724964 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59cbac-18db-4fc7-894d-ad7af9e8d642 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:06.738124 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59cbac-18db-4fc7-894d-ad7af9e8d642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:06.746313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-bf59cbac-18db-4fc7-894d-ad7af9e8d642 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:06.746313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:06.746313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:06.746313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:06.746313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:06.746313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:06.746313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:06.746313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:06.746313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:06.746313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:06.746313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:06.746313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:06.746313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:06.746313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:06.746313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:06.746313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:06.747232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:06.747232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:06.747232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:06.747232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:06.747232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:06.747232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:06.747232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:06.747232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:06.747232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:06.747232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:06.747232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:06.747232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:06.747232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:06.747232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:06.747232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:06.747232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:06.748082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:06.748082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:06.748082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:06.748082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:06.748082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:06.748082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:06.748082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:06.748082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:06.748082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:06.748082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:06.748082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:06.748082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:06.750836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 139/272] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:06.757009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b8a95-0d02-4450-8661-e11fca9b9e1f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:06.852175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:06.873426 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b8a95-0d02-4450-8661-e11fca9b9e1f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:06.909393 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd68c8-18c6-4226-aca8-3ee6884ecbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:06.910080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd68c8-18c6-4226-aca8-3ee6884ecbfb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:06.910358 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd68c8-18c6-4226-aca8-3ee6884ecbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:06.910631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd68c8-18c6-4226-aca8-3ee6884ecbfb None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:06.911381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd68c8-18c6-4226-aca8-3ee6884ecbfb None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:06.911685 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd68c8-18c6-4226-aca8-3ee6884ecbfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:06.913091 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd68c8-18c6-4226-aca8-3ee6884ecbfb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:06.921769 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 134/273] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:55:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:06.925470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84821cdf-1024-40c3-a482-ea7242ed2cd8 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:06.926115 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84821cdf-1024-40c3-a482-ea7242ed2cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:06.926596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84821cdf-1024-40c3-a482-ea7242ed2cd8 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:06.927019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd68c8-18c6-4226-aca8-3ee6884ecbfb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:06.928576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 140/274] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:06.933956 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0cc79-891f-4b8b-a9ed-88baef96a14f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:06.934458 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0cc79-891f-4b8b-a9ed-88baef96a14f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:06.934936 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0cc79-891f-4b8b-a9ed-88baef96a14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:06.954438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0ab0cc79-891f-4b8b-a9ed-88baef96a14f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:06.956798 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0ab0cc79-891f-4b8b-a9ed-88baef96a14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:07.040635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 141/275] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:07.045028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec58584-7789-4d46-8827-8bc7a6870581 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:07.045028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec58584-7789-4d46-8827-8bc7a6870581 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:07.045028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec58584-7789-4d46-8827-8bc7a6870581 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:07.045028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 142/276] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:07.049566 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acd4eb-03d3-4438-99e9-8e574e4fcb07 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:07.049830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd68c8-18c6-4226-aca8-3ee6884ecbfb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:07.050257 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acd4eb-03d3-4438-99e9-8e574e4fcb07 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:07.050511 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acd4eb-03d3-4438-99e9-8e574e4fcb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:07.071182 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f2acd4eb-03d3-4438-99e9-8e574e4fcb07 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:07.072400 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f2acd4eb-03d3-4438-99e9-8e574e4fcb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:07.090009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87234167-7811-46cb-9b33-482369de4e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:07.090888 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87234167-7811-46cb-9b33-482369de4e53 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:07.091169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87234167-7811-46cb-9b33-482369de4e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:07.091447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87234167-7811-46cb-9b33-482369de4e53 None admin] PATH_INFO: `/v3/users/43d5f5a25cab4f9aa29c52fdf05bb1ce` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:07.105427 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:07.108228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87234167-7811-46cb-9b33-482369de4e53 None admin] RBAC: Authorizing `identity:get_user(user_id=43d5f5a25cab4f9aa29c52fdf05bb1ce)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:07.110892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87234167-7811-46cb-9b33-482369de4e53 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:07.116649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 135/277] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:55:06 2022] GET /identity/v3/users/43d5f5a25cab4f9aa29c52fdf05bb1ce => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:07.116649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87234167-7811-46cb-9b33-482369de4e53 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:07.144751 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 143/278] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:07.145534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acd4eb-03d3-4438-99e9-8e574e4fcb07 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:07.172068 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:07.230801 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87234167-7811-46cb-9b33-482369de4e53 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:07.250486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acd4eb-03d3-4438-99e9-8e574e4fcb07 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:07.263886 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e6886-589a-4fff-ab6b-3df1a9c2295b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:07.264736 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e6886-589a-4fff-ab6b-3df1a9c2295b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:07.265023 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e6886-589a-4fff-ab6b-3df1a9c2295b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:07.265307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e6886-589a-4fff-ab6b-3df1a9c2295b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:07.266601 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e6886-589a-4fff-ab6b-3df1a9c2295b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:07.268131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e6886-589a-4fff-ab6b-3df1a9c2295b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:07.270272 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 136/279] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:07.272701 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e6886-589a-4fff-ab6b-3df1a9c2295b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:07.285364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73596144-7ed8-4c14-ac1e-10b23c866884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:07.286021 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73596144-7ed8-4c14-ac1e-10b23c866884 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:07.286310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73596144-7ed8-4c14-ac1e-10b23c866884 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:07.286592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73596144-7ed8-4c14-ac1e-10b23c866884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:07.287435 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73596144-7ed8-4c14-ac1e-10b23c866884 None admin] RBAC: Adding query filter params (role.id=0251662126f747ad9804858316f8573a, user.id=43d5f5a25cab4f9aa29c52fdf05bb1ce, scope.system=all) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:07.287752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73596144-7ed8-4c14-ac1e-10b23c866884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:07.289240 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73596144-7ed8-4c14-ac1e-10b23c866884 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:07.294111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 144/280] 10.222.0.73 () {56 vars in 1308 bytes} [Thu May 19 11:55:07 2022] GET /identity/v3/role_assignments?user.id=43d5f5a25cab4f9aa29c52fdf05bb1ce&scope.system=all&role.id=0251662126f747ad9804858316f8573a => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:07.295546 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96dcf-d5bf-4ca7-a847-41ad918fd9e3 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:07.295840 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96dcf-d5bf-4ca7-a847-41ad918fd9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:07.296162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96dcf-d5bf-4ca7-a847-41ad918fd9e3 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:07.297604 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 145/281] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:07.302484 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f96dcf-d5bf-4ca7-a847-41ad918fd9e3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:07.342398 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:07.384516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e6886-589a-4fff-ab6b-3df1a9c2295b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:07.413071 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:07.423204 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476332b6-fbc3-4172-922b-068492003f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:07.424043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476332b6-fbc3-4172-922b-068492003f6f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:07.424364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476332b6-fbc3-4172-922b-068492003f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:07.424644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476332b6-fbc3-4172-922b-068492003f6f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:07.431130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f96dcf-d5bf-4ca7-a847-41ad918fd9e3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:07.436635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476332b6-fbc3-4172-922b-068492003f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:07.445057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-476332b6-fbc3-4172-922b-068492003f6f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:55:07.445057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:07.445057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:07.445057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:07.445057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:07.445057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:07.445057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:07.445057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:07.445057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:07.445057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:07.445057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:07.445057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:07.445057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:07.445057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:07.445057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:07.445057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:07.446201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:07.446201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:07.446201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:07.446201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:07.446201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:07.446201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:07.446201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:07.446201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:07.446201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:07.446201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:07.446201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:07.446201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:07.446201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:07.446201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:07.446201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:07.446201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:07.447172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:07.447172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:07.447172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:07.447172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:07.447172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:07.447172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:07.447172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:07.447172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:07.447172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:07.447172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:07.447172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:55:07.447172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:07.447172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 137/282] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:07.447995 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadcc9a-4ba3-456f-8aae-468220644df0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:07.447995 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadcc9a-4ba3-456f-8aae-468220644df0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:07.448126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadcc9a-4ba3-456f-8aae-468220644df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:07.474660 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6eadcc9a-4ba3-456f-8aae-468220644df0 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:07.475006 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6eadcc9a-4ba3-456f-8aae-468220644df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:07.475831 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3950234-6beb-4b51-8771-b55628654478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:07.476559 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3950234-6beb-4b51-8771-b55628654478 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:07.476848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3950234-6beb-4b51-8771-b55628654478 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:07.477159 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3950234-6beb-4b51-8771-b55628654478 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:07.478666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3950234-6beb-4b51-8771-b55628654478 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:07.479325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3950234-6beb-4b51-8771-b55628654478 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:07.502085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 146/283] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:55:07 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:55:07.503339 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3950234-6beb-4b51-8771-b55628654478 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:07.567522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 138/284] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:07.594279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadcc9a-4ba3-456f-8aae-468220644df0 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:07.650375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3950234-6beb-4b51-8771-b55628654478 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:07.662400 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:07.691554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f6ca8-68b9-4ccb-a1e1-4ac09c2b33e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:07.692435 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f6ca8-68b9-4ccb-a1e1-4ac09c2b33e9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:07.692820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f6ca8-68b9-4ccb-a1e1-4ac09c2b33e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:07.693195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f6ca8-68b9-4ccb-a1e1-4ac09c2b33e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:07.694095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f6ca8-68b9-4ccb-a1e1-4ac09c2b33e9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:07.694507 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f6ca8-68b9-4ccb-a1e1-4ac09c2b33e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:07.696047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f6ca8-68b9-4ccb-a1e1-4ac09c2b33e9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:07.705128 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 147/285] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:55:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:07.710826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f6ca8-68b9-4ccb-a1e1-4ac09c2b33e9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:07.714657 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadcc9a-4ba3-456f-8aae-468220644df0 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:07.722324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:07.766945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f9cdb-d227-4d23-9271-454a0088fa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:07.767979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f9cdb-d227-4d23-9271-454a0088fa08 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:07.768284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f9cdb-d227-4d23-9271-454a0088fa08 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:07.768561 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f9cdb-d227-4d23-9271-454a0088fa08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:07.779620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f9cdb-d227-4d23-9271-454a0088fa08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:07.787355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-ee5f9cdb-d227-4d23-9271-454a0088fa08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:07.787355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:07.787355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:07.787355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:07.787355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:07.787355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:07.787355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:07.787355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:07.787355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:07.787355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:07.787355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:07.787355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:07.787355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:07.787355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:07.787355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:07.787355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:07.788357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:07.788357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:07.788357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:07.788357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:07.788357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:07.788357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:07.788357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:07.788357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:07.788357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:07.788357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:07.788357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:07.788357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:07.788357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:07.788357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:07.788357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:07.788357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:07.789353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:07.789353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:07.789353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:07.789353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:07.789353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:07.789353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:07.789353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:07.789353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:07.789353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:07.789353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:07.789353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:07.789353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:07.789353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 139/286] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:07.796896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f9cdb-d227-4d23-9271-454a0088fa08 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:07.844823 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f6ca8-68b9-4ccb-a1e1-4ac09c2b33e9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:07.886767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c08c0-ce97-45df-89ab-1789e0fdfa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:07.888018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c08c0-ce97-45df-89ab-1789e0fdfa0a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:07.888518 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c08c0-ce97-45df-89ab-1789e0fdfa0a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:07.888988 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c08c0-ce97-45df-89ab-1789e0fdfa0a None admin] PATH_INFO: `/v3/users/e249f47733124ce9a0a219d2cea9ff12` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:07.890506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c08c0-ce97-45df-89ab-1789e0fdfa0a None admin] RBAC: Authorizing `identity:get_user(user_id=e249f47733124ce9a0a219d2cea9ff12)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:07.892368 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c08c0-ce97-45df-89ab-1789e0fdfa0a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:07.894617 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 148/287] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:55:07 2022] GET /identity/v3/users/e249f47733124ce9a0a219d2cea9ff12 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:07.900363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c08c0-ce97-45df-89ab-1789e0fdfa0a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:07.922709 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f9cdb-d227-4d23-9271-454a0088fa08 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:07.946494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:07.980599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f3858-2aac-4fbf-9ed4-8189215d18e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:07.981539 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f3858-2aac-4fbf-9ed4-8189215d18e9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:07.981833 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f3858-2aac-4fbf-9ed4-8189215d18e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:07.982118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f3858-2aac-4fbf-9ed4-8189215d18e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:07.983329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f3858-2aac-4fbf-9ed4-8189215d18e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:07.983650 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f3858-2aac-4fbf-9ed4-8189215d18e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:07.985718 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f3858-2aac-4fbf-9ed4-8189215d18e9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:07.999345 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 140/288] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:55:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:08.005333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f3858-2aac-4fbf-9ed4-8189215d18e9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:08.011381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:08.039958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c08c0-ce97-45df-89ab-1789e0fdfa0a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:08.087865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c7369-ea3b-44f6-b134-3d43a978f4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:08.089448 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c7369-ea3b-44f6-b134-3d43a978f4dc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:08.090174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c7369-ea3b-44f6-b134-3d43a978f4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:08.090647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c7369-ea3b-44f6-b134-3d43a978f4dc None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:08.092103 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c7369-ea3b-44f6-b134-3d43a978f4dc None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:08.093902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c7369-ea3b-44f6-b134-3d43a978f4dc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:08.096678 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 149/289] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:07 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:08.103302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c7369-ea3b-44f6-b134-3d43a978f4dc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:08.170353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f3858-2aac-4fbf-9ed4-8189215d18e9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:08.219072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c7369-ea3b-44f6-b134-3d43a978f4dc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:08.246443 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe5191-ba3b-49cb-b8e6-f64b0ceb3c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:08.247350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe5191-ba3b-49cb-b8e6-f64b0ceb3c6e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:08.247612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe5191-ba3b-49cb-b8e6-f64b0ceb3c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:08.247888 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe5191-ba3b-49cb-b8e6-f64b0ceb3c6e None admin] PATH_INFO: `/v3/users/f12dd478705d4175ac917f60a1a9090e` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:08.252930 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe5191-ba3b-49cb-b8e6-f64b0ceb3c6e None admin] RBAC: Authorizing `identity:get_user(user_id=f12dd478705d4175ac917f60a1a9090e)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:08.254322 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe5191-ba3b-49cb-b8e6-f64b0ceb3c6e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:08.255988 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 141/290] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:55:08 2022] GET /identity/v3/users/f12dd478705d4175ac917f60a1a9090e => generated 297 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:08.263872 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe5191-ba3b-49cb-b8e6-f64b0ceb3c6e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:08.264622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0c240-3f00-45cc-a45f-2f732909585c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:08.265553 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0c240-3f00-45cc-a45f-2f732909585c None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:08.265898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0c240-3f00-45cc-a45f-2f732909585c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:08.266186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0c240-3f00-45cc-a45f-2f732909585c None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8/users/e249f47733124ce9a0a219d2cea9ff12/roles/75cb869182334e59ae0d8a7540e39b9b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:08.272696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0c240-3f00-45cc-a45f-2f732909585c None admin] RBAC: Authorizing `identity:create_grant(project_id=2df7204786d44ef282e29fc4ad4ecfa8, user_id=e249f47733124ce9a0a219d2cea9ff12, role_id=75cb869182334e59ae0d8a7540e39b9b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:08.274173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0c240-3f00-45cc-a45f-2f732909585c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:08.315941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 150/291] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:55:08 2022] PUT /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8/users/e249f47733124ce9a0a219d2cea9ff12/roles/75cb869182334e59ae0d8a7540e39b9b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:55:08.341021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:08.405945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe5191-ba3b-49cb-b8e6-f64b0ceb3c6e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:08.442911 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f4f52-495b-4e5e-843c-086ebd3c5f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:08.443945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f4f52-495b-4e5e-843c-086ebd3c5f29 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:08.444457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f4f52-495b-4e5e-843c-086ebd3c5f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:08.444927 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f4f52-495b-4e5e-843c-086ebd3c5f29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:08.519024 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f4f52-495b-4e5e-843c-086ebd3c5f29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:08.521022 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f4f52-495b-4e5e-843c-086ebd3c5f29 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:08.581754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:08.636071 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 142/292] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:08.637605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0c240-3f00-45cc-a45f-2f732909585c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:08.642706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:08.761524 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0c240-3f00-45cc-a45f-2f732909585c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:08.803078 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87ad5f-3e1c-4e7d-9e70-a1ab43d57630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:08.803976 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87ad5f-3e1c-4e7d-9e70-a1ab43d57630 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:08.804264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87ad5f-3e1c-4e7d-9e70-a1ab43d57630 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:08.804538 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87ad5f-3e1c-4e7d-9e70-a1ab43d57630 None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:08.806345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87ad5f-3e1c-4e7d-9e70-a1ab43d57630 None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:08.807801 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87ad5f-3e1c-4e7d-9e70-a1ab43d57630 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:08.809874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 151/293] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:08 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:08.815730 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f4f52-495b-4e5e-843c-086ebd3c5f29 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:08.939064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f4f52-495b-4e5e-843c-086ebd3c5f29 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:08.973905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49264a-1132-4154-9f20-4c4037ba64ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:08.974558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49264a-1132-4154-9f20-4c4037ba64ac None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:08.974841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49264a-1132-4154-9f20-4c4037ba64ac None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:08.975118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49264a-1132-4154-9f20-4c4037ba64ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:08.975976 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49264a-1132-4154-9f20-4c4037ba64ac None admin] RBAC: Adding query filter params (role.id=0251662126f747ad9804858316f8573a, scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8, user.id=f12dd478705d4175ac917f60a1a9090e) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:08.976290 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49264a-1132-4154-9f20-4c4037ba64ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:08.977717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49264a-1132-4154-9f20-4c4037ba64ac None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:08.983903 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 143/294] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:55:08 2022] GET /identity/v3/role_assignments?user.id=f12dd478705d4175ac917f60a1a9090e&scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8&role.id=0251662126f747ad9804858316f8573a => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:09.749559 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea83d0-fa19-439c-b54e-4704dd921b06 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:09.750058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea83d0-fa19-439c-b54e-4704dd921b06 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:09.750058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea83d0-fa19-439c-b54e-4704dd921b06 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:09.751686 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 152/295] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:09.756839 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d368d9d-3ec8-4773-b4b2-8bcfe727e9a1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:09.757249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d368d9d-3ec8-4773-b4b2-8bcfe727e9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:09.757431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d368d9d-3ec8-4773-b4b2-8bcfe727e9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:09.782017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3d368d9d-3ec8-4773-b4b2-8bcfe727e9a1 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:09.783209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3d368d9d-3ec8-4773-b4b2-8bcfe727e9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:09.791909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:09.856791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 144/296] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:09.878241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea83d0-fa19-439c-b54e-4704dd921b06 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:09.952884 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:09.986352 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea83d0-fa19-439c-b54e-4704dd921b06 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:10.024476 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551abf6-26fe-4648-8876-e5312f3f4fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:10.025189 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551abf6-26fe-4648-8876-e5312f3f4fad None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:10.025473 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551abf6-26fe-4648-8876-e5312f3f4fad None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:10.025748 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551abf6-26fe-4648-8876-e5312f3f4fad None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:10.036732 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551abf6-26fe-4648-8876-e5312f3f4fad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:10.044441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-4551abf6-26fe-4648-8876-e5312f3f4fad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:10.044441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:10.044441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:10.044441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:10.044441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:10.044441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:10.044441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:10.044441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:10.044441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:10.044441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:10.044441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:10.044441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:10.044441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:10.044441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:10.044441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:10.044441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:10.045609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:10.045609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:10.045609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:10.045609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:10.045609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:10.045609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:10.045609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:10.045609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:10.045609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:10.045609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:10.045609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:10.045609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:10.045609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:10.045609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:10.045609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:10.045609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:10.046384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:10.046384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:10.046384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:10.046384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:10.046384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:10.046384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:10.046384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:10.046384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:10.046384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:10.046384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:10.046384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:10.046384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:10.046384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 153/297] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:10.053007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d368d9d-3ec8-4773-b4b2-8bcfe727e9a1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:10.159517 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d368d9d-3ec8-4773-b4b2-8bcfe727e9a1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:10.194724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c9d8a-797d-40a7-a55f-e3a55b137dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:10.195392 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c9d8a-797d-40a7-a55f-e3a55b137dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:10.195675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c9d8a-797d-40a7-a55f-e3a55b137dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:10.195966 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c9d8a-797d-40a7-a55f-e3a55b137dd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:10.196720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c9d8a-797d-40a7-a55f-e3a55b137dd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:10.197044 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c9d8a-797d-40a7-a55f-e3a55b137dd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:10.198388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c9d8a-797d-40a7-a55f-e3a55b137dd0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:10.207609 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 145/298] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:55:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:10.212830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551abf6-26fe-4648-8876-e5312f3f4fad None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:10.262255 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b18fd4-18ae-4e72-9bfc-c6652c6bd348 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:10.262567 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b18fd4-18ae-4e72-9bfc-c6652c6bd348 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:10.262820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b18fd4-18ae-4e72-9bfc-c6652c6bd348 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:10.264485 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 146/299] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:10.273696 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae2bc7-1e4b-49e5-bf54-9ef06331b519 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:10.274108 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae2bc7-1e4b-49e5-bf54-9ef06331b519 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:10.274548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae2bc7-1e4b-49e5-bf54-9ef06331b519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:10.288910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:10.295634 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6fae2bc7-1e4b-49e5-bf54-9ef06331b519 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:10.297260 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6fae2bc7-1e4b-49e5-bf54-9ef06331b519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:10.334540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551abf6-26fe-4648-8876-e5312f3f4fad None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:10.374417 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:10.384279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527ab34-693d-417b-9adc-51bbd6e44cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:10.385426 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527ab34-693d-417b-9adc-51bbd6e44cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:10.385913 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527ab34-693d-417b-9adc-51bbd6e44cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:10.386389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527ab34-693d-417b-9adc-51bbd6e44cb7 None admin] PATH_INFO: `/v3/users/43d5f5a25cab4f9aa29c52fdf05bb1ce` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:10.387893 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527ab34-693d-417b-9adc-51bbd6e44cb7 None admin] RBAC: Authorizing `identity:get_user(user_id=43d5f5a25cab4f9aa29c52fdf05bb1ce)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:10.388060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 147/300] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:10.389798 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527ab34-693d-417b-9adc-51bbd6e44cb7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:10.391883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 154/301] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:55:10 2022] GET /identity/v3/users/43d5f5a25cab4f9aa29c52fdf05bb1ce => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:10.403417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae2bc7-1e4b-49e5-bf54-9ef06331b519 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:10.412935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527ab34-693d-417b-9adc-51bbd6e44cb7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:10.510835 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae2bc7-1e4b-49e5-bf54-9ef06331b519 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:10.546683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10f7bc-c85c-489a-b2da-457388c471de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:10.547362 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527ab34-693d-417b-9adc-51bbd6e44cb7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:10.547485 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10f7bc-c85c-489a-b2da-457388c471de None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:10.547751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10f7bc-c85c-489a-b2da-457388c471de None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:10.548062 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10f7bc-c85c-489a-b2da-457388c471de None admin] PATH_INFO: `/v3/system/users/43d5f5a25cab4f9aa29c52fdf05bb1ce/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:10.550085 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10f7bc-c85c-489a-b2da-457388c471de None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=43d5f5a25cab4f9aa29c52fdf05bb1ce, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:10.551473 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10f7bc-c85c-489a-b2da-457388c471de None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:10.553502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:10.562350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 148/302] 10.222.0.73 () {58 vars in 1334 bytes} [Thu May 19 11:55:10 2022] PUT /identity/v3/system/users/43d5f5a25cab4f9aa29c52fdf05bb1ce/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:55:10.564369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76868be-c9a0-4e08-833e-b7d6fd6ec658 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:10.564672 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76868be-c9a0-4e08-833e-b7d6fd6ec658 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:10.565565 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76868be-c9a0-4e08-833e-b7d6fd6ec658 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:10.567481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 149/303] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:10.573980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0bd5f-e1f0-4412-b4a8-d9f419d2973c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:10.574263 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0bd5f-e1f0-4412-b4a8-d9f419d2973c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:10.574575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0bd5f-e1f0-4412-b4a8-d9f419d2973c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:10.592842 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-28b0bd5f-e1f0-4412-b4a8-d9f419d2973c None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:10.594369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-28b0bd5f-e1f0-4412-b4a8-d9f419d2973c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:10.596178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe59ec-4cf4-4fc1-af97-267947ad4390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:10.597327 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe59ec-4cf4-4fc1-af97-267947ad4390 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:10.597755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe59ec-4cf4-4fc1-af97-267947ad4390 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:10.598170 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe59ec-4cf4-4fc1-af97-267947ad4390 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:10.610511 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe59ec-4cf4-4fc1-af97-267947ad4390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:10.619340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-65fe59ec-4cf4-4fc1-af97-267947ad4390 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:55:10.619340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:10.619340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:10.619340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:10.619340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:10.619340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:10.619340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:10.619340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:10.619340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:10.619340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:10.619340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:10.619340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:10.619340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:10.619340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:10.619340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:10.619340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:10.620506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:10.620506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:10.620506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:10.620506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:10.620506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:10.620506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:10.620506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:10.620506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:10.620506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:10.620506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:10.620506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:10.620506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:10.620506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:10.620506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:10.620506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:10.620506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:10.621477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:10.621477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:10.621477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:10.621477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:10.621477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:10.621477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:10.621477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:10.621477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:10.621477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:10.621477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:10.621477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:55:10.621477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:10.628917 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 155/304] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:10.630072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe59ec-4cf4-4fc1-af97-267947ad4390 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:10.674820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 150/305] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:10.699017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:10.700733 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0bd5f-e1f0-4412-b4a8-d9f419d2973c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:10.745192 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe59ec-4cf4-4fc1-af97-267947ad4390 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:10.783169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97e490-f433-4079-a492-3220fe21fef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:10.783863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e490-f433-4079-a492-3220fe21fef5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:10.784334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e490-f433-4079-a492-3220fe21fef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:10.784664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e490-f433-4079-a492-3220fe21fef5 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:10.785453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97e490-f433-4079-a492-3220fe21fef5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:10.785761 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97e490-f433-4079-a492-3220fe21fef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:10.787201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97e490-f433-4079-a492-3220fe21fef5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:10.798878 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 156/306] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:55:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:10.805024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97e490-f433-4079-a492-3220fe21fef5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:10.829223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0bd5f-e1f0-4412-b4a8-d9f419d2973c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:10.858675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:10.867828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4e919-23f6-4763-a251-a123392c15e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:10.869050 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4e919-23f6-4763-a251-a123392c15e1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:10.869480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4e919-23f6-4763-a251-a123392c15e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:10.869923 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4e919-23f6-4763-a251-a123392c15e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:10.871348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4e919-23f6-4763-a251-a123392c15e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:10.873107 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4e919-23f6-4763-a251-a123392c15e1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:10.875122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 151/307] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:10.881348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4e919-23f6-4763-a251-a123392c15e1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:10.925114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97e490-f433-4079-a492-3220fe21fef5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:10.952268 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:10.968165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73512a18-b8db-48b4-8850-0c6b22be586c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:10.969135 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73512a18-b8db-48b4-8850-0c6b22be586c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:10.969495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73512a18-b8db-48b4-8850-0c6b22be586c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:10.969846 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73512a18-b8db-48b4-8850-0c6b22be586c None admin] PATH_INFO: `/v3/users/32e507b5d5f044c3b0fdb0fda7274ec7` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:10.984475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73512a18-b8db-48b4-8850-0c6b22be586c None admin] RBAC: Authorizing `identity:get_user(user_id=32e507b5d5f044c3b0fdb0fda7274ec7)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:10.985940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73512a18-b8db-48b4-8850-0c6b22be586c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:10.988423 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 157/308] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:55:10 2022] GET /identity/v3/users/32e507b5d5f044c3b0fdb0fda7274ec7 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:10.989493 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f391d1-6338-46ca-b189-42558988cf72 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:10.989780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f391d1-6338-46ca-b189-42558988cf72 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:10.990056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f391d1-6338-46ca-b189-42558988cf72 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:10.991285 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 158/309] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:10.993579 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f391d1-6338-46ca-b189-42558988cf72 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:11.006417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4e919-23f6-4763-a251-a123392c15e1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:11.040683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b6109-7b71-4b84-b735-ace447916448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:11.041352 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b6109-7b71-4b84-b735-ace447916448 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:11.041638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b6109-7b71-4b84-b735-ace447916448 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:11.041917 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b6109-7b71-4b84-b735-ace447916448 None admin] PATH_INFO: `/v3/groups` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:11.042600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b6109-7b71-4b84-b735-ace447916448 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:11.044060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b6109-7b71-4b84-b735-ace447916448 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:11.059825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 152/310] 10.222.0.73 () {60 vars in 1134 bytes} [Thu May 19 11:55:10 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:55:11.060891 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfdc25-3897-4787-82cd-468450b0a977 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:11.061181 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfdc25-3897-4787-82cd-468450b0a977 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:11.061459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfdc25-3897-4787-82cd-468450b0a977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:11.079678 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c5dfdc25-3897-4787-82cd-468450b0a977 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:11.080992 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c5dfdc25-3897-4787-82cd-468450b0a977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:11.140514 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f391d1-6338-46ca-b189-42558988cf72 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:11.142705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:11.171941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 153/311] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:11.187742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dcad2-2337-482c-bf68-86ecaaf81fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:11.188489 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dcad2-2337-482c-bf68-86ecaaf81fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:11.188768 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dcad2-2337-482c-bf68-86ecaaf81fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:11.189082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dcad2-2337-482c-bf68-86ecaaf81fc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:11.189971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dcad2-2337-482c-bf68-86ecaaf81fc8 None admin] RBAC: Adding query filter params (role.id=75cb869182334e59ae0d8a7540e39b9b, user.id=32e507b5d5f044c3b0fdb0fda7274ec7, scope.system=all) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:11.190399 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dcad2-2337-482c-bf68-86ecaaf81fc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:11.192458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfdc25-3897-4787-82cd-468450b0a977 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:11.193046 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dcad2-2337-482c-bf68-86ecaaf81fc8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:11.205089 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 159/312] 10.222.0.73 () {56 vars in 1308 bytes} [Thu May 19 11:55:10 2022] GET /identity/v3/role_assignments?user.id=32e507b5d5f044c3b0fdb0fda7274ec7&scope.system=all&role.id=75cb869182334e59ae0d8a7540e39b9b => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:11.320245 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfdc25-3897-4787-82cd-468450b0a977 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:11.360671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cac1b-819d-4cdd-bca7-07c3390ed61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:11.361494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cac1b-819d-4cdd-bca7-07c3390ed61c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:11.361837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cac1b-819d-4cdd-bca7-07c3390ed61c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:11.362091 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cac1b-819d-4cdd-bca7-07c3390ed61c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:11.385027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cac1b-819d-4cdd-bca7-07c3390ed61c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:11.393728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-148cac1b-819d-4cdd-bca7-07c3390ed61c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:55:11.393728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:11.393728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:11.393728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:11.393728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:11.393728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:11.393728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:11.393728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:11.393728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:11.393728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:11.393728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:11.393728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:11.393728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:11.393728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:11.393728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:11.393728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:11.394628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:11.394628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:11.394628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:11.394628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:11.394628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:11.394628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:11.394628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:11.394628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:11.394628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:11.394628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:11.394628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:11.394628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:11.394628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:11.394628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:11.394628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:11.394628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:11.395425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:11.395425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:11.395425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:11.395425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:11.395425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:11.395425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:11.395425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:11.395425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:11.395425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:11.395425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:11.395425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:55:11.395425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:11.395425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 154/313] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:11.401924 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dcad2-2337-482c-bf68-86ecaaf81fc8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:11.448984 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:11.506462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dcad2-2337-482c-bf68-86ecaaf81fc8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:11.545975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928df76-88d7-4e5f-b5f9-1a15fe32b6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:11.546823 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928df76-88d7-4e5f-b5f9-1a15fe32b6bc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:11.547118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928df76-88d7-4e5f-b5f9-1a15fe32b6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:11.547395 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928df76-88d7-4e5f-b5f9-1a15fe32b6bc None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:11.548177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928df76-88d7-4e5f-b5f9-1a15fe32b6bc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:11.548489 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928df76-88d7-4e5f-b5f9-1a15fe32b6bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:11.549906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928df76-88d7-4e5f-b5f9-1a15fe32b6bc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:11.558945 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 160/314] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:55:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:11.564355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cac1b-819d-4cdd-bca7-07c3390ed61c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:11.616494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:11.679146 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cac1b-819d-4cdd-bca7-07c3390ed61c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:11.714641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc00dd-ee62-42c7-af5b-9fd50580c1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:11.715573 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc00dd-ee62-42c7-af5b-9fd50580c1cb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:11.715862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc00dd-ee62-42c7-af5b-9fd50580c1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:11.716166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc00dd-ee62-42c7-af5b-9fd50580c1cb None admin] PATH_INFO: `/v3/users/e249f47733124ce9a0a219d2cea9ff12` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:11.717374 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc00dd-ee62-42c7-af5b-9fd50580c1cb None admin] RBAC: Authorizing `identity:get_user(user_id=e249f47733124ce9a0a219d2cea9ff12)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:11.718818 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc00dd-ee62-42c7-af5b-9fd50580c1cb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:11.720779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 155/315] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:55:11 2022] GET /identity/v3/users/e249f47733124ce9a0a219d2cea9ff12 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:11.725938 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928df76-88d7-4e5f-b5f9-1a15fe32b6bc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:11.842652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928df76-88d7-4e5f-b5f9-1a15fe32b6bc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:11.845420 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:11.878798 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ddadd-54d5-436b-b94f-bf151e5b8000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:11.879374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ddadd-54d5-436b-b94f-bf151e5b8000 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:11.879663 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ddadd-54d5-436b-b94f-bf151e5b8000 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:11.879965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ddadd-54d5-436b-b94f-bf151e5b8000 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:11.950750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ddadd-54d5-436b-b94f-bf151e5b8000 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:11.952256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ddadd-54d5-436b-b94f-bf151e5b8000 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:12.059310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 161/316] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:12.064451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc00dd-ee62-42c7-af5b-9fd50580c1cb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:12.166337 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc00dd-ee62-42c7-af5b-9fd50580c1cb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:12.180514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:12.202060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f2454-0f3f-48a1-9cbf-e9b5943b496e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:12.202909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f2454-0f3f-48a1-9cbf-e9b5943b496e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:12.203192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f2454-0f3f-48a1-9cbf-e9b5943b496e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:12.203467 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f2454-0f3f-48a1-9cbf-e9b5943b496e None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:12.204645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f2454-0f3f-48a1-9cbf-e9b5943b496e None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:12.206118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f2454-0f3f-48a1-9cbf-e9b5943b496e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:12.208100 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 156/317] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:12 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:12.213798 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ddadd-54d5-436b-b94f-bf151e5b8000 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:12.216874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:12.325527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ddadd-54d5-436b-b94f-bf151e5b8000 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:12.364866 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6296fcd-2039-4c33-90cd-673c6d26fc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:12.365876 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6296fcd-2039-4c33-90cd-673c6d26fc9b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:12.366380 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6296fcd-2039-4c33-90cd-673c6d26fc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:12.366848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6296fcd-2039-4c33-90cd-673c6d26fc9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:12.367879 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6296fcd-2039-4c33-90cd-673c6d26fc9b None admin] RBAC: Adding query filter params (role.id=75cb869182334e59ae0d8a7540e39b9b, scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8, user.id=e249f47733124ce9a0a219d2cea9ff12) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:12.368441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6296fcd-2039-4c33-90cd-673c6d26fc9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:12.370085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6296fcd-2039-4c33-90cd-673c6d26fc9b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:12.376850 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 162/318] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:55:12 2022] GET /identity/v3/role_assignments?user.id=e249f47733124ce9a0a219d2cea9ff12&scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8&role.id=75cb869182334e59ae0d8a7540e39b9b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:13.009722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f9aa8-0bec-4688-b793-90c433648a8e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.010132 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f9aa8-0bec-4688-b793-90c433648a8e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.010315 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f9aa8-0bec-4688-b793-90c433648a8e None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.011935 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 157/319] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:13.016994 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77707fc-cc99-497b-848a-db70315d117c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.017434 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77707fc-cc99-497b-848a-db70315d117c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.017617 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77707fc-cc99-497b-848a-db70315d117c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.035665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b77707fc-cc99-497b-848a-db70315d117c None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:13.036868 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b77707fc-cc99-497b-848a-db70315d117c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:13.097929 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:13.107944 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 163/320] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:13.127788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f9aa8-0bec-4688-b793-90c433648a8e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:13.235647 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f9aa8-0bec-4688-b793-90c433648a8e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:13.274748 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296babbf-a406-496d-9d2a-1575327a208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:13.275908 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296babbf-a406-496d-9d2a-1575327a208e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.276431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296babbf-a406-496d-9d2a-1575327a208e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.276906 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296babbf-a406-496d-9d2a-1575327a208e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.290118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296babbf-a406-496d-9d2a-1575327a208e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:13.298788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-296babbf-a406-496d-9d2a-1575327a208e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:13.298788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:13.298788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:13.298788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:13.298788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:13.298788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:13.298788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:13.298788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:13.298788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:13.298788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:13.298788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:13.298788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:13.298788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:13.298788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:13.298788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:13.298788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:13.299897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:13.299897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:13.299897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:13.299897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:13.299897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:13.299897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:13.299897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:13.299897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:13.299897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:13.299897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:13.299897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:13.299897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:13.299897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:13.299897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:13.299897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:13.299897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:13.300691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:13.300691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:13.300691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:13.300691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:13.300691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:13.300691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:13.300691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:13.300691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:13.300691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:13.300691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:13.300691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:13.300691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:13.301268 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 158/321] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:13.306659 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77707fc-cc99-497b-848a-db70315d117c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:13.416527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77707fc-cc99-497b-848a-db70315d117c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:13.450061 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d82fe-0ef6-48be-a93f-3fee9912d325 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.450349 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d82fe-0ef6-48be-a93f-3fee9912d325 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.450444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8a481-706e-4bb5-8e9c-e1d00d1a9647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:13.450657 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d82fe-0ef6-48be-a93f-3fee9912d325 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.451077 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8a481-706e-4bb5-8e9c-e1d00d1a9647 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.451360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8a481-706e-4bb5-8e9c-e1d00d1a9647 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.451634 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8a481-706e-4bb5-8e9c-e1d00d1a9647 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.452125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 159/322] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:55:13.452426 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8a481-706e-4bb5-8e9c-e1d00d1a9647 None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:13.452734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8a481-706e-4bb5-8e9c-e1d00d1a9647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:13.454116 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8a481-706e-4bb5-8e9c-e1d00d1a9647 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:13.457361 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6dc48-23c1-4611-bacc-ac9856fc8eba None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.457654 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6dc48-23c1-4611-bacc-ac9856fc8eba None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.457935 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6dc48-23c1-4611-bacc-ac9856fc8eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.463360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 164/323] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:55:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:13.464815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3eafb-82b4-4d3b-877c-b8549a1d0c86 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.465923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3eafb-82b4-4d3b-877c-b8549a1d0c86 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.466209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3eafb-82b4-4d3b-877c-b8549a1d0c86 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.467461 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 165/324] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:13.472542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f7b45-e22c-454f-8ca8-397d9abf9359 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.472826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f7b45-e22c-454f-8ca8-397d9abf9359 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.473105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f7b45-e22c-454f-8ca8-397d9abf9359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.475207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e6b6dc48-23c1-4611-bacc-ac9856fc8eba None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:13.476438 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e6b6dc48-23c1-4611-bacc-ac9856fc8eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:13.489028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b43f7b45-e22c-454f-8ca8-397d9abf9359 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:13.490181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b43f7b45-e22c-454f-8ca8-397d9abf9359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:13.511322 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:13.542373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 160/325] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:13.545037 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6dc48-23c1-4611-bacc-ac9856fc8eba None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:13.546454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:13.558346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 166/326] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:13.565805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f7b45-e22c-454f-8ca8-397d9abf9359 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:13.649405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6dc48-23c1-4611-bacc-ac9856fc8eba None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:13.661897 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f7b45-e22c-454f-8ca8-397d9abf9359 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:13.683125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc7c2e-c63d-438c-8206-dc07ef215b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:13.684116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc7c2e-c63d-438c-8206-dc07ef215b6c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.684403 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc7c2e-c63d-438c-8206-dc07ef215b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.684678 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc7c2e-c63d-438c-8206-dc07ef215b6c None admin] PATH_INFO: `/v3/users/43d5f5a25cab4f9aa29c52fdf05bb1ce` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.685895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc7c2e-c63d-438c-8206-dc07ef215b6c None admin] RBAC: Authorizing `identity:get_user(user_id=43d5f5a25cab4f9aa29c52fdf05bb1ce)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:13.687341 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc7c2e-c63d-438c-8206-dc07ef215b6c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:13.689000 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 161/327] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:55:13 2022] GET /identity/v3/users/43d5f5a25cab4f9aa29c52fdf05bb1ce => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:13.689789 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc7c2e-c63d-438c-8206-dc07ef215b6c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:13.696702 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e645b-72b8-4ac3-99f3-92fdc4b6a6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:13.697490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e645b-72b8-4ac3-99f3-92fdc4b6a6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.697770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e645b-72b8-4ac3-99f3-92fdc4b6a6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.698043 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e645b-72b8-4ac3-99f3-92fdc4b6a6a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.699210 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e645b-72b8-4ac3-99f3-92fdc4b6a6a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:13.700652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e645b-72b8-4ac3-99f3-92fdc4b6a6a0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:13.706649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 167/328] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:13.706649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e645b-72b8-4ac3-99f3-92fdc4b6a6a0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:13.731171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:13.761281 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:13.790655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc7c2e-c63d-438c-8206-dc07ef215b6c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:13.802446 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e645b-72b8-4ac3-99f3-92fdc4b6a6a0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:13.824028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf72895-463a-4980-8736-bc7c619b59a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:13.824816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf72895-463a-4980-8736-bc7c619b59a4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.825097 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf72895-463a-4980-8736-bc7c619b59a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.825375 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf72895-463a-4980-8736-bc7c619b59a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.838851 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e08d3a-4fdb-4a78-8682-c3aeab76db3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:13.839555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e08d3a-4fdb-4a78-8682-c3aeab76db3e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:13.839673 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf72895-463a-4980-8736-bc7c619b59a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:13.839844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e08d3a-4fdb-4a78-8682-c3aeab76db3e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:13.840153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e08d3a-4fdb-4a78-8682-c3aeab76db3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:13.840994 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e08d3a-4fdb-4a78-8682-c3aeab76db3e None admin] RBAC: Adding query filter params (role.id=0251662126f747ad9804858316f8573a, user.id=43d5f5a25cab4f9aa29c52fdf05bb1ce, scope.system=all) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:13.841310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e08d3a-4fdb-4a78-8682-c3aeab76db3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:13.842742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e08d3a-4fdb-4a78-8682-c3aeab76db3e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:13.848223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-9cf72895-463a-4980-8736-bc7c619b59a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:55:13.848223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:13.848223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:13.848223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:13.848223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:13.848223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:13.848223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:13.848223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:13.848223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:13.848223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:13.848223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:13.848223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:13.848223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:13.848223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:13.848223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:13.848223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:13.849080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:13.849080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:13.849080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:13.849080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:13.849080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:13.849080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:13.849080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:13.849080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:13.849080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:13.849080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:13.849080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:13.849080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:13.849080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:13.849080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:13.849080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:13.849080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:13.849831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:13.849831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:13.849831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:13.849831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:13.849831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:13.849831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:13.849831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:13.849831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:13.849831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:13.849831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:13.849831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:55:13.849831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:13.849831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 162/329] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:13.850972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf72895-463a-4980-8736-bc7c619b59a4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:13.855960 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 168/330] 10.222.0.73 () {56 vars in 1308 bytes} [Thu May 19 11:55:13 2022] GET /identity/v3/role_assignments?user.id=43d5f5a25cab4f9aa29c52fdf05bb1ce&scope.system=all&role.id=0251662126f747ad9804858316f8573a => generated 510 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:13.855960 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e08d3a-4fdb-4a78-8682-c3aeab76db3e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:13.967721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:13.969238 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e08d3a-4fdb-4a78-8682-c3aeab76db3e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:13.970873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf72895-463a-4980-8736-bc7c619b59a4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:13.989163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:14.008613 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b149973-aa43-484b-97ef-6e82649f42c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:14.009301 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b149973-aa43-484b-97ef-6e82649f42c2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:14.009589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b149973-aa43-484b-97ef-6e82649f42c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:14.009867 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b149973-aa43-484b-97ef-6e82649f42c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:14.010633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b149973-aa43-484b-97ef-6e82649f42c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:14.010945 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b149973-aa43-484b-97ef-6e82649f42c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:14.012442 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b149973-aa43-484b-97ef-6e82649f42c2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:14.014083 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdae70-4139-4a00-b1cf-3fc2e4af2f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:14.014759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdae70-4139-4a00-b1cf-3fc2e4af2f27 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:14.015050 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdae70-4139-4a00-b1cf-3fc2e4af2f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:14.015330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdae70-4139-4a00-b1cf-3fc2e4af2f27 None admin] PATH_INFO: `/v3/groups` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:14.016075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdae70-4139-4a00-b1cf-3fc2e4af2f27 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:14.017523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdae70-4139-4a00-b1cf-3fc2e4af2f27 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:14.026264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 169/331] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:55:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:14.027390 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b149973-aa43-484b-97ef-6e82649f42c2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:14.040409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 163/332] 10.222.0.73 () {60 vars in 1134 bytes} [Thu May 19 11:55:13 2022] POST /identity/v3/groups => generated 226 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:55:14.149992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b149973-aa43-484b-97ef-6e82649f42c2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:14.185551 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85611108-cdf0-44f8-a974-80b93540f170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:14.186445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85611108-cdf0-44f8-a974-80b93540f170 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:14.186732 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85611108-cdf0-44f8-a974-80b93540f170 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:14.187013 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85611108-cdf0-44f8-a974-80b93540f170 None admin] PATH_INFO: `/v3/users/32e507b5d5f044c3b0fdb0fda7274ec7` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:14.188260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85611108-cdf0-44f8-a974-80b93540f170 None admin] RBAC: Authorizing `identity:get_user(user_id=32e507b5d5f044c3b0fdb0fda7274ec7)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:14.189768 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85611108-cdf0-44f8-a974-80b93540f170 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:14.191458 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 170/333] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:55:14 2022] GET /identity/v3/users/32e507b5d5f044c3b0fdb0fda7274ec7 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:14.197289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdae70-4139-4a00-b1cf-3fc2e4af2f27 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:14.300400 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdae70-4139-4a00-b1cf-3fc2e4af2f27 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:14.338728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef4512-97e4-4694-8e10-070cba3a0c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:14.339617 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef4512-97e4-4694-8e10-070cba3a0c82 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:14.339900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef4512-97e4-4694-8e10-070cba3a0c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:14.340205 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef4512-97e4-4694-8e10-070cba3a0c82 None admin] PATH_INFO: `/v3/system/users/32e507b5d5f044c3b0fdb0fda7274ec7/roles/75cb869182334e59ae0d8a7540e39b9b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:14.341709 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef4512-97e4-4694-8e10-070cba3a0c82 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=32e507b5d5f044c3b0fdb0fda7274ec7, role_id=75cb869182334e59ae0d8a7540e39b9b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:14.343081 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef4512-97e4-4694-8e10-070cba3a0c82 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:14.351380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 164/334] 10.222.0.73 () {58 vars in 1334 bytes} [Thu May 19 11:55:14 2022] PUT /identity/v3/system/users/32e507b5d5f044c3b0fdb0fda7274ec7/roles/75cb869182334e59ae0d8a7540e39b9b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:55:16.690356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406265f-ab1e-41bb-9460-5692f0ac35a3 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:16.691180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406265f-ab1e-41bb-9460-5692f0ac35a3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:16.691599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406265f-ab1e-41bb-9460-5692f0ac35a3 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:16.693394 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 171/335] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:16.699296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a3c13-3f01-4f82-af80-91be932c6b20 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:16.700089 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a3c13-3f01-4f82-af80-91be932c6b20 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:16.700510 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a3c13-3f01-4f82-af80-91be932c6b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:16.724951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d82a3c13-3f01-4f82-af80-91be932c6b20 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:16.726380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d82a3c13-3f01-4f82-af80-91be932c6b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:16.748587 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:16.813272 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 165/336] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:16.849623 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406265f-ab1e-41bb-9460-5692f0ac35a3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:16.862284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d17b5-9782-47a9-bf88-1d7a4baac254 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:16.862816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d17b5-9782-47a9-bf88-1d7a4baac254 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:16.863235 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d17b5-9782-47a9-bf88-1d7a4baac254 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:16.864997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 166/337] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:55:16.875042 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013122e-073e-464f-82a0-40a81171fb6a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:16.875509 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013122e-073e-464f-82a0-40a81171fb6a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:16.876017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013122e-073e-464f-82a0-40a81171fb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:16.917007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e013122e-073e-464f-82a0-40a81171fb6a None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:16.918458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e013122e-073e-464f-82a0-40a81171fb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:16.921565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:17.002665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406265f-ab1e-41bb-9460-5692f0ac35a3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:17.036251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 167/338] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:17.056430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c89cc-88ae-44fa-b6bf-86bd68cd697b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:17.057256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c89cc-88ae-44fa-b6bf-86bd68cd697b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:17.057538 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c89cc-88ae-44fa-b6bf-86bd68cd697b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:17.057810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c89cc-88ae-44fa-b6bf-86bd68cd697b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:17.094248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013122e-073e-464f-82a0-40a81171fb6a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:17.123682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c89cc-88ae-44fa-b6bf-86bd68cd697b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:17.138620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f56c89cc-88ae-44fa-b6bf-86bd68cd697b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:17.138620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:17.138620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:17.138620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:17.138620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:17.138620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:17.138620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:17.138620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:17.138620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:17.138620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:17.138620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:17.138620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:17.138620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:17.138620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:17.138620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:17.138620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:17.139558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:17.139558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:17.139558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:17.139558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:17.139558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:17.139558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:17.139558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:17.139558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:17.139558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:17.139558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:17.139558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:17.139558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:17.139558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:17.139558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:17.139558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:17.139558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:17.141153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:17.141153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:17.141153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:17.141153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:17.141153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:17.141153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:17.141153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:17.141153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:17.141153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:17.141153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:17.141153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:17.141153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:17.147936 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 172/339] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:55:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:17.156149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c89cc-88ae-44fa-b6bf-86bd68cd697b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:17.258329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:17.278902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013122e-073e-464f-82a0-40a81171fb6a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:17.339730 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c0722-b576-4845-a3d8-02a21f547287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:17.340905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c0722-b576-4845-a3d8-02a21f547287 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:17.341395 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c0722-b576-4845-a3d8-02a21f547287 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:17.341880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c0722-b576-4845-a3d8-02a21f547287 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:17.357974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c0722-b576-4845-a3d8-02a21f547287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:17.368528 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c89cc-88ae-44fa-b6bf-86bd68cd697b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:17.384945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-157c0722-b576-4845-a3d8-02a21f547287 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:55:17.384945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:17.384945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:17.384945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:17.384945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:17.384945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:17.384945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:17.384945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:17.384945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:17.384945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:17.384945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:17.384945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:17.384945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:17.384945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:17.384945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:17.384945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:17.385867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:17.385867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:17.385867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:17.385867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:17.385867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:17.385867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:17.385867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:17.385867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:17.385867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:17.385867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:17.385867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:17.385867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:17.385867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:17.385867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:17.385867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:17.385867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:17.386626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:17.386626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:17.386626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:17.386626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:17.386626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:17.386626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:17.386626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:17.386626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:17.386626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:17.386626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:17.386626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 11:55:17.386626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:17.386626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 168/340] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:17.395229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c0722-b576-4845-a3d8-02a21f547287 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:17.395779 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:17.466328 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2016af4-7a14-4343-8eb7-561d5e0a8463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:17.467037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2016af4-7a14-4343-8eb7-561d5e0a8463 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:17.467325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2016af4-7a14-4343-8eb7-561d5e0a8463 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:17.467602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2016af4-7a14-4343-8eb7-561d5e0a8463 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:17.469390 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2016af4-7a14-4343-8eb7-561d5e0a8463 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:17.471943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2016af4-7a14-4343-8eb7-561d5e0a8463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:17.471943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2016af4-7a14-4343-8eb7-561d5e0a8463 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:17.498140 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 173/341] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:17.504279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86148696-c888-48f7-8324-58e4e6817661 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:17.504910 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86148696-c888-48f7-8324-58e4e6817661 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:17.505393 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86148696-c888-48f7-8324-58e4e6817661 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:17.507081 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 174/342] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:17.508249 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86148696-c888-48f7-8324-58e4e6817661 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:17.621489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c0722-b576-4845-a3d8-02a21f547287 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:17.694487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6612e7f-5164-495a-9560-44f123867dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:17.695625 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6612e7f-5164-495a-9560-44f123867dbb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:17.696156 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6612e7f-5164-495a-9560-44f123867dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:17.696638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6612e7f-5164-495a-9560-44f123867dbb None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:17.697594 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6612e7f-5164-495a-9560-44f123867dbb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:17.698116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6612e7f-5164-495a-9560-44f123867dbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:17.699688 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6612e7f-5164-495a-9560-44f123867dbb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:17.711626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 169/343] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:55:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:17.713437 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500eca6-1e72-4c38-95dc-81e725f775b6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:17.715618 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500eca6-1e72-4c38-95dc-81e725f775b6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:17.716354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500eca6-1e72-4c38-95dc-81e725f775b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:17.755747 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:17.766242 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86148696-c888-48f7-8324-58e4e6817661 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:17.766734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7500eca6-1e72-4c38-95dc-81e725f775b6 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:17.767574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7500eca6-1e72-4c38-95dc-81e725f775b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:17.809574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6ab3b-e256-4335-9fe9-f2ce4b892423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:17.810706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6ab3b-e256-4335-9fe9-f2ce4b892423 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:17.811196 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6ab3b-e256-4335-9fe9-f2ce4b892423 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:17.811722 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6ab3b-e256-4335-9fe9-f2ce4b892423 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:17.842703 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 170/344] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:17.843820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500eca6-1e72-4c38-95dc-81e725f775b6 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:17.851825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:17.890859 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6ab3b-e256-4335-9fe9-f2ce4b892423 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:17.894655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6ab3b-e256-4335-9fe9-f2ce4b892423 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:17.973806 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500eca6-1e72-4c38-95dc-81e725f775b6 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:18.014416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 175/345] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:18.014708 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29012560-2d3a-4239-ae8c-09a4eecd9e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:18.015393 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29012560-2d3a-4239-ae8c-09a4eecd9e68 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:18.015675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29012560-2d3a-4239-ae8c-09a4eecd9e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:18.019939 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29012560-2d3a-4239-ae8c-09a4eecd9e68 None admin] PATH_INFO: `/v3/users/32e507b5d5f044c3b0fdb0fda7274ec7` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:18.021323 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29012560-2d3a-4239-ae8c-09a4eecd9e68 None admin] RBAC: Authorizing `identity:get_user(user_id=32e507b5d5f044c3b0fdb0fda7274ec7)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:18.022766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29012560-2d3a-4239-ae8c-09a4eecd9e68 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:18.024840 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a55ff2-11d6-403e-a99c-65113b777a43 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:18.025132 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a55ff2-11d6-403e-a99c-65113b777a43 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:18.025405 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a55ff2-11d6-403e-a99c-65113b777a43 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:18.026781 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 176/346] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:18.027503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a55ff2-11d6-403e-a99c-65113b777a43 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:18.028119 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 171/347] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:55:17 2022] GET /identity/v3/users/32e507b5d5f044c3b0fdb0fda7274ec7 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:18.029313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29012560-2d3a-4239-ae8c-09a4eecd9e68 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:18.036701 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:18.125136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:18.162547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29012560-2d3a-4239-ae8c-09a4eecd9e68 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:18.170465 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a55ff2-11d6-403e-a99c-65113b777a43 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:18.200408 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f49dd-9552-44b2-b160-92553b92490e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:18.201327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f49dd-9552-44b2-b160-92553b92490e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:18.201620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f49dd-9552-44b2-b160-92553b92490e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:18.201895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f49dd-9552-44b2-b160-92553b92490e None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:18.203825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f49dd-9552-44b2-b160-92553b92490e None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:18.205879 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f49dd-9552-44b2-b160-92553b92490e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:18.207650 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 172/348] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:18 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:18.208915 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce852829-ba7b-4b98-a8ca-07d5e5853c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:18.209062 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6100365-33f1-44a2-aa3e-ab5e1ff62ceb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:18.209236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6100365-33f1-44a2-aa3e-ab5e1ff62ceb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:18.209485 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6100365-33f1-44a2-aa3e-ab5e1ff62ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:18.209652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce852829-ba7b-4b98-a8ca-07d5e5853c92 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:18.209928 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce852829-ba7b-4b98-a8ca-07d5e5853c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:18.210206 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce852829-ba7b-4b98-a8ca-07d5e5853c92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:18.221994 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce852829-ba7b-4b98-a8ca-07d5e5853c92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:18.229084 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c6100365-33f1-44a2-aa3e-ab5e1ff62ceb None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:18.229955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ce852829-ba7b-4b98-a8ca-07d5e5853c92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:18.229955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:18.229955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:18.229955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:18.229955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:18.229955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:18.229955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:18.229955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:18.229955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:18.229955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:18.229955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:18.229955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:18.229955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:18.229955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:18.229955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:18.229955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:18.230847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:18.230847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:18.230847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:18.230847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:18.230847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:18.230847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:18.230847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:18.230847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:18.230847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:18.230847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:18.230847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:18.230847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:18.230847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:18.230847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:18.230847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:18.230847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:18.231734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:18.231734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:18.231734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:18.231734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:18.231734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:18.231734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:18.231734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:18.231734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:18.231734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:18.231734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:18.231734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:18.231734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:18.233284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c6100365-33f1-44a2-aa3e-ab5e1ff62ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:18.233444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 177/349] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:18.233444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce852829-ba7b-4b98-a8ca-07d5e5853c92 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:18.316240 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 173/350] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:18.317956 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e58a0-f599-4126-87bd-9b3b157df7ea None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:18.323979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e58a0-f599-4126-87bd-9b3b157df7ea None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:18.324597 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e58a0-f599-4126-87bd-9b3b157df7ea None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:18.326539 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 174/351] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:18.327504 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e58a0-f599-4126-87bd-9b3b157df7ea None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:18.335937 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:18.355305 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce852829-ba7b-4b98-a8ca-07d5e5853c92 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:18.389312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:18.399993 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5f96a-a139-43d2-a199-a6557986c711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:18.400803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5f96a-a139-43d2-a199-a6557986c711 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:18.401090 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5f96a-a139-43d2-a199-a6557986c711 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:18.401365 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5f96a-a139-43d2-a199-a6557986c711 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:18.402400 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5f96a-a139-43d2-a199-a6557986c711 None admin] RBAC: Adding query filter params (role.id=75cb869182334e59ae0d8a7540e39b9b, user.id=32e507b5d5f044c3b0fdb0fda7274ec7, scope.system=all) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:18.402718 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5f96a-a139-43d2-a199-a6557986c711 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:18.404231 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5f96a-a139-43d2-a199-a6557986c711 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:18.418169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 178/352] 10.222.0.73 () {56 vars in 1308 bytes} [Thu May 19 11:55:18 2022] GET /identity/v3/role_assignments?user.id=32e507b5d5f044c3b0fdb0fda7274ec7&scope.system=all&role.id=75cb869182334e59ae0d8a7540e39b9b => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:18.418823 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5f96a-a139-43d2-a199-a6557986c711 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:18.477315 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e58a0-f599-4126-87bd-9b3b157df7ea None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:18.530992 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15ce90-ea66-463c-aed9-93e413bba7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:18.532180 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15ce90-ea66-463c-aed9-93e413bba7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:18.532464 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15ce90-ea66-463c-aed9-93e413bba7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:18.533008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15ce90-ea66-463c-aed9-93e413bba7e3 None admin] PATH_INFO: `/v3/groups/eca681a7f19841b6a93e31848cb88658` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:18.541787 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15ce90-ea66-463c-aed9-93e413bba7e3 None admin] RBAC: Authorizing `identity:get_group(group_id=eca681a7f19841b6a93e31848cb88658)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:18.544246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15ce90-ea66-463c-aed9-93e413bba7e3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:18.547593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 175/353] 10.222.0.73 () {56 vars in 1180 bytes} [Thu May 19 11:55:18 2022] GET /identity/v3/groups/eca681a7f19841b6a93e31848cb88658 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:18.548975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeabb8e-ae88-4116-a590-0a45647963d4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:18.549705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeabb8e-ae88-4116-a590-0a45647963d4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:18.550178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeabb8e-ae88-4116-a590-0a45647963d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:18.552521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5f96a-a139-43d2-a199-a6557986c711 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:18.574564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-abeabb8e-ae88-4116-a590-0a45647963d4 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:18.576486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-abeabb8e-ae88-4116-a590-0a45647963d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:18.599151 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d57126-f1cd-41e1-b963-814986c152f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:18.599833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d57126-f1cd-41e1-b963-814986c152f9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:18.600310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d57126-f1cd-41e1-b963-814986c152f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:18.600588 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d57126-f1cd-41e1-b963-814986c152f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:18.601680 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d57126-f1cd-41e1-b963-814986c152f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:18.601992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d57126-f1cd-41e1-b963-814986c152f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:18.603393 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d57126-f1cd-41e1-b963-814986c152f9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:18.619002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 179/354] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:55:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:18.620126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d57126-f1cd-41e1-b963-814986c152f9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:18.672949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:18.683398 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 176/355] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:18.684279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeabb8e-ae88-4116-a590-0a45647963d4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:18.704293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:18.775578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d57126-f1cd-41e1-b963-814986c152f9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:18.819936 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb9bcc-37c9-47e6-b5a5-7fd41ab2e2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:18.820768 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb9bcc-37c9-47e6-b5a5-7fd41ab2e2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:18.821050 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb9bcc-37c9-47e6-b5a5-7fd41ab2e2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:18.821345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb9bcc-37c9-47e6-b5a5-7fd41ab2e2d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:18.822205 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeabb8e-ae88-4116-a590-0a45647963d4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:18.835764 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb9bcc-37c9-47e6-b5a5-7fd41ab2e2d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:18.843647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-77fb9bcc-37c9-47e6-b5a5-7fd41ab2e2d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:18.843647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:18.843647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:18.843647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:18.843647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:18.843647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:18.843647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:18.843647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:18.843647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:18.843647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:18.843647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:18.843647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:18.843647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:18.843647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:18.843647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:18.843647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:18.844752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:18.844752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:18.844752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:18.844752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:18.844752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:18.844752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:18.844752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:18.844752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:18.844752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:18.844752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:18.844752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:18.844752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:18.844752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:18.844752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:18.844752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:18.844752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:18.845625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:18.845625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:18.845625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:18.845625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:18.845625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:18.845625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:18.845625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:18.845625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:18.845625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:18.845625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:18.845625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:18.845625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:18.847816 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 180/356] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:18.848812 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb9bcc-37c9-47e6-b5a5-7fd41ab2e2d0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:18.861201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687d795-ffbe-47ab-a606-5696b75cadd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:18.862512 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687d795-ffbe-47ab-a606-5696b75cadd0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:18.862795 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687d795-ffbe-47ab-a606-5696b75cadd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:18.863067 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687d795-ffbe-47ab-a606-5696b75cadd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:18.863959 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687d795-ffbe-47ab-a606-5696b75cadd0 None admin] RBAC: Adding query filter params (group.id=eca681a7f19841b6a93e31848cb88658, role.id=a1fb3b01c7424cf18f71b9a2b8333f03, scope.project.id=c0e8ecfbb10647af9a7496598e58b208) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:18.864281 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687d795-ffbe-47ab-a606-5696b75cadd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:18.865697 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687d795-ffbe-47ab-a606-5696b75cadd0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:18.873118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 177/357] 10.222.0.73 () {56 vars in 1376 bytes} [Thu May 19 11:55:18 2022] GET /identity/v3/role_assignments?group.id=eca681a7f19841b6a93e31848cb88658&scope.project.id=c0e8ecfbb10647af9a7496598e58b208&role.id=a1fb3b01c7424cf18f71b9a2b8333f03 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:18.874135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687d795-ffbe-47ab-a606-5696b75cadd0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:18.967838 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:18.989058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb9bcc-37c9-47e6-b5a5-7fd41ab2e2d0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:19.001771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:19.029548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687d795-ffbe-47ab-a606-5696b75cadd0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:19.032841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11ef6f-a8c1-447e-a3cd-7df6b38726ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:19.034210 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11ef6f-a8c1-447e-a3cd-7df6b38726ab None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:19.034508 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11ef6f-a8c1-447e-a3cd-7df6b38726ab None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:19.034782 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11ef6f-a8c1-447e-a3cd-7df6b38726ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:19.072032 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1c6b9-574b-43cd-9520-7b0bab18f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:19.072874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1c6b9-574b-43cd-9520-7b0bab18f00c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:19.073155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1c6b9-574b-43cd-9520-7b0bab18f00c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:19.073432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1c6b9-574b-43cd-9520-7b0bab18f00c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:19.087888 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1c6b9-574b-43cd-9520-7b0bab18f00c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:19.096875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-a3e1c6b9-574b-43cd-9520-7b0bab18f00c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:19.096875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:19.096875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:19.096875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:19.096875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:19.096875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:19.096875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:19.096875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:19.096875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:19.096875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:19.096875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:19.096875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:19.096875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:19.096875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:19.096875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:19.096875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:19.097754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:19.097754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:19.097754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:19.097754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:19.097754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:19.097754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:19.097754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:19.097754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:19.097754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:19.097754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:19.097754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:19.097754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:19.097754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:19.097754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:19.097754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:19.097754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:19.098529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:19.098529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:19.098529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:19.098529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:19.098529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:19.098529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:19.098529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:19.098529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:19.098529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:19.098529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:19.098529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:19.098529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:19.098529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 178/358] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:55:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:19.099265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1c6b9-574b-43cd-9520-7b0bab18f00c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:19.126893 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11ef6f-a8c1-447e-a3cd-7df6b38726ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:19.128577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11ef6f-a8c1-447e-a3cd-7df6b38726ab None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:19.217292 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1c6b9-574b-43cd-9520-7b0bab18f00c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:19.255996 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:19.262594 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 181/359] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:19.262594 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e9141-9652-4445-b309-bdcd6bb9c4c9 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:19.262594 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e9141-9652-4445-b309-bdcd6bb9c4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:19.262908 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e9141-9652-4445-b309-bdcd6bb9c4c9 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:19.263960 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 182/360] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:19.264662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e9141-9652-4445-b309-bdcd6bb9c4c9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:19.279860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354e950-4951-4df1-a438-4f100e35241d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:19.280571 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354e950-4951-4df1-a438-4f100e35241d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:19.280858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354e950-4951-4df1-a438-4f100e35241d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:19.281139 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354e950-4951-4df1-a438-4f100e35241d None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:19.281899 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354e950-4951-4df1-a438-4f100e35241d None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:19.282209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354e950-4951-4df1-a438-4f100e35241d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:19.282775 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:19.284814 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354e950-4951-4df1-a438-4f100e35241d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:19.297625 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 179/361] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:55:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:19.299619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354e950-4951-4df1-a438-4f100e35241d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:19.414401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e9141-9652-4445-b309-bdcd6bb9c4c9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:19.433261 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354e950-4951-4df1-a438-4f100e35241d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:19.461804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d31189-38b2-4dd6-96bb-9ad031a68bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:19.462486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d31189-38b2-4dd6-96bb-9ad031a68bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:19.462783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d31189-38b2-4dd6-96bb-9ad031a68bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:19.463044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d31189-38b2-4dd6-96bb-9ad031a68bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:19.463809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d31189-38b2-4dd6-96bb-9ad031a68bf8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:19.464130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d31189-38b2-4dd6-96bb-9ad031a68bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:19.467580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d31189-38b2-4dd6-96bb-9ad031a68bf8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:19.476319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccb1d2-3978-477e-9263-5347c0a99195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:19.477183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccb1d2-3978-477e-9263-5347c0a99195 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:19.477468 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccb1d2-3978-477e-9263-5347c0a99195 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:19.477745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccb1d2-3978-477e-9263-5347c0a99195 None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:19.478217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 183/362] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:19.479284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccb1d2-3978-477e-9263-5347c0a99195 None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:19.479526 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eeae28-020d-4308-808d-acba84c31423 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:19.479963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eeae28-020d-4308-808d-acba84c31423 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:19.480169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eeae28-020d-4308-808d-acba84c31423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:19.480840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccb1d2-3978-477e-9263-5347c0a99195 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:19.482522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 180/363] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:19 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:19.485283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccb1d2-3978-477e-9263-5347c0a99195 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:19.499330 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f2eeae28-020d-4308-808d-acba84c31423 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:19.500547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f2eeae28-020d-4308-808d-acba84c31423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:19.550487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:19.590722 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:19.604005 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 184/364] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:19.604930 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eeae28-020d-4308-808d-acba84c31423 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:19.637707 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccb1d2-3978-477e-9263-5347c0a99195 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:19.683034 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e97d1a-96e5-409b-b43f-09f0b3a3c337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:19.683903 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e97d1a-96e5-409b-b43f-09f0b3a3c337 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:19.684235 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e97d1a-96e5-409b-b43f-09f0b3a3c337 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:19.685253 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e97d1a-96e5-409b-b43f-09f0b3a3c337 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:19.727903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eeae28-020d-4308-808d-acba84c31423 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:19.770817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5580f39-c326-4f02-b629-d1c611b6c7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:19.771619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5580f39-c326-4f02-b629-d1c611b6c7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:19.772005 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5580f39-c326-4f02-b629-d1c611b6c7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:19.772370 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5580f39-c326-4f02-b629-d1c611b6c7e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:19.774541 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e97d1a-96e5-409b-b43f-09f0b3a3c337 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:19.776053 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e97d1a-96e5-409b-b43f-09f0b3a3c337 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:19.832532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:19.847028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:19.849662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5580f39-c326-4f02-b629-d1c611b6c7e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:19.851352 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5580f39-c326-4f02-b629-d1c611b6c7e1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:19.914617 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 181/365] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:19.916389 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e97d1a-96e5-409b-b43f-09f0b3a3c337 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:20.000839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 185/366] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:20.003079 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5580f39-c326-4f02-b629-d1c611b6c7e1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:20.046638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e97d1a-96e5-409b-b43f-09f0b3a3c337 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:20.101120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c144c9-eb0f-4ce3-9db4-cebc8ccc4d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:20.101918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c144c9-eb0f-4ce3-9db4-cebc8ccc4d4f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:20.102208 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c144c9-eb0f-4ce3-9db4-cebc8ccc4d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:20.102893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c144c9-eb0f-4ce3-9db4-cebc8ccc4d4f None admin] PATH_INFO: `/v3/groups/eca681a7f19841b6a93e31848cb88658` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:20.104494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c144c9-eb0f-4ce3-9db4-cebc8ccc4d4f None admin] RBAC: Authorizing `identity:get_group(group_id=eca681a7f19841b6a93e31848cb88658)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:20.106586 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c144c9-eb0f-4ce3-9db4-cebc8ccc4d4f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:20.108869 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 182/367] 10.222.0.73 () {56 vars in 1180 bytes} [Thu May 19 11:55:19 2022] GET /identity/v3/groups/eca681a7f19841b6a93e31848cb88658 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:20.109895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c144c9-eb0f-4ce3-9db4-cebc8ccc4d4f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:20.123134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:20.133066 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5580f39-c326-4f02-b629-d1c611b6c7e1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:20.134293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:20.184304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49df7e4-534d-4d08-8168-1e9d6d2db313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:20.185108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49df7e4-534d-4d08-8168-1e9d6d2db313 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:20.185390 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49df7e4-534d-4d08-8168-1e9d6d2db313 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:20.185666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49df7e4-534d-4d08-8168-1e9d6d2db313 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:20.197971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49df7e4-534d-4d08-8168-1e9d6d2db313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:20.205703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b49df7e4-534d-4d08-8168-1e9d6d2db313 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:20.205703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:20.205703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:20.205703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:20.205703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:20.205703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:20.205703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:20.205703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:20.205703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:20.205703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:20.205703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:20.205703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:20.205703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:20.205703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:20.205703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:20.205703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:20.207542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:20.207542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:20.207542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:20.207542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:20.207542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:20.207542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:20.207542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:20.207542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:20.207542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:20.207542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:20.207542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:20.207542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:20.207542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:20.207542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:20.207542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:20.207542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:20.213841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:20.213841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:20.213841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:20.213841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:20.213841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:20.213841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:20.213841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:20.213841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:20.213841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:20.213841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:20.213841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:20.213841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:20.213841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 186/368] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:55:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:20.213841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49df7e4-534d-4d08-8168-1e9d6d2db313 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:20.250336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c144c9-eb0f-4ce3-9db4-cebc8ccc4d4f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:20.298678 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857e30d-ba5f-4962-93de-b0c5c95f4b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:20.300684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857e30d-ba5f-4962-93de-b0c5c95f4b6c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:20.301885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857e30d-ba5f-4962-93de-b0c5c95f4b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:20.302172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857e30d-ba5f-4962-93de-b0c5c95f4b6c None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:20.303436 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857e30d-ba5f-4962-93de-b0c5c95f4b6c None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:20.305210 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857e30d-ba5f-4962-93de-b0c5c95f4b6c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:20.307266 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 183/369] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:20 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:20.308070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857e30d-ba5f-4962-93de-b0c5c95f4b6c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:20.353885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49df7e4-534d-4d08-8168-1e9d6d2db313 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:20.398104 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c56560-7c27-40f0-9b90-3d63811318b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:20.398984 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c56560-7c27-40f0-9b90-3d63811318b1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:20.399266 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c56560-7c27-40f0-9b90-3d63811318b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:20.399540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c56560-7c27-40f0-9b90-3d63811318b1 None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:20.401590 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c56560-7c27-40f0-9b90-3d63811318b1 None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:20.403054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c56560-7c27-40f0-9b90-3d63811318b1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:20.404877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 187/370] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:20 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:20.405637 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c56560-7c27-40f0-9b90-3d63811318b1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:20.421399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:20.445475 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857e30d-ba5f-4962-93de-b0c5c95f4b6c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:20.454841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:20.492278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837dce9-dfc6-41f4-91ab-e7f40fb127b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:20.493266 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837dce9-dfc6-41f4-91ab-e7f40fb127b0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:20.493568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837dce9-dfc6-41f4-91ab-e7f40fb127b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:20.493856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837dce9-dfc6-41f4-91ab-e7f40fb127b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:20.494992 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837dce9-dfc6-41f4-91ab-e7f40fb127b0 None admin] RBAC: Adding query filter params (group.id=eca681a7f19841b6a93e31848cb88658, role.id=0251662126f747ad9804858316f8573a, scope.project.id=c0e8ecfbb10647af9a7496598e58b208) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:20.495313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837dce9-dfc6-41f4-91ab-e7f40fb127b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:20.496951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837dce9-dfc6-41f4-91ab-e7f40fb127b0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:20.505094 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 184/371] 10.222.0.73 () {56 vars in 1376 bytes} [Thu May 19 11:55:20 2022] GET /identity/v3/role_assignments?group.id=eca681a7f19841b6a93e31848cb88658&scope.project.id=c0e8ecfbb10647af9a7496598e58b208&role.id=0251662126f747ad9804858316f8573a => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:20.506095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837dce9-dfc6-41f4-91ab-e7f40fb127b0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:20.555886 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c56560-7c27-40f0-9b90-3d63811318b1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:20.601854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9dfbd-45d3-4336-bbda-8537d47aacb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:20.602946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9dfbd-45d3-4336-bbda-8537d47aacb6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:20.603457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9dfbd-45d3-4336-bbda-8537d47aacb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:20.604045 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9dfbd-45d3-4336-bbda-8537d47aacb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:20.605023 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9dfbd-45d3-4336-bbda-8537d47aacb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:20.605537 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9dfbd-45d3-4336-bbda-8537d47aacb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:20.607136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9dfbd-45d3-4336-bbda-8537d47aacb6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:20.617375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 188/372] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:20.618642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9dfbd-45d3-4336-bbda-8537d47aacb6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:20.652312 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837dce9-dfc6-41f4-91ab-e7f40fb127b0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:20.700156 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4be1e-ed67-4ab9-b4b1-636077bf4e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:20.701972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4be1e-ed67-4ab9-b4b1-636077bf4e2c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:20.702233 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4be1e-ed67-4ab9-b4b1-636077bf4e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:20.702514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4be1e-ed67-4ab9-b4b1-636077bf4e2c None admin] PATH_INFO: `/v3/groups/eca681a7f19841b6a93e31848cb88658` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:20.703789 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4be1e-ed67-4ab9-b4b1-636077bf4e2c None admin] RBAC: Authorizing `identity:get_group(group_id=eca681a7f19841b6a93e31848cb88658)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:20.705914 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4be1e-ed67-4ab9-b4b1-636077bf4e2c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:20.708873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 185/373] 10.222.0.73 () {56 vars in 1180 bytes} [Thu May 19 11:55:20 2022] GET /identity/v3/groups/eca681a7f19841b6a93e31848cb88658 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:20.709059 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4be1e-ed67-4ab9-b4b1-636077bf4e2c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:20.731349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:20.734657 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:20.746567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9dfbd-45d3-4336-bbda-8537d47aacb6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:20.803357 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223c86a-8461-4432-8dce-d8d99828f1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:20.804254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223c86a-8461-4432-8dce-d8d99828f1ac None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:20.804538 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223c86a-8461-4432-8dce-d8d99828f1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:20.804818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223c86a-8461-4432-8dce-d8d99828f1ac None admin] PATH_INFO: `/v3/groups/eca681a7f19841b6a93e31848cb88658` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:20.806112 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223c86a-8461-4432-8dce-d8d99828f1ac None admin] RBAC: Authorizing `identity:get_group(group_id=eca681a7f19841b6a93e31848cb88658)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:20.807436 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223c86a-8461-4432-8dce-d8d99828f1ac None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:20.809397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 189/374] 10.222.0.73 () {56 vars in 1180 bytes} [Thu May 19 11:55:20 2022] GET /identity/v3/groups/eca681a7f19841b6a93e31848cb88658 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:20.810169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223c86a-8461-4432-8dce-d8d99828f1ac None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:20.850550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4be1e-ed67-4ab9-b4b1-636077bf4e2c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:20.904439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da6256-ec6c-47bb-995f-c6ca881ba3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:20.905422 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da6256-ec6c-47bb-995f-c6ca881ba3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:20.905930 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da6256-ec6c-47bb-995f-c6ca881ba3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:20.906406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da6256-ec6c-47bb-995f-c6ca881ba3c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:20.937556 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223c86a-8461-4432-8dce-d8d99828f1ac None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:20.975322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f181c0c-9b56-4779-9129-350dd1e620e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:20.976061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f181c0c-9b56-4779-9129-350dd1e620e3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:20.976345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f181c0c-9b56-4779-9129-350dd1e620e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:20.976685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f181c0c-9b56-4779-9129-350dd1e620e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:20.977509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f181c0c-9b56-4779-9129-350dd1e620e3 None admin] RBAC: Adding query filter params (group.id=eca681a7f19841b6a93e31848cb88658, role.id=0251662126f747ad9804858316f8573a, scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:20.977827 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f181c0c-9b56-4779-9129-350dd1e620e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:20.979253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f181c0c-9b56-4779-9129-350dd1e620e3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:20.986969 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 190/375] 10.222.0.73 () {56 vars in 1376 bytes} [Thu May 19 11:55:20 2022] GET /identity/v3/role_assignments?group.id=eca681a7f19841b6a93e31848cb88658&scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8&role.id=0251662126f747ad9804858316f8573a => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:20.987797 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f181c0c-9b56-4779-9129-350dd1e620e3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:21.001163 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da6256-ec6c-47bb-995f-c6ca881ba3c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:21.003586 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da6256-ec6c-47bb-995f-c6ca881ba3c3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:21.026946 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:21.043519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:21.142392 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 186/376] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:21.148737 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da6256-ec6c-47bb-995f-c6ca881ba3c3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:21.231497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f181c0c-9b56-4779-9129-350dd1e620e3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:21.275167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da6256-ec6c-47bb-995f-c6ca881ba3c3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:21.284696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f24a1b-3eb4-41fc-a099-cee07ee515b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:21.285364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f24a1b-3eb4-41fc-a099-cee07ee515b9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:21.285648 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f24a1b-3eb4-41fc-a099-cee07ee515b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:21.285926 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f24a1b-3eb4-41fc-a099-cee07ee515b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:21.286763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f24a1b-3eb4-41fc-a099-cee07ee515b9 None admin] RBAC: Adding query filter params (group.id=eca681a7f19841b6a93e31848cb88658, role.id=a1fb3b01c7424cf18f71b9a2b8333f03, scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:21.287075 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f24a1b-3eb4-41fc-a099-cee07ee515b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:21.288673 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f24a1b-3eb4-41fc-a099-cee07ee515b9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:21.294833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 191/377] 10.222.0.73 () {56 vars in 1376 bytes} [Thu May 19 11:55:20 2022] GET /identity/v3/role_assignments?group.id=eca681a7f19841b6a93e31848cb88658&scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8&role.id=a1fb3b01c7424cf18f71b9a2b8333f03 => generated 260 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:21.296356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58942ef5-dd36-4336-8850-a12bffc9e4d2 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:21.296640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58942ef5-dd36-4336-8850-a12bffc9e4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:21.297015 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58942ef5-dd36-4336-8850-a12bffc9e4d2 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:21.302466 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 192/378] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:21.304558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6dd30-b145-4fba-969d-4a8d29266dcc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:21.304924 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6dd30-b145-4fba-969d-4a8d29266dcc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:21.305274 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6dd30-b145-4fba-969d-4a8d29266dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:21.328323 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:21.341754 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e0f6dd30-b145-4fba-969d-4a8d29266dcc None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:21.342989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e0f6dd30-b145-4fba-969d-4a8d29266dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:21.347662 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbf3f7-9956-4892-9457-f419c3bc3cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:21.348588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbf3f7-9956-4892-9457-f419c3bc3cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:21.348874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbf3f7-9956-4892-9457-f419c3bc3cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:21.349151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbf3f7-9956-4892-9457-f419c3bc3cf3 None admin] PATH_INFO: `/v3/projects/df2a417664864d77b82ff77f60f05d0b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:21.350740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbf3f7-9956-4892-9457-f419c3bc3cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=df2a417664864d77b82ff77f60f05d0b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:21.354126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbf3f7-9956-4892-9457-f419c3bc3cf3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:21.355980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 187/379] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:21 2022] GET /identity/v3/projects/df2a417664864d77b82ff77f60f05d0b => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:21.375781 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbf3f7-9956-4892-9457-f419c3bc3cf3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:21.503831 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 193/380] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:21.528850 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6dd30-b145-4fba-969d-4a8d29266dcc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:21.551439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:21.554743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbf3f7-9956-4892-9457-f419c3bc3cf3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:21.603038 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a233b4c-1ebd-4b06-b8fe-37cdc9084839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:21.604122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a233b4c-1ebd-4b06-b8fe-37cdc9084839 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:21.604510 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a233b4c-1ebd-4b06-b8fe-37cdc9084839 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:21.604803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a233b4c-1ebd-4b06-b8fe-37cdc9084839 None admin] PATH_INFO: `/v3/groups/46dec73c5ace4a37a4ccf035f37447bf` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:21.613456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a233b4c-1ebd-4b06-b8fe-37cdc9084839 None admin] RBAC: Authorizing `identity:get_group(group_id=46dec73c5ace4a37a4ccf035f37447bf)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:21.615123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a233b4c-1ebd-4b06-b8fe-37cdc9084839 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:21.617288 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 188/381] 10.222.0.73 () {56 vars in 1180 bytes} [Thu May 19 11:55:21 2022] GET /identity/v3/groups/46dec73c5ace4a37a4ccf035f37447bf => generated 229 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:21.633484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a233b4c-1ebd-4b06-b8fe-37cdc9084839 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:21.644420 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6dd30-b145-4fba-969d-4a8d29266dcc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:21.680998 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998eb00-05e2-4c9b-a3d1-62ab03a852a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:21.681811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998eb00-05e2-4c9b-a3d1-62ab03a852a7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:21.682089 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998eb00-05e2-4c9b-a3d1-62ab03a852a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:21.682360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998eb00-05e2-4c9b-a3d1-62ab03a852a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:21.693076 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998eb00-05e2-4c9b-a3d1-62ab03a852a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:21.701137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-3998eb00-05e2-4c9b-a3d1-62ab03a852a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:21.701137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:21.701137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:21.701137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:21.701137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:21.701137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:21.701137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:21.701137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:21.701137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:21.701137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:21.701137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:21.701137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:21.701137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:21.701137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:21.701137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:21.701137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:21.703225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:21.703225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:21.703225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:21.703225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:21.703225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:21.703225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:21.703225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:21.703225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:21.703225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:21.703225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:21.703225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:21.703225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:21.703225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:21.703225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:21.703225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:21.703225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:21.706582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:21.706582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:21.706582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:21.706582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:21.706582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:21.706582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:21.706582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:21.706582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:21.706582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:21.706582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:21.706582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:21.706582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:21.708022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 194/382] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:55:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:21.712030 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998eb00-05e2-4c9b-a3d1-62ab03a852a7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:21.727302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:21.814649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a233b4c-1ebd-4b06-b8fe-37cdc9084839 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:21.820038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:21.845058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998eb00-05e2-4c9b-a3d1-62ab03a852a7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:21.878936 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e92560-e907-4808-a631-006d5ebcef15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:21.879611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e92560-e907-4808-a631-006d5ebcef15 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:21.879898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e92560-e907-4808-a631-006d5ebcef15 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:21.880216 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e92560-e907-4808-a631-006d5ebcef15 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:21.880971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e92560-e907-4808-a631-006d5ebcef15 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:21.881282 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e92560-e907-4808-a631-006d5ebcef15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:21.882656 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e92560-e907-4808-a631-006d5ebcef15 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:21.885556 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b86e5-ae01-4271-988d-833f708cb961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:21.886228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b86e5-ae01-4271-988d-833f708cb961 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:21.886514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b86e5-ae01-4271-988d-833f708cb961 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:21.886793 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b86e5-ae01-4271-988d-833f708cb961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:21.887631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b86e5-ae01-4271-988d-833f708cb961 None admin] RBAC: Adding query filter params (group.id=46dec73c5ace4a37a4ccf035f37447bf, role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=df2a417664864d77b82ff77f60f05d0b) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:21.887961 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b86e5-ae01-4271-988d-833f708cb961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:21.889400 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b86e5-ae01-4271-988d-833f708cb961 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:21.891054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 195/383] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:21.897358 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e92560-e907-4808-a631-006d5ebcef15 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:21.906302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 189/384] 10.222.0.73 () {56 vars in 1376 bytes} [Thu May 19 11:55:21 2022] GET /identity/v3/role_assignments?group.id=46dec73c5ace4a37a4ccf035f37447bf&scope.project.id=df2a417664864d77b82ff77f60f05d0b&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 260 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:22.056489 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e92560-e907-4808-a631-006d5ebcef15 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:22.092918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67ab92-4bcc-449e-b3ef-4380c22d5994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:22.093701 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67ab92-4bcc-449e-b3ef-4380c22d5994 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:22.093983 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67ab92-4bcc-449e-b3ef-4380c22d5994 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:22.094261 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67ab92-4bcc-449e-b3ef-4380c22d5994 None admin] PATH_INFO: `/v3/groups/eca681a7f19841b6a93e31848cb88658` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:22.095435 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67ab92-4bcc-449e-b3ef-4380c22d5994 None admin] RBAC: Authorizing `identity:get_group(group_id=eca681a7f19841b6a93e31848cb88658)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:22.097498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67ab92-4bcc-449e-b3ef-4380c22d5994 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:22.103593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 196/385] 10.222.0.73 () {56 vars in 1180 bytes} [Thu May 19 11:55:21 2022] GET /identity/v3/groups/eca681a7f19841b6a93e31848cb88658 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:22.104940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b86e5-ae01-4271-988d-833f708cb961 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:22.211269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b86e5-ae01-4271-988d-833f708cb961 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:22.232544 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:22.259039 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718cec4-bf95-4374-a37d-b9ccb379f59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:22.259936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718cec4-bf95-4374-a37d-b9ccb379f59d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:22.260364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718cec4-bf95-4374-a37d-b9ccb379f59d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:22.260643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718cec4-bf95-4374-a37d-b9ccb379f59d None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:22.261837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718cec4-bf95-4374-a37d-b9ccb379f59d None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:22.263274 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718cec4-bf95-4374-a37d-b9ccb379f59d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:22.265300 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 190/386] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:22 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:22.271496 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67ab92-4bcc-449e-b3ef-4380c22d5994 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:22.284990 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:22.428499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67ab92-4bcc-449e-b3ef-4380c22d5994 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:22.464332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfadea8-e494-4a87-a4e7-2cd73ac6e1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:22.465221 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfadea8-e494-4a87-a4e7-2cd73ac6e1bc None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:22.465503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfadea8-e494-4a87-a4e7-2cd73ac6e1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:22.465853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfadea8-e494-4a87-a4e7-2cd73ac6e1bc None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208/groups/eca681a7f19841b6a93e31848cb88658/roles/a1fb3b01c7424cf18f71b9a2b8333f03` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:22.468111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfadea8-e494-4a87-a4e7-2cd73ac6e1bc None admin] RBAC: Authorizing `identity:create_grant(project_id=c0e8ecfbb10647af9a7496598e58b208, group_id=eca681a7f19841b6a93e31848cb88658, role_id=a1fb3b01c7424cf18f71b9a2b8333f03)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:22.469635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfadea8-e494-4a87-a4e7-2cd73ac6e1bc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:22.484105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 197/387] 10.222.0.73 () {58 vars in 1442 bytes} [Thu May 19 11:55:22 2022] PUT /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208/groups/eca681a7f19841b6a93e31848cb88658/roles/a1fb3b01c7424cf18f71b9a2b8333f03 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:55:23.450705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cdcef-6395-4d85-a31b-bb60ccdb3131 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:23.451216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cdcef-6395-4d85-a31b-bb60ccdb3131 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:23.451290 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cdcef-6395-4d85-a31b-bb60ccdb3131 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:23.452947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 191/388] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:23.458022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d677ad-96b5-4076-ab9b-b83795d930ba None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:23.458420 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d677ad-96b5-4076-ab9b-b83795d930ba None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:23.458587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d677ad-96b5-4076-ab9b-b83795d930ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:23.479825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-42d677ad-96b5-4076-ab9b-b83795d930ba None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:23.481050 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-42d677ad-96b5-4076-ab9b-b83795d930ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:23.565983 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:23.573839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 198/389] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:23.608180 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cdcef-6395-4d85-a31b-bb60ccdb3131 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:23.740178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cdcef-6395-4d85-a31b-bb60ccdb3131 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:23.777993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3faa0-4cf0-49d3-8786-b59b3bf07e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:23.778805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3faa0-4cf0-49d3-8786-b59b3bf07e58 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:23.779090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3faa0-4cf0-49d3-8786-b59b3bf07e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:23.779370 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3faa0-4cf0-49d3-8786-b59b3bf07e58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:23.795818 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3faa0-4cf0-49d3-8786-b59b3bf07e58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:23.804644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-2ed3faa0-4cf0-49d3-8786-b59b3bf07e58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:23.804644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:23.804644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:23.804644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:23.804644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:23.804644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:23.804644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:23.804644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:23.804644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:23.804644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:23.804644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:23.804644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:23.804644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:23.804644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:23.804644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:23.804644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:23.805603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:23.805603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:23.805603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:23.805603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:23.805603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:23.805603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:23.805603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:23.805603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:23.805603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:23.805603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:23.805603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:23.805603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:23.805603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:23.805603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:23.805603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:23.805603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:23.806399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:23.806399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:23.806399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:23.806399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:23.806399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:23.806399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:23.806399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:23.806399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:23.806399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:23.806399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:23.806399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:23.806399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:23.806399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 192/390] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:23.811883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d677ad-96b5-4076-ab9b-b83795d930ba None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:23.894663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1991f-5306-4858-a329-2b00e2f458d7 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:23.895021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1991f-5306-4858-a329-2b00e2f458d7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:23.895320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1991f-5306-4858-a329-2b00e2f458d7 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:23.896724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 193/391] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:55:23.903126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa587b08-a89d-4173-9070-11faa75315a6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:23.903416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa587b08-a89d-4173-9070-11faa75315a6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:23.903694 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa587b08-a89d-4173-9070-11faa75315a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:23.940031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-aa587b08-a89d-4173-9070-11faa75315a6 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:23.941282 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-aa587b08-a89d-4173-9070-11faa75315a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:23.966534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d677ad-96b5-4076-ab9b-b83795d930ba None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:24.023071 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:24.028017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ed34e-cca4-4825-bdf2-a5dadcdea8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:24.028697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ed34e-cca4-4825-bdf2-a5dadcdea8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:24.028982 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ed34e-cca4-4825-bdf2-a5dadcdea8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:24.029255 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ed34e-cca4-4825-bdf2-a5dadcdea8d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:24.030010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ed34e-cca4-4825-bdf2-a5dadcdea8d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:24.030312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ed34e-cca4-4825-bdf2-a5dadcdea8d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:24.032141 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ed34e-cca4-4825-bdf2-a5dadcdea8d5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:24.043949 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 199/392] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:55:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:24.045858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bb06c-fc74-4d9b-83af-0f7f71475b4c None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:24.046150 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bb06c-fc74-4d9b-83af-0f7f71475b4c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:24.046428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bb06c-fc74-4d9b-83af-0f7f71475b4c None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:24.047691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 200/393] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:24.052838 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bb06c-fc74-4d9b-83af-0f7f71475b4c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:24.068336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 194/394] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:24.076201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7f5c5-4e18-493b-9fe4-79245560857c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:24.076743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7f5c5-4e18-493b-9fe4-79245560857c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:24.077276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7f5c5-4e18-493b-9fe4-79245560857c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:24.108650 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-05e7f5c5-4e18-493b-9fe4-79245560857c None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:24.109981 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-05e7f5c5-4e18-493b-9fe4-79245560857c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:24.126530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:24.178309 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bb06c-fc74-4d9b-83af-0f7f71475b4c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:24.182263 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 195/395] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:24.183304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7f5c5-4e18-493b-9fe4-79245560857c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:24.216863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8c480-2b86-421b-af3e-908b1aa71039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:24.218248 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8c480-2b86-421b-af3e-908b1aa71039 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:24.218737 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8c480-2b86-421b-af3e-908b1aa71039 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:24.219226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8c480-2b86-421b-af3e-908b1aa71039 None admin] PATH_INFO: `/v3/groups/eca681a7f19841b6a93e31848cb88658` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:24.220711 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8c480-2b86-421b-af3e-908b1aa71039 None admin] RBAC: Authorizing `identity:get_group(group_id=eca681a7f19841b6a93e31848cb88658)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:24.222886 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8c480-2b86-421b-af3e-908b1aa71039 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:24.225159 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 201/396] 10.222.0.73 () {56 vars in 1180 bytes} [Thu May 19 11:55:24 2022] GET /identity/v3/groups/eca681a7f19841b6a93e31848cb88658 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:24.226196 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8c480-2b86-421b-af3e-908b1aa71039 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:24.291032 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7f5c5-4e18-493b-9fe4-79245560857c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:24.292615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:24.327427 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4c9cf-942c-44df-b095-fcfc6cc948eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:24.328264 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4c9cf-942c-44df-b095-fcfc6cc948eb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:24.328548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4c9cf-942c-44df-b095-fcfc6cc948eb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:24.328827 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4c9cf-942c-44df-b095-fcfc6cc948eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:24.340281 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4c9cf-942c-44df-b095-fcfc6cc948eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:24.340753 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8c480-2b86-421b-af3e-908b1aa71039 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:24.349031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-c1d4c9cf-942c-44df-b095-fcfc6cc948eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:24.349031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:24.349031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:24.349031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:24.349031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:24.349031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:24.349031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:24.349031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:24.349031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:24.349031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:24.349031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:24.349031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:24.349031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:24.349031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:24.349031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:24.349031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:24.349912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:24.349912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:24.349912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:24.349912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:24.349912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:24.349912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:24.349912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:24.349912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:24.349912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:24.349912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:24.349912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:24.349912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:24.349912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:24.349912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:24.349912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:24.349912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:24.350705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:24.350705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:24.350705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:24.350705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:24.350705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:24.350705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:24.350705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:24.350705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:24.350705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:24.350705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:24.350705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:24.350705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:24.354951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 196/397] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:24.355803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4c9cf-942c-44df-b095-fcfc6cc948eb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:24.372669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:24.383828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c8b29-9afd-4d26-9ebf-e428ed9105d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:24.385022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c8b29-9afd-4d26-9ebf-e428ed9105d4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:24.385514 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c8b29-9afd-4d26-9ebf-e428ed9105d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:24.386206 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c8b29-9afd-4d26-9ebf-e428ed9105d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:24.398407 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c8b29-9afd-4d26-9ebf-e428ed9105d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:24.407254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-1d6c8b29-9afd-4d26-9ebf-e428ed9105d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:24.407254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:24.407254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:24.407254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:24.407254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:24.407254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:24.407254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:24.407254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:24.407254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:24.407254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:24.407254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:24.407254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:24.407254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:24.407254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:24.407254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:24.407254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:24.408217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:24.408217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:24.408217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:24.408217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:24.408217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:24.408217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:24.408217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:24.408217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:24.408217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:24.408217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:24.408217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:24.408217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:24.408217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:24.408217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:24.408217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:24.408217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:24.409513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:24.409513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:24.409513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:24.409513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:24.409513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:24.409513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:24.409513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:24.409513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:24.409513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:24.409513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:24.409513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:24.409513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:24.410096 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 202/398] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:55:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:24.410622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c8b29-9afd-4d26-9ebf-e428ed9105d4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:24.465003 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4c9cf-942c-44df-b095-fcfc6cc948eb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:24.499887 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e4603-11a4-4ec0-b884-43fa27144783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:24.500834 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e4603-11a4-4ec0-b884-43fa27144783 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:24.501117 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e4603-11a4-4ec0-b884-43fa27144783 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:24.501396 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e4603-11a4-4ec0-b884-43fa27144783 None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:24.503247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e4603-11a4-4ec0-b884-43fa27144783 None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:24.504768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e4603-11a4-4ec0-b884-43fa27144783 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:24.511528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 197/399] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:24 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:24.512649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e4603-11a4-4ec0-b884-43fa27144783 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:24.525166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c8b29-9afd-4d26-9ebf-e428ed9105d4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:24.547440 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:24.567428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c9be0-aff8-4c1a-8781-e654d4c7b122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:24.568380 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9be0-aff8-4c1a-8781-e654d4c7b122 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:24.568671 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9be0-aff8-4c1a-8781-e654d4c7b122 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:24.569347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9be0-aff8-4c1a-8781-e654d4c7b122 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:24.570120 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c9be0-aff8-4c1a-8781-e654d4c7b122 None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:24.570435 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c9be0-aff8-4c1a-8781-e654d4c7b122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:24.571825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c9be0-aff8-4c1a-8781-e654d4c7b122 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:24.585100 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 203/400] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:55:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:24.585982 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c9be0-aff8-4c1a-8781-e654d4c7b122 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:24.628635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e4603-11a4-4ec0-b884-43fa27144783 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:24.651030 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:24.681174 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bc519-f4d6-4602-967a-1c3e307e7fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:24.682713 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bc519-f4d6-4602-967a-1c3e307e7fbc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:24.683223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bc519-f4d6-4602-967a-1c3e307e7fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:24.684141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bc519-f4d6-4602-967a-1c3e307e7fbc None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:24.685401 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bc519-f4d6-4602-967a-1c3e307e7fbc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:24.685994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bc519-f4d6-4602-967a-1c3e307e7fbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:24.688610 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bc519-f4d6-4602-967a-1c3e307e7fbc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:24.700385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 198/401] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:24.701079 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bc519-f4d6-4602-967a-1c3e307e7fbc None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:24.707844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c9be0-aff8-4c1a-8781-e654d4c7b122 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:24.743945 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab40d80-d323-4c08-8e36-fdc3d2717a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:24.744851 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab40d80-d323-4c08-8e36-fdc3d2717a86 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:24.745137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab40d80-d323-4c08-8e36-fdc3d2717a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:24.745419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab40d80-d323-4c08-8e36-fdc3d2717a86 None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208/groups/eca681a7f19841b6a93e31848cb88658/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:24.747605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab40d80-d323-4c08-8e36-fdc3d2717a86 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0e8ecfbb10647af9a7496598e58b208, group_id=eca681a7f19841b6a93e31848cb88658, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:24.749350 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab40d80-d323-4c08-8e36-fdc3d2717a86 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:24.763857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 204/402] 10.222.0.73 () {58 vars in 1442 bytes} [Thu May 19 11:55:24 2022] PUT /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208/groups/eca681a7f19841b6a93e31848cb88658/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:55:24.765930 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7515e-0232-44d0-9b3e-4fbaba07c753 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:24.766763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7515e-0232-44d0-9b3e-4fbaba07c753 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:24.767252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7515e-0232-44d0-9b3e-4fbaba07c753 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:24.774391 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 205/403] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:24.774391 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7515e-0232-44d0-9b3e-4fbaba07c753 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:24.812835 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:24.823869 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bc519-f4d6-4602-967a-1c3e307e7fbc None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:24.867710 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5716c-e7e1-4291-adae-f9ab1c09d161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:24.868960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5716c-e7e1-4291-adae-f9ab1c09d161 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:24.869487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5716c-e7e1-4291-adae-f9ab1c09d161 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:24.870055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5716c-e7e1-4291-adae-f9ab1c09d161 None admin] PATH_INFO: `/v3/groups/eca681a7f19841b6a93e31848cb88658` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:24.871526 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5716c-e7e1-4291-adae-f9ab1c09d161 None admin] RBAC: Authorizing `identity:get_group(group_id=eca681a7f19841b6a93e31848cb88658)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:24.873253 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5716c-e7e1-4291-adae-f9ab1c09d161 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:24.875638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 199/404] 10.222.0.73 () {56 vars in 1180 bytes} [Thu May 19 11:55:24 2022] GET /identity/v3/groups/eca681a7f19841b6a93e31848cb88658 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:24.877968 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710e5bf-241c-4937-a178-140481042dd1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:24.878457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710e5bf-241c-4937-a178-140481042dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:24.878927 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710e5bf-241c-4937-a178-140481042dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:24.897644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4710e5bf-241c-4937-a178-140481042dd1 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:24.899397 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4710e5bf-241c-4937-a178-140481042dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:24.925770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7515e-0232-44d0-9b3e-4fbaba07c753 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:24.936273 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:24.968269 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca0239-fd41-48ed-8e95-7d7069cfcb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:24.969739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca0239-fd41-48ed-8e95-7d7069cfcb5b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:24.970018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca0239-fd41-48ed-8e95-7d7069cfcb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:24.970294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca0239-fd41-48ed-8e95-7d7069cfcb5b None admin] PATH_INFO: `/v3/groups/eca681a7f19841b6a93e31848cb88658` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:24.972533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca0239-fd41-48ed-8e95-7d7069cfcb5b None admin] RBAC: Authorizing `identity:get_group(group_id=eca681a7f19841b6a93e31848cb88658)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:24.974083 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca0239-fd41-48ed-8e95-7d7069cfcb5b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:24.975984 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 206/405] 10.222.0.73 () {56 vars in 1180 bytes} [Thu May 19 11:55:24 2022] GET /identity/v3/groups/eca681a7f19841b6a93e31848cb88658 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:24.976572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca0239-fd41-48ed-8e95-7d7069cfcb5b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:24.979959 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 200/406] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:24.984893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710e5bf-241c-4937-a178-140481042dd1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:25.097911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca0239-fd41-48ed-8e95-7d7069cfcb5b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:25.098560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:25.109365 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710e5bf-241c-4937-a178-140481042dd1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:25.135031 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14219798-6a53-44a5-b5b1-e4b8086e1639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:25.135895 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14219798-6a53-44a5-b5b1-e4b8086e1639 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:25.136204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14219798-6a53-44a5-b5b1-e4b8086e1639 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:25.136479 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14219798-6a53-44a5-b5b1-e4b8086e1639 None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:25.137661 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14219798-6a53-44a5-b5b1-e4b8086e1639 None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:25.139088 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14219798-6a53-44a5-b5b1-e4b8086e1639 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:25.140790 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 207/407] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:24 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:25.141544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14219798-6a53-44a5-b5b1-e4b8086e1639 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:25.149251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8bd46-4768-4c44-814f-56a91a3e7fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:25.150119 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8bd46-4768-4c44-814f-56a91a3e7fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:25.150409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8bd46-4768-4c44-814f-56a91a3e7fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:25.150685 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8bd46-4768-4c44-814f-56a91a3e7fd5 None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:25.151876 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8bd46-4768-4c44-814f-56a91a3e7fd5 None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:25.153361 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8bd46-4768-4c44-814f-56a91a3e7fd5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:25.155117 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 201/408] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:24 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:25.156309 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeba8de-7f6d-4710-859e-127392388bba None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:25.156599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeba8de-7f6d-4710-859e-127392388bba None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:25.156884 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeba8de-7f6d-4710-859e-127392388bba None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:25.160368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 202/409] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:25.160368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeba8de-7f6d-4710-859e-127392388bba None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:25.195660 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:25.252290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14219798-6a53-44a5-b5b1-e4b8086e1639 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:25.275607 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeba8de-7f6d-4710-859e-127392388bba None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:25.286905 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421d45c-edeb-4c2b-a767-edf4b326ba41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:25.287708 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421d45c-edeb-4c2b-a767-edf4b326ba41 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:25.288019 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421d45c-edeb-4c2b-a767-edf4b326ba41 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:25.288305 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421d45c-edeb-4c2b-a767-edf4b326ba41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:25.300753 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421d45c-edeb-4c2b-a767-edf4b326ba41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:25.308721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-2421d45c-edeb-4c2b-a767-edf4b326ba41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:25.308721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:25.308721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:25.308721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:25.308721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:25.308721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:25.308721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:25.308721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:25.308721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:25.308721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:25.308721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:25.308721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:25.308721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:25.308721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:25.308721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:25.308721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:25.309799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:25.309799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:25.309799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:25.309799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:25.309799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:25.309799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:25.309799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:25.309799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:25.309799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:25.309799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:25.309799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:25.309799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:25.309799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:25.309799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:25.309799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:25.309799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:25.310777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:25.310777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:25.310777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:25.310777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:25.310777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:25.310777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:25.310777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:25.310777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:25.310777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:25.310777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:25.310777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:25.310777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:25.312420 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 208/410] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:55:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:25.313235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421d45c-edeb-4c2b-a767-edf4b326ba41 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:25.322698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ff07f-d920-4056-a8e0-e2974e91bc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:25.323800 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ff07f-d920-4056-a8e0-e2974e91bc02 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:25.324119 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ff07f-d920-4056-a8e0-e2974e91bc02 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:25.324400 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ff07f-d920-4056-a8e0-e2974e91bc02 None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8/groups/eca681a7f19841b6a93e31848cb88658/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:25.326366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ff07f-d920-4056-a8e0-e2974e91bc02 None admin] RBAC: Authorizing `identity:create_grant(project_id=2df7204786d44ef282e29fc4ad4ecfa8, group_id=eca681a7f19841b6a93e31848cb88658, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:25.327799 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ff07f-d920-4056-a8e0-e2974e91bc02 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:25.344743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 203/411] 10.222.0.73 () {58 vars in 1442 bytes} [Thu May 19 11:55:25 2022] PUT /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8/groups/eca681a7f19841b6a93e31848cb88658/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:55:25.346738 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bad665-7c03-4f66-8c2a-92ee891625c3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:25.347085 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bad665-7c03-4f66-8c2a-92ee891625c3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:25.347366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bad665-7c03-4f66-8c2a-92ee891625c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:25.382095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e6bad665-7c03-4f66-8c2a-92ee891625c3 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:25.383723 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e6bad665-7c03-4f66-8c2a-92ee891625c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:25.405341 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:25.443322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421d45c-edeb-4c2b-a767-edf4b326ba41 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:25.446544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:25.485002 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 204/412] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:25.485964 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed186a2a-ca88-4e16-aabd-98a041f0f200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:25.486248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bad665-7c03-4f66-8c2a-92ee891625c3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:25.487726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed186a2a-ca88-4e16-aabd-98a041f0f200 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:25.488215 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed186a2a-ca88-4e16-aabd-98a041f0f200 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:25.488636 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed186a2a-ca88-4e16-aabd-98a041f0f200 None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8/groups/eca681a7f19841b6a93e31848cb88658/roles/a1fb3b01c7424cf18f71b9a2b8333f03` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:25.491305 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed186a2a-ca88-4e16-aabd-98a041f0f200 None admin] RBAC: Authorizing `identity:create_grant(project_id=2df7204786d44ef282e29fc4ad4ecfa8, group_id=eca681a7f19841b6a93e31848cb88658, role_id=a1fb3b01c7424cf18f71b9a2b8333f03)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:25.493071 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed186a2a-ca88-4e16-aabd-98a041f0f200 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:25.520507 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 209/413] 10.222.0.73 () {58 vars in 1442 bytes} [Thu May 19 11:55:25 2022] PUT /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8/groups/eca681a7f19841b6a93e31848cb88658/roles/a1fb3b01c7424cf18f71b9a2b8333f03 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:55:25.522678 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed186a2a-ca88-4e16-aabd-98a041f0f200 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:25.643414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bad665-7c03-4f66-8c2a-92ee891625c3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:25.674812 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed186a2a-ca88-4e16-aabd-98a041f0f200 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:25.696270 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046850d-c89d-464e-9b58-b961d405ec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:25.697896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046850d-c89d-464e-9b58-b961d405ec44 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:25.698364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046850d-c89d-464e-9b58-b961d405ec44 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:25.699117 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046850d-c89d-464e-9b58-b961d405ec44 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:25.700126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046850d-c89d-464e-9b58-b961d405ec44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:25.700841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046850d-c89d-464e-9b58-b961d405ec44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:25.703147 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046850d-c89d-464e-9b58-b961d405ec44 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:25.713457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c014d6-5298-4989-9dce-012c63ad4e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:25.714286 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c014d6-5298-4989-9dce-012c63ad4e95 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:25.714605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c014d6-5298-4989-9dce-012c63ad4e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:25.714846 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c014d6-5298-4989-9dce-012c63ad4e95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:25.717743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 205/414] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:25.726545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046850d-c89d-464e-9b58-b961d405ec44 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:25.738279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c014d6-5298-4989-9dce-012c63ad4e95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:25.746620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f2c014d6-5298-4989-9dce-012c63ad4e95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:25.746620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:25.746620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:25.746620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:25.746620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:25.746620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:25.746620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:25.746620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:25.746620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:25.746620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:25.746620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:25.746620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:25.746620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:25.746620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:25.746620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:25.746620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:25.747542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:25.747542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:25.747542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:25.747542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:25.747542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:25.747542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:25.747542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:25.747542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:25.747542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:25.747542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:25.747542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:25.747542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:25.747542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:25.747542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:25.747542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:25.747542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:25.748439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:25.748439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:25.748439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:25.748439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:25.748439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:25.748439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:25.748439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:25.748439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:25.748439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:25.748439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:25.748439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:25.748439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:25.748439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 210/415] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:55:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:25.755312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c014d6-5298-4989-9dce-012c63ad4e95 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:25.757120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:25.784224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:25.867388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046850d-c89d-464e-9b58-b961d405ec44 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:25.867582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c014d6-5298-4989-9dce-012c63ad4e95 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:25.913489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c04f40-4401-42d9-b669-3b441c398f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:25.914982 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fef64-fcf6-444d-9fe7-0eae6dd1df1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:25.916626 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fef64-fcf6-444d-9fe7-0eae6dd1df1a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:25.916995 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c04f40-4401-42d9-b669-3b441c398f9f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:25.917511 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c04f40-4401-42d9-b669-3b441c398f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:25.918002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fef64-fcf6-444d-9fe7-0eae6dd1df1a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:25.918478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c04f40-4401-42d9-b669-3b441c398f9f None admin] PATH_INFO: `/v3/groups/46dec73c5ace4a37a4ccf035f37447bf` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:25.918948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fef64-fcf6-444d-9fe7-0eae6dd1df1a None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:25.920763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fef64-fcf6-444d-9fe7-0eae6dd1df1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:25.921578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c04f40-4401-42d9-b669-3b441c398f9f None admin] RBAC: Authorizing `identity:get_group(group_id=46dec73c5ace4a37a4ccf035f37447bf)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:25.922106 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fef64-fcf6-444d-9fe7-0eae6dd1df1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:25.923778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c04f40-4401-42d9-b669-3b441c398f9f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:25.925503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fef64-fcf6-444d-9fe7-0eae6dd1df1a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:25.925911 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 206/416] 10.222.0.73 () {56 vars in 1180 bytes} [Thu May 19 11:55:25 2022] GET /identity/v3/groups/46dec73c5ace4a37a4ccf035f37447bf => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:25.933041 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c04f40-4401-42d9-b669-3b441c398f9f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:25.934571 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 211/417] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:25.948715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fef64-fcf6-444d-9fe7-0eae6dd1df1a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:26.033367 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:26.058432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c04f40-4401-42d9-b669-3b441c398f9f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:26.098170 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbf7ab-a4ab-4d33-93a5-2a0e3eec089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:26.099328 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbf7ab-a4ab-4d33-93a5-2a0e3eec089d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:26.100733 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbf7ab-a4ab-4d33-93a5-2a0e3eec089d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:26.101166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbf7ab-a4ab-4d33-93a5-2a0e3eec089d None admin] PATH_INFO: `/v3/projects/df2a417664864d77b82ff77f60f05d0b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:26.107275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbf7ab-a4ab-4d33-93a5-2a0e3eec089d None admin] RBAC: Authorizing `identity:get_project(project_id=df2a417664864d77b82ff77f60f05d0b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:26.108943 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbf7ab-a4ab-4d33-93a5-2a0e3eec089d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:26.112649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 207/418] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:25 2022] GET /identity/v3/projects/df2a417664864d77b82ff77f60f05d0b => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:26.120905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbf7ab-a4ab-4d33-93a5-2a0e3eec089d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:26.135940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:26.174049 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fef64-fcf6-444d-9fe7-0eae6dd1df1a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:26.229326 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbf7ab-a4ab-4d33-93a5-2a0e3eec089d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:26.265768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5e66f-0260-4b5c-8318-47165280fda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:26.266681 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5e66f-0260-4b5c-8318-47165280fda9 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:26.266978 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5e66f-0260-4b5c-8318-47165280fda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:26.267270 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5e66f-0260-4b5c-8318-47165280fda9 None admin] PATH_INFO: `/v3/projects/df2a417664864d77b82ff77f60f05d0b/groups/46dec73c5ace4a37a4ccf035f37447bf/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:26.274073 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5e66f-0260-4b5c-8318-47165280fda9 None admin] RBAC: Authorizing `identity:create_grant(project_id=df2a417664864d77b82ff77f60f05d0b, group_id=46dec73c5ace4a37a4ccf035f37447bf, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:26.275533 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5e66f-0260-4b5c-8318-47165280fda9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:26.277633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd73539-a279-4537-ac66-bf9a5afb9825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:26.278292 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd73539-a279-4537-ac66-bf9a5afb9825 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:26.278580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd73539-a279-4537-ac66-bf9a5afb9825 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:26.278881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd73539-a279-4537-ac66-bf9a5afb9825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:26.303562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 208/419] 10.222.0.73 () {58 vars in 1442 bytes} [Thu May 19 11:55:26 2022] PUT /identity/v3/projects/df2a417664864d77b82ff77f60f05d0b/groups/46dec73c5ace4a37a4ccf035f37447bf/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:55:26.405839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd73539-a279-4537-ac66-bf9a5afb9825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:26.407339 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd73539-a279-4537-ac66-bf9a5afb9825 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:26.498634 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:26.515731 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 212/420] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:26.521565 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5e66f-0260-4b5c-8318-47165280fda9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:26.537419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:26.685435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5e66f-0260-4b5c-8318-47165280fda9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:26.744688 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab97d13-e713-4df9-9e13-20f9c35ae63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:26.745573 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97d13-e713-4df9-9e13-20f9c35ae63d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:26.745894 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97d13-e713-4df9-9e13-20f9c35ae63d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:26.746182 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97d13-e713-4df9-9e13-20f9c35ae63d None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:26.747419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab97d13-e713-4df9-9e13-20f9c35ae63d None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:26.748958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab97d13-e713-4df9-9e13-20f9c35ae63d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:26.750956 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 209/421] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:26 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:26.756059 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd73539-a279-4537-ac66-bf9a5afb9825 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:26.870433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd73539-a279-4537-ac66-bf9a5afb9825 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:26.911907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7aeca-9113-4e33-8ec3-0c3039d918b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:26.912803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7aeca-9113-4e33-8ec3-0c3039d918b5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:26.913089 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7aeca-9113-4e33-8ec3-0c3039d918b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:26.913372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7aeca-9113-4e33-8ec3-0c3039d918b5 None admin] PATH_INFO: `/v3/groups/eca681a7f19841b6a93e31848cb88658` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:26.914593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7aeca-9113-4e33-8ec3-0c3039d918b5 None admin] RBAC: Authorizing `identity:get_group(group_id=eca681a7f19841b6a93e31848cb88658)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:26.916077 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7aeca-9113-4e33-8ec3-0c3039d918b5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:26.917701 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 213/422] 10.222.0.73 () {56 vars in 1180 bytes} [Thu May 19 11:55:26 2022] GET /identity/v3/groups/eca681a7f19841b6a93e31848cb88658 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:26.923649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab97d13-e713-4df9-9e13-20f9c35ae63d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:27.044816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:27.077799 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab97d13-e713-4df9-9e13-20f9c35ae63d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:27.115486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddf9d6-7509-4c66-88c4-0037ee6ef28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:27.116200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf9d6-7509-4c66-88c4-0037ee6ef28a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:27.116491 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf9d6-7509-4c66-88c4-0037ee6ef28a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:27.116833 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf9d6-7509-4c66-88c4-0037ee6ef28a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:27.117754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddf9d6-7509-4c66-88c4-0037ee6ef28a None admin] RBAC: Adding query filter params (group.id=eca681a7f19841b6a93e31848cb88658, role.id=a1fb3b01c7424cf18f71b9a2b8333f03, scope.project.id=c0e8ecfbb10647af9a7496598e58b208) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:27.118085 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddf9d6-7509-4c66-88c4-0037ee6ef28a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:27.119582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddf9d6-7509-4c66-88c4-0037ee6ef28a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:27.126870 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 210/423] 10.222.0.73 () {56 vars in 1376 bytes} [Thu May 19 11:55:26 2022] GET /identity/v3/role_assignments?group.id=eca681a7f19841b6a93e31848cb88658&scope.project.id=c0e8ecfbb10647af9a7496598e58b208&role.id=a1fb3b01c7424cf18f71b9a2b8333f03 => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:27.373009 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa22e2-15eb-4226-9c32-2a7c872fdc94 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:27.373398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa22e2-15eb-4226-9c32-2a7c872fdc94 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:27.373572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa22e2-15eb-4226-9c32-2a7c872fdc94 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:27.374948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 214/424] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:27.380942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322b389-e6b6-43c1-9804-d45f418eaea5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:27.381241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322b389-e6b6-43c1-9804-d45f418eaea5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:27.381528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322b389-e6b6-43c1-9804-d45f418eaea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:27.399672 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a322b389-e6b6-43c1-9804-d45f418eaea5 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:27.400925 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a322b389-e6b6-43c1-9804-d45f418eaea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:27.478102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 211/425] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:27.501849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa22e2-15eb-4226-9c32-2a7c872fdc94 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:27.563786 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:27.617789 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa22e2-15eb-4226-9c32-2a7c872fdc94 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:27.660499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3adc64-0cd2-4af4-87b2-51159a800fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:27.661248 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3adc64-0cd2-4af4-87b2-51159a800fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:27.661585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3adc64-0cd2-4af4-87b2-51159a800fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:27.661870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3adc64-0cd2-4af4-87b2-51159a800fa0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:27.674606 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3adc64-0cd2-4af4-87b2-51159a800fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:27.682572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-9d3adc64-0cd2-4af4-87b2-51159a800fa0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:27.682572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:27.682572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:27.682572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:27.682572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:27.682572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:27.682572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:27.682572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:27.682572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:27.682572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:27.682572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:27.682572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:27.682572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:27.682572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:27.682572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:27.682572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:27.683470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:27.683470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:27.683470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:27.683470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:27.683470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:27.683470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:27.683470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:27.683470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:27.683470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:27.683470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:27.683470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:27.683470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:27.683470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:27.683470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:27.683470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:27.683470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:27.684283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:27.684283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:27.684283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:27.684283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:27.684283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:27.684283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:27.684283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:27.684283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:27.684283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:27.684283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:27.684283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:27.684283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:27.684899 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 215/426] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:27.690579 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322b389-e6b6-43c1-9804-d45f418eaea5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:27.759353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:27.796066 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322b389-e6b6-43c1-9804-d45f418eaea5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:27.831982 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06249a-8c08-4b35-8d69-cb4e56baf8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:27.832661 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06249a-8c08-4b35-8d69-cb4e56baf8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:27.832949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06249a-8c08-4b35-8d69-cb4e56baf8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:27.833287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06249a-8c08-4b35-8d69-cb4e56baf8e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:27.834036 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06249a-8c08-4b35-8d69-cb4e56baf8e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:27.834395 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06249a-8c08-4b35-8d69-cb4e56baf8e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:27.835829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06249a-8c08-4b35-8d69-cb4e56baf8e0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:27.844720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 212/427] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:55:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:27.850183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3adc64-0cd2-4af4-87b2-51159a800fa0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:27.961472 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3adc64-0cd2-4af4-87b2-51159a800fa0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:27.975784 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:28.003397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e31244-3b5f-4f3a-9d57-c8969ba6e17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:28.004089 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e31244-3b5f-4f3a-9d57-c8969ba6e17e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:28.004378 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e31244-3b5f-4f3a-9d57-c8969ba6e17e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:28.004658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e31244-3b5f-4f3a-9d57-c8969ba6e17e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:28.076773 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e31244-3b5f-4f3a-9d57-c8969ba6e17e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:28.078244 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e31244-3b5f-4f3a-9d57-c8969ba6e17e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:28.099261 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ddb23-764e-4ec5-86e1-ce1bc9a82afc None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:28.099568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ddb23-764e-4ec5-86e1-ce1bc9a82afc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:28.099827 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ddb23-764e-4ec5-86e1-ce1bc9a82afc None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:28.104240 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 213/428] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:28.107531 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd51ad6-b844-4b47-84e0-8aedea851822 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:28.107825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd51ad6-b844-4b47-84e0-8aedea851822 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:28.108227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd51ad6-b844-4b47-84e0-8aedea851822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:28.129105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6dd51ad6-b844-4b47-84e0-8aedea851822 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:28.130320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6dd51ad6-b844-4b47-84e0-8aedea851822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:28.184366 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 216/429] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:28.193366 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e31244-3b5f-4f3a-9d57-c8969ba6e17e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:28.209752 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 214/430] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:28.221302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:28.239030 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd51ad6-b844-4b47-84e0-8aedea851822 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:28.302271 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:28.327627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e31244-3b5f-4f3a-9d57-c8969ba6e17e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:28.356938 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd51ad6-b844-4b47-84e0-8aedea851822 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:28.375785 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27d78e-4c6f-4a27-bec7-186b87312d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:28.378538 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27d78e-4c6f-4a27-bec7-186b87312d4b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:28.378978 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27d78e-4c6f-4a27-bec7-186b87312d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:28.379487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27d78e-4c6f-4a27-bec7-186b87312d4b None admin] PATH_INFO: `/v3/projects/c0e8ecfbb10647af9a7496598e58b208` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:28.381646 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27d78e-4c6f-4a27-bec7-186b87312d4b None admin] RBAC: Authorizing `identity:get_project(project_id=c0e8ecfbb10647af9a7496598e58b208)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:28.383540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27d78e-4c6f-4a27-bec7-186b87312d4b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:28.390967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 217/431] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:28 2022] GET /identity/v3/projects/c0e8ecfbb10647af9a7496598e58b208 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:28.391734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27d78e-4c6f-4a27-bec7-186b87312d4b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:28.411636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5933ae-f43a-4dd2-8b74-58081a797b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:28.412611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5933ae-f43a-4dd2-8b74-58081a797b1b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:28.412934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5933ae-f43a-4dd2-8b74-58081a797b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:28.413215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5933ae-f43a-4dd2-8b74-58081a797b1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:28.424444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5933ae-f43a-4dd2-8b74-58081a797b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:28.432301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-2b5933ae-f43a-4dd2-8b74-58081a797b1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:28.432301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:28.432301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:28.432301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:28.432301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:28.432301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:28.432301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:28.432301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:28.432301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:28.432301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:28.432301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:28.432301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:28.432301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:28.432301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:28.432301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:28.432301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:28.433179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:28.433179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:28.433179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:28.433179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:28.433179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:28.433179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:28.433179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:28.433179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:28.433179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:28.433179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:28.433179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:28.433179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:28.433179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:28.433179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:28.433179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:28.433179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:28.433964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:28.433964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:28.433964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:28.433964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:28.433964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:28.433964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:28.433964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:28.433964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:28.433964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:28.433964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:28.433964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 11:55:28.433964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:28.438590 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 215/432] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:28.440431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5933ae-f43a-4dd2-8b74-58081a797b1b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:28.500309 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:28.523651 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27d78e-4c6f-4a27-bec7-186b87312d4b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:28.553542 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5933ae-f43a-4dd2-8b74-58081a797b1b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:28.564357 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7508137-b994-4a94-bac2-23615fb29fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:28.566071 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7508137-b994-4a94-bac2-23615fb29fbc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:28.566362 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7508137-b994-4a94-bac2-23615fb29fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:28.566642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7508137-b994-4a94-bac2-23615fb29fbc None admin] PATH_INFO: `/v3/groups/eca681a7f19841b6a93e31848cb88658` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:28.568413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7508137-b994-4a94-bac2-23615fb29fbc None admin] RBAC: Authorizing `identity:get_group(group_id=eca681a7f19841b6a93e31848cb88658)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:28.570385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7508137-b994-4a94-bac2-23615fb29fbc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:28.576951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 218/433] 10.222.0.73 () {56 vars in 1180 bytes} [Thu May 19 11:55:28 2022] GET /identity/v3/groups/eca681a7f19841b6a93e31848cb88658 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:28.576951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4616c41-08b8-4abc-9480-0c25c599d184 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:28.576951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4616c41-08b8-4abc-9480-0c25c599d184 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:28.576951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4616c41-08b8-4abc-9480-0c25c599d184 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:28.576951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 219/434] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:28.578865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4616c41-08b8-4abc-9480-0c25c599d184 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:28.580399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:28.592613 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199775fc-b215-44d7-a397-6144ba3564e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:28.593288 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199775fc-b215-44d7-a397-6144ba3564e4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:28.593580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199775fc-b215-44d7-a397-6144ba3564e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:28.593862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199775fc-b215-44d7-a397-6144ba3564e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:28.594622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199775fc-b215-44d7-a397-6144ba3564e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:28.594929 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199775fc-b215-44d7-a397-6144ba3564e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:28.596348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199775fc-b215-44d7-a397-6144ba3564e4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:28.604982 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 216/435] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:55:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:28.606319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374478b0-4b10-46bf-b77b-40e0bb29f617 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:28.606609 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374478b0-4b10-46bf-b77b-40e0bb29f617 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:28.606885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374478b0-4b10-46bf-b77b-40e0bb29f617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:28.624748 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-374478b0-4b10-46bf-b77b-40e0bb29f617 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:28.625928 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-374478b0-4b10-46bf-b77b-40e0bb29f617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:28.700728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4616c41-08b8-4abc-9480-0c25c599d184 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:28.703624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 217/436] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:28.704134 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374478b0-4b10-46bf-b77b-40e0bb29f617 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:28.749176 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8d8e2-4cd9-42f4-85b0-a9aafd948378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:28.749829 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8d8e2-4cd9-42f4-85b0-a9aafd948378 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:28.750108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8d8e2-4cd9-42f4-85b0-a9aafd948378 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:28.750447 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8d8e2-4cd9-42f4-85b0-a9aafd948378 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:28.751236 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8d8e2-4cd9-42f4-85b0-a9aafd948378 None admin] RBAC: Adding query filter params (group.id=eca681a7f19841b6a93e31848cb88658, role.id=0251662126f747ad9804858316f8573a, scope.project.id=c0e8ecfbb10647af9a7496598e58b208) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:28.751522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8d8e2-4cd9-42f4-85b0-a9aafd948378 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:28.753529 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8d8e2-4cd9-42f4-85b0-a9aafd948378 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:28.768388 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 220/437] 10.222.0.73 () {56 vars in 1376 bytes} [Thu May 19 11:55:28 2022] GET /identity/v3/role_assignments?group.id=eca681a7f19841b6a93e31848cb88658&scope.project.id=c0e8ecfbb10647af9a7496598e58b208&role.id=0251662126f747ad9804858316f8573a => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:28.769874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8d8e2-4cd9-42f4-85b0-a9aafd948378 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:28.790227 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:28.830056 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374478b0-4b10-46bf-b77b-40e0bb29f617 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:28.844640 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:28.868859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067cb79-6d4c-4303-8ece-d42e6273a389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:28.869912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067cb79-6d4c-4303-8ece-d42e6273a389 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:28.870418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067cb79-6d4c-4303-8ece-d42e6273a389 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:28.870905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067cb79-6d4c-4303-8ece-d42e6273a389 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:28.893352 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8d8e2-4cd9-42f4-85b0-a9aafd948378 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:28.931358 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274d4a0-e555-4df8-8fbf-2f512872204c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:28.932237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274d4a0-e555-4df8-8fbf-2f512872204c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:28.932507 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274d4a0-e555-4df8-8fbf-2f512872204c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:28.932790 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274d4a0-e555-4df8-8fbf-2f512872204c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:28.945392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274d4a0-e555-4df8-8fbf-2f512872204c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:28.950703 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067cb79-6d4c-4303-8ece-d42e6273a389 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:28.952207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067cb79-6d4c-4303-8ece-d42e6273a389 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:28.953453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-9274d4a0-e555-4df8-8fbf-2f512872204c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:28.953453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:28.953453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:28.953453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:28.953453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:28.953453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:28.953453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:28.953453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:28.953453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:28.953453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:28.953453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:28.953453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:28.953453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:28.953453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:28.953453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:28.953453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:28.954324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:28.954324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:28.954324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:28.954324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:28.954324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:28.954324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:28.954324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:28.954324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:28.954324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:28.954324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:28.954324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:28.954324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:28.954324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:28.954324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:28.954324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:28.954324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:28.955574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:28.955574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:28.955574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:28.955574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:28.955574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:28.955574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:28.955574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:28.955574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:28.955574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:28.955574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:28.955574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:28.955574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:28.955574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 221/438] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:55:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:28.956431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccbc10-5caf-4e3b-b2a8-330edf2910e8 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:28.956431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccbc10-5caf-4e3b-b2a8-330edf2910e8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:28.956546 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccbc10-5caf-4e3b-b2a8-330edf2910e8 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:28.960175 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 222/439] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:28.960864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccbc10-5caf-4e3b-b2a8-330edf2910e8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:29.059505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:29.082359 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 218/440] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:29.083560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122202f3-e903-4cae-b295-e9113a2db429 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:29.083858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122202f3-e903-4cae-b295-e9113a2db429 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:29.084177 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122202f3-e903-4cae-b295-e9113a2db429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:29.094605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccbc10-5caf-4e3b-b2a8-330edf2910e8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:29.102314 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-122202f3-e903-4cae-b295-e9113a2db429 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:29.103872 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-122202f3-e903-4cae-b295-e9113a2db429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:29.114241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:29.133623 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186cb7f-3a35-4a27-b819-0f286d13705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:29.134293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186cb7f-3a35-4a27-b819-0f286d13705f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:29.134575 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186cb7f-3a35-4a27-b819-0f286d13705f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:29.134852 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186cb7f-3a35-4a27-b819-0f286d13705f None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:29.135593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186cb7f-3a35-4a27-b819-0f286d13705f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:29.135898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186cb7f-3a35-4a27-b819-0f286d13705f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:29.137293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186cb7f-3a35-4a27-b819-0f286d13705f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:29.146290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 223/441] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:29.147095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186cb7f-3a35-4a27-b819-0f286d13705f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:29.180538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 219/442] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:29.181128 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122202f3-e903-4cae-b295-e9113a2db429 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:29.268353 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186cb7f-3a35-4a27-b819-0f286d13705f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:29.307576 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122202f3-e903-4cae-b295-e9113a2db429 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:29.314989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21aada-2930-4e36-a5d6-e8b64873524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:29.315798 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21aada-2930-4e36-a5d6-e8b64873524d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:29.316178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21aada-2930-4e36-a5d6-e8b64873524d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:29.316456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21aada-2930-4e36-a5d6-e8b64873524d None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:29.317649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21aada-2930-4e36-a5d6-e8b64873524d None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:29.319098 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21aada-2930-4e36-a5d6-e8b64873524d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:29.320851 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 224/443] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:29 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:29.321571 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21aada-2930-4e36-a5d6-e8b64873524d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:29.325072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:29.344514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd1428-09c6-47d2-903d-a642e12a7309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:29.345162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd1428-09c6-47d2-903d-a642e12a7309 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:29.345489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd1428-09c6-47d2-903d-a642e12a7309 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:29.346301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd1428-09c6-47d2-903d-a642e12a7309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:29.358072 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:29.418182 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd1428-09c6-47d2-903d-a642e12a7309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:29.419655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd1428-09c6-47d2-903d-a642e12a7309 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:29.421197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21aada-2930-4e36-a5d6-e8b64873524d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:29.455778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad60da-12a3-4ca8-88f2-5dc5164cbe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:29.456596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad60da-12a3-4ca8-88f2-5dc5164cbe5f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:29.456891 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad60da-12a3-4ca8-88f2-5dc5164cbe5f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:29.457172 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad60da-12a3-4ca8-88f2-5dc5164cbe5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:29.467409 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad60da-12a3-4ca8-88f2-5dc5164cbe5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:29.475598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-96ad60da-12a3-4ca8-88f2-5dc5164cbe5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:29.475598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:29.475598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:29.475598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:29.475598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:29.475598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:29.475598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:29.475598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:29.475598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:29.475598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:29.475598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:29.475598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:29.475598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:29.475598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:29.475598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:29.475598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:29.476612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:29.476612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:29.476612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:29.476612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:29.476612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:29.476612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:29.476612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:29.476612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:29.476612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:29.476612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:29.476612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:29.476612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:29.476612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:29.476612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:29.476612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:29.476612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:29.482364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:29.482364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:29.482364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:29.482364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:29.482364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:29.482364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:29.482364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:29.482364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:29.482364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:29.482364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:29.482364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:29.482364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:29.482364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 225/444] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:55:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:29.482364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad60da-12a3-4ca8-88f2-5dc5164cbe5f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:29.521021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 220/445] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:29.521768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd1428-09c6-47d2-903d-a642e12a7309 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:29.537571 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:29.563736 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:29.575791 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad60da-12a3-4ca8-88f2-5dc5164cbe5f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:29.608945 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bfd42-1c2d-4ed9-888a-ceaf8cd39c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:29.609820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bfd42-1c2d-4ed9-888a-ceaf8cd39c62 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:29.610103 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bfd42-1c2d-4ed9-888a-ceaf8cd39c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:29.610379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bfd42-1c2d-4ed9-888a-ceaf8cd39c62 None admin] PATH_INFO: `/v3/groups/eca681a7f19841b6a93e31848cb88658` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:29.611622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bfd42-1c2d-4ed9-888a-ceaf8cd39c62 None admin] RBAC: Authorizing `identity:get_group(group_id=eca681a7f19841b6a93e31848cb88658)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:29.613171 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bfd42-1c2d-4ed9-888a-ceaf8cd39c62 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:29.614796 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 226/446] 10.222.0.73 () {56 vars in 1180 bytes} [Thu May 19 11:55:29 2022] GET /identity/v3/groups/eca681a7f19841b6a93e31848cb88658 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:29.615555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bfd42-1c2d-4ed9-888a-ceaf8cd39c62 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:29.623194 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd1428-09c6-47d2-903d-a642e12a7309 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:29.656181 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d79e8-0db0-43bf-8e44-5aa6c33594e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:29.656839 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d79e8-0db0-43bf-8e44-5aa6c33594e1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:29.657123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d79e8-0db0-43bf-8e44-5aa6c33594e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:29.657400 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d79e8-0db0-43bf-8e44-5aa6c33594e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:29.658682 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d79e8-0db0-43bf-8e44-5aa6c33594e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:29.658986 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d79e8-0db0-43bf-8e44-5aa6c33594e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:29.660369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d79e8-0db0-43bf-8e44-5aa6c33594e1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:29.668266 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 221/447] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:29.669055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d79e8-0db0-43bf-8e44-5aa6c33594e1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:29.713235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bfd42-1c2d-4ed9-888a-ceaf8cd39c62 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:29.741317 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:29.746394 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d3b6b-1c91-4040-b5c8-0b57d3f2a374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:29.747248 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d3b6b-1c91-4040-b5c8-0b57d3f2a374 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:29.747529 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d3b6b-1c91-4040-b5c8-0b57d3f2a374 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:29.747802 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d3b6b-1c91-4040-b5c8-0b57d3f2a374 None admin] PATH_INFO: `/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:29.749001 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d3b6b-1c91-4040-b5c8-0b57d3f2a374 None admin] RBAC: Authorizing `identity:get_project(project_id=2df7204786d44ef282e29fc4ad4ecfa8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:29.750434 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d3b6b-1c91-4040-b5c8-0b57d3f2a374 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:29.752627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 227/448] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:29 2022] GET /identity/v3/projects/2df7204786d44ef282e29fc4ad4ecfa8 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:29.753373 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d3b6b-1c91-4040-b5c8-0b57d3f2a374 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:29.773430 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d79e8-0db0-43bf-8e44-5aa6c33594e1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:29.775706 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:29.806443 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77ba93-dc51-4856-815f-56ad9fb54d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:29.807088 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ba93-dc51-4856-815f-56ad9fb54d6d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:29.807375 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ba93-dc51-4856-815f-56ad9fb54d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:29.807653 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ba93-dc51-4856-815f-56ad9fb54d6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:29.808506 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77ba93-dc51-4856-815f-56ad9fb54d6d None admin] RBAC: Adding query filter params (group.id=eca681a7f19841b6a93e31848cb88658, role.id=0251662126f747ad9804858316f8573a, scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:29.808818 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77ba93-dc51-4856-815f-56ad9fb54d6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:29.810270 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77ba93-dc51-4856-815f-56ad9fb54d6d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:29.816434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 222/449] 10.222.0.73 () {56 vars in 1376 bytes} [Thu May 19 11:55:29 2022] GET /identity/v3/role_assignments?group.id=eca681a7f19841b6a93e31848cb88658&scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8&role.id=0251662126f747ad9804858316f8573a => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:29.817195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77ba93-dc51-4856-815f-56ad9fb54d6d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:29.856635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d3b6b-1c91-4040-b5c8-0b57d3f2a374 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:29.896379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac354d44-80f5-452f-9822-b7f2723e340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:29.897066 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac354d44-80f5-452f-9822-b7f2723e340c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:29.898191 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac354d44-80f5-452f-9822-b7f2723e340c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:29.898191 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac354d44-80f5-452f-9822-b7f2723e340c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:29.932536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77ba93-dc51-4856-815f-56ad9fb54d6d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:29.970212 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fb968-d5dc-43e8-822f-a44f4a2a6ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:29.971135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fb968-d5dc-43e8-822f-a44f4a2a6ccb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:29.971427 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fb968-d5dc-43e8-822f-a44f4a2a6ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:29.971711 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fb968-d5dc-43e8-822f-a44f4a2a6ccb None admin] PATH_INFO: `/v3/groups/eca681a7f19841b6a93e31848cb88658` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:29.972986 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fb968-d5dc-43e8-822f-a44f4a2a6ccb None admin] RBAC: Authorizing `identity:get_group(group_id=eca681a7f19841b6a93e31848cb88658)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:29.974278 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:29.974471 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980fb968-d5dc-43e8-822f-a44f4a2a6ccb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:29.976468 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 223/450] 10.222.0.73 () {56 vars in 1180 bytes} [Thu May 19 11:55:29 2022] GET /identity/v3/groups/eca681a7f19841b6a93e31848cb88658 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:29.976924 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac354d44-80f5-452f-9822-b7f2723e340c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:29.978483 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac354d44-80f5-452f-9822-b7f2723e340c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:29.982260 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fb968-d5dc-43e8-822f-a44f4a2a6ccb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:30.022272 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:30.106342 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 228/451] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:30.108052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fb968-d5dc-43e8-822f-a44f4a2a6ccb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:30.109815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac354d44-80f5-452f-9822-b7f2723e340c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:30.145122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22224c-4850-4197-aec2-425dca9f453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:30.145786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22224c-4850-4197-aec2-425dca9f453c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:30.146073 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22224c-4850-4197-aec2-425dca9f453c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:30.146350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22224c-4850-4197-aec2-425dca9f453c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:30.147196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22224c-4850-4197-aec2-425dca9f453c None admin] RBAC: Adding query filter params (group.id=eca681a7f19841b6a93e31848cb88658, role.id=a1fb3b01c7424cf18f71b9a2b8333f03, scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:30.147507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22224c-4850-4197-aec2-425dca9f453c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:30.149078 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22224c-4850-4197-aec2-425dca9f453c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:30.155947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 224/452] 10.222.0.73 () {56 vars in 1376 bytes} [Thu May 19 11:55:29 2022] GET /identity/v3/role_assignments?group.id=eca681a7f19841b6a93e31848cb88658&scope.project.id=2df7204786d44ef282e29fc4ad4ecfa8&role.id=a1fb3b01c7424cf18f71b9a2b8333f03 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:30.233066 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:30.236746 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac354d44-80f5-452f-9822-b7f2723e340c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:30.272445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9db34-1fe2-4ae9-bbc0-94003582b5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:30.273319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9db34-1fe2-4ae9-bbc0-94003582b5fb None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:30.273599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9db34-1fe2-4ae9-bbc0-94003582b5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:30.273874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9db34-1fe2-4ae9-bbc0-94003582b5fb None admin] PATH_INFO: `/v3/projects/df2a417664864d77b82ff77f60f05d0b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:30.275090 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9db34-1fe2-4ae9-bbc0-94003582b5fb None admin] RBAC: Authorizing `identity:get_project(project_id=df2a417664864d77b82ff77f60f05d0b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:30.276577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9db34-1fe2-4ae9-bbc0-94003582b5fb None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:30.278311 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 229/453] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:55:30 2022] GET /identity/v3/projects/df2a417664864d77b82ff77f60f05d0b => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:30.284743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22224c-4850-4197-aec2-425dca9f453c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:30.386472 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:30.389624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22224c-4850-4197-aec2-425dca9f453c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:30.425683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ac1f0-2f81-4ee6-89d1-5b86de891e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:30.426554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ac1f0-2f81-4ee6-89d1-5b86de891e94 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:30.426837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ac1f0-2f81-4ee6-89d1-5b86de891e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:30.427116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ac1f0-2f81-4ee6-89d1-5b86de891e94 None admin] PATH_INFO: `/v3/groups/46dec73c5ace4a37a4ccf035f37447bf` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:30.428307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ac1f0-2f81-4ee6-89d1-5b86de891e94 None admin] RBAC: Authorizing `identity:get_group(group_id=46dec73c5ace4a37a4ccf035f37447bf)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:30.429750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ac1f0-2f81-4ee6-89d1-5b86de891e94 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:30.431362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 225/454] 10.222.0.73 () {56 vars in 1180 bytes} [Thu May 19 11:55:30 2022] GET /identity/v3/groups/46dec73c5ace4a37a4ccf035f37447bf => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:30.437172 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9db34-1fe2-4ae9-bbc0-94003582b5fb None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:30.541797 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9db34-1fe2-4ae9-bbc0-94003582b5fb None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:30.574536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b131c6b-61d8-4810-82eb-bbd1ced995c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:30.575183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b131c6b-61d8-4810-82eb-bbd1ced995c7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:30.575470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b131c6b-61d8-4810-82eb-bbd1ced995c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:30.575748 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b131c6b-61d8-4810-82eb-bbd1ced995c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:30.576605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b131c6b-61d8-4810-82eb-bbd1ced995c7 None admin] RBAC: Adding query filter params (group.id=46dec73c5ace4a37a4ccf035f37447bf, role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=df2a417664864d77b82ff77f60f05d0b) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:30.576922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b131c6b-61d8-4810-82eb-bbd1ced995c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:30.578354 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b131c6b-61d8-4810-82eb-bbd1ced995c7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:30.584627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 230/455] 10.222.0.73 () {56 vars in 1376 bytes} [Thu May 19 11:55:30 2022] GET /identity/v3/role_assignments?group.id=46dec73c5ace4a37a4ccf035f37447bf&scope.project.id=df2a417664864d77b82ff77f60f05d0b&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:33.278160 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6160b-d161-4c89-b717-81dae56edc80 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:33.279053 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6160b-d161-4c89-b717-81dae56edc80 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:33.279486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6160b-d161-4c89-b717-81dae56edc80 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:33.281494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 226/456] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:33.287350 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0c56a-9673-41c7-a41b-dd8693047944 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:33.287886 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0c56a-9673-41c7-a41b-dd8693047944 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:33.287886 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0c56a-9673-41c7-a41b-dd8693047944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:33.313183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-40b0c56a-9673-41c7-a41b-dd8693047944 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:33.315516 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-40b0c56a-9673-41c7-a41b-dd8693047944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:33.355037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:33.429679 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 231/457] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:33.461814 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6160b-d161-4c89-b717-81dae56edc80 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:33.513262 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cee988-c154-4cb3-a1d5-c82c0eb1e65a None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:33.513930 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cee988-c154-4cb3-a1d5-c82c0eb1e65a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:33.514427 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cee988-c154-4cb3-a1d5-c82c0eb1e65a None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:33.516287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 232/458] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:55:33.528667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166af2be-2920-446d-afe2-13d6bbeb713a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:33.529230 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166af2be-2920-446d-afe2-13d6bbeb713a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:33.529727 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166af2be-2920-446d-afe2-13d6bbeb713a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:33.557007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-166af2be-2920-446d-afe2-13d6bbeb713a None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:33.559240 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-166af2be-2920-446d-afe2-13d6bbeb713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:33.633900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6160b-d161-4c89-b717-81dae56edc80 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:33.650502 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 233/459] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:33.652427 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fcbe5-659f-4cbe-b140-0f2e7ae20de3 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:33.652937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fcbe5-659f-4cbe-b140-0f2e7ae20de3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:33.653412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fcbe5-659f-4cbe-b140-0f2e7ae20de3 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:33.655207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 234/460] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:33.661562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fc532-4c07-436f-8022-27085ea453b0 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:33.662123 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fc532-4c07-436f-8022-27085ea453b0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:33.662615 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fc532-4c07-436f-8022-27085ea453b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:33.677247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53478b4e-5899-4ada-b12a-ac5724ff9315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:33.678044 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53478b4e-5899-4ada-b12a-ac5724ff9315 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:33.678330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53478b4e-5899-4ada-b12a-ac5724ff9315 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:33.678610 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53478b4e-5899-4ada-b12a-ac5724ff9315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:33.691082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53478b4e-5899-4ada-b12a-ac5724ff9315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:33.691713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8e5fc532-4c07-436f-8022-27085ea453b0 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:33.692740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53478b4e-5899-4ada-b12a-ac5724ff9315 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:33.693569 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8e5fc532-4c07-436f-8022-27085ea453b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:33.711154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-53478b4e-5899-4ada-b12a-ac5724ff9315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:33.711154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:33.711154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:33.711154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:33.711154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:33.711154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:33.711154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:33.711154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:33.711154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:33.711154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:33.711154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:33.711154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:33.711154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:33.711154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:33.711154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:33.712057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:33.712057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:33.712057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:33.712057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:33.712057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:33.712057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:33.712057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:33.712057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:33.712057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:33.712057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:33.712057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:33.712057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:33.712057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:33.712057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:33.712057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:33.712057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:33.712057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:33.712909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:33.712909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:33.712909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:33.712909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:33.712909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 227/461] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:33.713528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53478b4e-5899-4ada-b12a-ac5724ff9315 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:33.738475 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:33.771993 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 235/462] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:33.772981 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fc532-4c07-436f-8022-27085ea453b0 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:33.817824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:33.831450 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53478b4e-5899-4ada-b12a-ac5724ff9315 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:33.867054 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc03915-c86e-43a4-a719-263a88ed5fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:33.869085 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc03915-c86e-43a4-a719-263a88ed5fda None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:33.869558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc03915-c86e-43a4-a719-263a88ed5fda None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:33.870018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc03915-c86e-43a4-a719-263a88ed5fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:33.883947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc03915-c86e-43a4-a719-263a88ed5fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:33.885717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc03915-c86e-43a4-a719-263a88ed5fda None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:33.899670 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fc532-4c07-436f-8022-27085ea453b0 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:33.909209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-5bc03915-c86e-43a4-a719-263a88ed5fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:33.909209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:33.909209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:33.909209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:33.909209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:33.909209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:33.909209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:33.909209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:33.909209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:33.909209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:33.909209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:33.909209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:33.909209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:33.909209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:33.909209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:33.910336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:33.910336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:33.910336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:33.910336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:33.910336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:33.910336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:33.910336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:33.910336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:33.910336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:33.910336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:33.910336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:33.910336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:33.910336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:33.910336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:33.910336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:33.910336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:33.910336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:33.911407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:33.911407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:33.911407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:33.911407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:33.912151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 228/463] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:33.913285 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc03915-c86e-43a4-a719-263a88ed5fda None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:33.954045 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942e4eb-e5dd-4a7b-a110-8b80e26fdd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:33.956490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942e4eb-e5dd-4a7b-a110-8b80e26fdd9d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:33.956962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942e4eb-e5dd-4a7b-a110-8b80e26fdd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:33.957419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942e4eb-e5dd-4a7b-a110-8b80e26fdd9d None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:33.958368 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942e4eb-e5dd-4a7b-a110-8b80e26fdd9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:33.958852 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942e4eb-e5dd-4a7b-a110-8b80e26fdd9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:33.960466 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942e4eb-e5dd-4a7b-a110-8b80e26fdd9d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:33.988888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 236/464] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:33.990539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942e4eb-e5dd-4a7b-a110-8b80e26fdd9d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:33.994555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:34.027301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc03915-c86e-43a4-a719-263a88ed5fda None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:34.062972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a5111-c454-4979-93e2-d9b04b0ad458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:34.063971 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5111-c454-4979-93e2-d9b04b0ad458 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:34.064374 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5111-c454-4979-93e2-d9b04b0ad458 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:34.065044 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5111-c454-4979-93e2-d9b04b0ad458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:34.076444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a5111-c454-4979-93e2-d9b04b0ad458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:34.078009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a5111-c454-4979-93e2-d9b04b0ad458 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:34.096370 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:34.097829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-3f8a5111-c454-4979-93e2-d9b04b0ad458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:34.097829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:34.097829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:34.097829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:34.097829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:34.097829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:34.097829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:34.097829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:34.097829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:34.097829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:34.097829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:34.097829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:34.097829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:34.097829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:34.097829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:34.098649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:34.098649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:34.098649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:34.098649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:34.098649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:34.098649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:34.098649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:34.098649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:34.098649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:34.098649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:34.098649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:34.098649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:34.098649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:34.098649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:34.098649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:34.098649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:34.098649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:34.099454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:34.099454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:34.099454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:34.099454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:34.103500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 229/465] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:34.104458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a5111-c454-4979-93e2-d9b04b0ad458 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:34.124343 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942e4eb-e5dd-4a7b-a110-8b80e26fdd9d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:34.161999 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51165429-c8eb-4d11-a72a-dfab05d31b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:34.162675 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51165429-c8eb-4d11-a72a-dfab05d31b37 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:34.162971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51165429-c8eb-4d11-a72a-dfab05d31b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:34.163255 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51165429-c8eb-4d11-a72a-dfab05d31b37 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:34.164016 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51165429-c8eb-4d11-a72a-dfab05d31b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:34.164334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51165429-c8eb-4d11-a72a-dfab05d31b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:34.165732 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51165429-c8eb-4d11-a72a-dfab05d31b37 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:34.177405 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 237/466] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:34.178214 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51165429-c8eb-4d11-a72a-dfab05d31b37 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:34.233057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a5111-c454-4979-93e2-d9b04b0ad458 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:34.257787 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:34.269962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fdb1f-5388-40a8-a6e2-28ba62972c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:34.270633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fdb1f-5388-40a8-a6e2-28ba62972c94 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:34.270918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fdb1f-5388-40a8-a6e2-28ba62972c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:34.271192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fdb1f-5388-40a8-a6e2-28ba62972c94 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:34.271891 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fdb1f-5388-40a8-a6e2-28ba62972c94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:34.273347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fdb1f-5388-40a8-a6e2-28ba62972c94 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:34.291874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51165429-c8eb-4d11-a72a-dfab05d31b37 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:34.300279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 230/467] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:55:34 2022] POST /identity/v3/users => generated 246 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:55:34.301630 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ed853-6b61-4441-9122-398cf3d89065 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:34.301947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ed853-6b61-4441-9122-398cf3d89065 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:34.302235 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ed853-6b61-4441-9122-398cf3d89065 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:34.303833 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 231/468] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:34.304427 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ed853-6b61-4441-9122-398cf3d89065 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:34.348896 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a6889-b6fc-4a5d-8891-39c8c6372f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:34.349119 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a6889-b6fc-4a5d-8891-39c8c6372f1e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:34.349364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a6889-b6fc-4a5d-8891-39c8c6372f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:34.349574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a6889-b6fc-4a5d-8891-39c8c6372f1e None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:34.350410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a6889-b6fc-4a5d-8891-39c8c6372f1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:34.350731 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a6889-b6fc-4a5d-8891-39c8c6372f1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:34.352292 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a6889-b6fc-4a5d-8891-39c8c6372f1e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:34.371226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 238/469] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:34.372865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda70a58-0a6b-44de-8804-94f9eb2c7309 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:34.373162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda70a58-0a6b-44de-8804-94f9eb2c7309 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:34.373446 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda70a58-0a6b-44de-8804-94f9eb2c7309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:34.379481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:34.397062 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-dda70a58-0a6b-44de-8804-94f9eb2c7309 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:34.398438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dda70a58-0a6b-44de-8804-94f9eb2c7309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:34.469011 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ed853-6b61-4441-9122-398cf3d89065 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:34.480360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 239/470] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:34.481977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda70a58-0a6b-44de-8804-94f9eb2c7309 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:34.524376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67050fe-8679-4b28-9e90-1035232a29cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:34.525364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67050fe-8679-4b28-9e90-1035232a29cd None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:34.525813 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67050fe-8679-4b28-9e90-1035232a29cd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:34.526294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67050fe-8679-4b28-9e90-1035232a29cd None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:34.527162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67050fe-8679-4b28-9e90-1035232a29cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:34.528804 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67050fe-8679-4b28-9e90-1035232a29cd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:34.549419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 232/471] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:55:34 2022] POST /identity/v3/users => generated 248 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:55:34.550269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67050fe-8679-4b28-9e90-1035232a29cd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:34.601043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:34.622580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda70a58-0a6b-44de-8804-94f9eb2c7309 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:34.667310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:34.676043 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce785b-5735-4315-ab59-e34cd524ea29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:34.677144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce785b-5735-4315-ab59-e34cd524ea29 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:34.677596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce785b-5735-4315-ab59-e34cd524ea29 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:34.677885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce785b-5735-4315-ab59-e34cd524ea29 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:34.678894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce785b-5735-4315-ab59-e34cd524ea29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:34.680869 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce785b-5735-4315-ab59-e34cd524ea29 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:34.700322 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67050fe-8679-4b28-9e90-1035232a29cd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:34.717227 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 240/472] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:55:34 2022] POST /identity/v3/users => generated 248 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:55:34.719826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e8ed4-a7ce-4ba2-98e1-8d7ddfcd8338 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:34.720366 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e8ed4-a7ce-4ba2-98e1-8d7ddfcd8338 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:34.721167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e8ed4-a7ce-4ba2-98e1-8d7ddfcd8338 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:34.723713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 241/473] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:34.729973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56704404-4e76-425f-b6fa-4fd2ccec1a58 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:34.730607 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56704404-4e76-425f-b6fa-4fd2ccec1a58 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:34.731090 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56704404-4e76-425f-b6fa-4fd2ccec1a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:34.746715 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a776b12-c85a-45a1-bdb1-ead84447dbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:34.747620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a776b12-c85a-45a1-bdb1-ead84447dbaa None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:34.747908 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a776b12-c85a-45a1-bdb1-ead84447dbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:34.748267 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a776b12-c85a-45a1-bdb1-ead84447dbaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:34.751303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-56704404-4e76-425f-b6fa-4fd2ccec1a58 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:34.753264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-56704404-4e76-425f-b6fa-4fd2ccec1a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:34.760847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a776b12-c85a-45a1-bdb1-ead84447dbaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:34.762644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a776b12-c85a-45a1-bdb1-ead84447dbaa None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:34.785746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7a776b12-c85a-45a1-bdb1-ead84447dbaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:34.785746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:34.785746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:34.785746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:34.785746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:34.785746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:34.785746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:34.785746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:34.785746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:34.785746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:34.785746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:34.785746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:34.785746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:34.785746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:34.785746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:34.786853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:34.786853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:34.786853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:34.786853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:34.786853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:34.786853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:34.786853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:34.786853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:34.786853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:34.786853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:34.786853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:34.786853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:34.786853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:34.786853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:34.786853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:34.786853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:34.786853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:34.787873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:34.787873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:34.787873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:34.787873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:34.795491 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 233/474] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:34.797582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a776b12-c85a-45a1-bdb1-ead84447dbaa None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:34.851355 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 242/475] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:34.878306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56704404-4e76-425f-b6fa-4fd2ccec1a58 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:34.922831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:34.943850 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a776b12-c85a-45a1-bdb1-ead84447dbaa None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:34.980013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a91d2-3815-4b45-bfad-a340594aae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:34.980802 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a91d2-3815-4b45-bfad-a340594aae03 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:34.981159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a91d2-3815-4b45-bfad-a340594aae03 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:34.981514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a91d2-3815-4b45-bfad-a340594aae03 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:34.982318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a91d2-3815-4b45-bfad-a340594aae03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:34.983494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a91d2-3815-4b45-bfad-a340594aae03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:34.985187 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a91d2-3815-4b45-bfad-a340594aae03 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:34.998996 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 234/476] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:35.004675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a91d2-3815-4b45-bfad-a340594aae03 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:35.012314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56704404-4e76-425f-b6fa-4fd2ccec1a58 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:35.035962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:35.069684 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed2cfb-254b-41d7-86f6-f0fb7469a72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:35.070363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed2cfb-254b-41d7-86f6-f0fb7469a72b None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:35.070657 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed2cfb-254b-41d7-86f6-f0fb7469a72b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:35.070939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed2cfb-254b-41d7-86f6-f0fb7469a72b None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:35.071707 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed2cfb-254b-41d7-86f6-f0fb7469a72b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:35.073170 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed2cfb-254b-41d7-86f6-f0fb7469a72b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:35.081875 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.sql.core [None req-69ed2cfb-254b-41d7-86f6-f0fb7469a72b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 11:55:35.081875 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 11:55:35.081875 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [parameters: {'id': '9a6a80c0432945b2b00bdd44c1fb9362', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 11:55:35.081875 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80190) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 11:55:35.104199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-69ed2cfb-254b-41d7-86f6-f0fb7469a72b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 11:55:35.104199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:35.104199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:55:35.104199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:55:35.104199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:55:35.104199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:55:35.104199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:55:35.104199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:55:35.104199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:55:35.104199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application conn.query(q) May 19 11:55:35.104199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:55:35.104199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:55:35.104199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:55:35.104199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application result.read() May 19 11:55:35.104199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return ref.to_dict() May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:55:35.105134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application next(self.gen) May 19 11:55:35.106017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 11:55:35.106017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application yield resource May 19 11:55:35.106017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:55:35.106017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application next(self.gen) May 19 11:55:35.106017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 11:55:35.106017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self.session.rollback() May 19 11:55:35.106017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 11:55:35.106017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self.force_reraise() May 19 11:55:35.106017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 11:55:35.106017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise self.value May 19 11:55:35.106017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 11:55:35.106017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 11:55:35.106017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 11:55:35.106017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application session.commit() May 19 11:55:35.106017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 11:55:35.106017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 11:55:35.106017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 11:55:35.106842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._prepare_impl() May 19 11:55:35.106842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 11:55:35.106842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self.session.flush() May 19 11:55:35.106842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 11:55:35.106842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._flush(objects) May 19 11:55:35.106842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 11:55:35.106842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 11:55:35.106842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 11:55:35.106842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application compat.raise_( May 19 11:55:35.106842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:55:35.106842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception May 19 11:55:35.106842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 11:55:35.106842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application flush_context.execute() May 19 11:55:35.106842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 11:55:35.106842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rec.execute(self) May 19 11:55:35.106842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 11:55:35.106842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 11:55:35.107691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 11:55:35.107691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 11:55:35.107691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 11:55:35.107691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 11:55:35.107691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 11:55:35.107691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 11:55:35.107691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 11:55:35.107691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 11:55:35.107691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 11:55:35.107691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 11:55:35.107691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 11:55:35.107691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 11:55:35.107691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 11:55:35.107691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 11:55:35.107691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:55:35.107691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception May 19 11:55:35.108557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:55:35.108557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:55:35.108557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:55:35.108557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:55:35.108557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:55:35.108557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:55:35.108557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:55:35.108557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application conn.query(q) May 19 11:55:35.108557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:55:35.108557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:55:35.108557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:55:35.108557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application result.read() May 19 11:55:35.108557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:55:35.108557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:55:35.108557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:55:35.108557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:55:35.109322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:55:35.109322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:55:35.109322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:55:35.109322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:55:35.109322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 11:55:35.109322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 11:55:35.109322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [parameters: {'id': '9a6a80c0432945b2b00bdd44c1fb9362', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 11:55:35.109322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 11:55:35.109322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:35.109322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:55:35.109322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:35.109322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:35.109322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:35.109322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:35.109322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:35.109322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:35.110082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:35.110082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:35.110082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:35.110082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:35.110082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:35.110082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:35.110082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 11:55:35.110082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 11:55:35.110082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:35.110082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:35.110082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 11:55:35.110082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 11:55:35.110082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 11:55:35.110082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 11:55:35.110082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 11:55:35.110082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:35.110973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 243/477] 10.222.0.73 () {60 vars in 1131 bytes} [Thu May 19 11:55:34 2022] POST /identity/v3/roles => generated 144 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:35.113297 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed2cfb-254b-41d7-86f6-f0fb7469a72b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:35.143686 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a91d2-3815-4b45-bfad-a340594aae03 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:35.189307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf9ddc-d8ba-4348-be85-ddaa9577d68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:35.190942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf9ddc-d8ba-4348-be85-ddaa9577d68c None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:35.191429 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf9ddc-d8ba-4348-be85-ddaa9577d68c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:35.192095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf9ddc-d8ba-4348-be85-ddaa9577d68c None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:35.193790 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf9ddc-d8ba-4348-be85-ddaa9577d68c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:35.196086 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf9ddc-d8ba-4348-be85-ddaa9577d68c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:35.225825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 235/478] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:55:35 2022] POST /identity/v3/users => generated 249 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:55:35.242036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed2cfb-254b-41d7-86f6-f0fb7469a72b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:35.280086 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4498b-6b45-47ff-b384-f7d75cff002a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:35.280903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4498b-6b45-47ff-b384-f7d75cff002a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:35.281364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4498b-6b45-47ff-b384-f7d75cff002a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:35.281657 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4498b-6b45-47ff-b384-f7d75cff002a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:35.295520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4498b-6b45-47ff-b384-f7d75cff002a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:35.305235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-7ef4498b-6b45-47ff-b384-f7d75cff002a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:35.305235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:35.305235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:35.305235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:35.305235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:35.305235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:35.305235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:35.305235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:35.305235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:35.305235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:35.305235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:35.305235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:35.305235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:35.305235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:35.305235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:35.305235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:35.306198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:35.306198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:35.306198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:35.306198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:35.306198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:35.306198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:35.306198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:35.306198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:35.306198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:35.306198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:35.306198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:35.306198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:35.306198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:35.306198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:35.306198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:35.306198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:35.306968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:35.306968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:35.306968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:35.306968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:35.306968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:35.306968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:35.306968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:35.306968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:35.306968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:35.306968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:35.306968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 11:55:35.306968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:35.306968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 244/479] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:55:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:35.312236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf9ddc-d8ba-4348-be85-ddaa9577d68c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:35.322778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:35.455249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf9ddc-d8ba-4348-be85-ddaa9577d68c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:35.506148 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c0cbd-d583-422e-ac1b-5789946349ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:35.506844 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c0cbd-d583-422e-ac1b-5789946349ee None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:35.507135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c0cbd-d583-422e-ac1b-5789946349ee None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:35.507416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c0cbd-d583-422e-ac1b-5789946349ee None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:35.508220 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c0cbd-d583-422e-ac1b-5789946349ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:35.508536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c0cbd-d583-422e-ac1b-5789946349ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:35.509939 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c0cbd-d583-422e-ac1b-5789946349ee None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:35.525046 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 236/480] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:37.067878 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd977b5b-0677-493e-88d7-b8cb9c4ea547 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:37.068948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd977b5b-0677-493e-88d7-b8cb9c4ea547 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:37.069436 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd977b5b-0677-493e-88d7-b8cb9c4ea547 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:37.071419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 245/481] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:37.077484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a320b-0295-4b3c-98f4-d5aa0caba986 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:37.078484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a320b-0295-4b3c-98f4-d5aa0caba986 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:37.078965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a320b-0295-4b3c-98f4-d5aa0caba986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:37.098313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ea2a320b-0295-4b3c-98f4-d5aa0caba986 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:37.099841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ea2a320b-0295-4b3c-98f4-d5aa0caba986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:37.165056 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:37.173802 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 237/482] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:37.197439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd977b5b-0677-493e-88d7-b8cb9c4ea547 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:37.255363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:37.293954 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8add259-5772-47d1-ba10-c2a350b382af None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:37.294293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8add259-5772-47d1-ba10-c2a350b382af None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:37.294523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8add259-5772-47d1-ba10-c2a350b382af None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:37.296442 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 238/483] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:55:37.301267 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e74486-107c-493f-9ec6-d251150b93ca None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:37.301554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e74486-107c-493f-9ec6-d251150b93ca None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:37.301836 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e74486-107c-493f-9ec6-d251150b93ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:37.335700 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-98e74486-107c-493f-9ec6-d251150b93ca None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:37.336851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-98e74486-107c-493f-9ec6-d251150b93ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:37.341742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd977b5b-0677-493e-88d7-b8cb9c4ea547 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:37.415355 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74f9f2-67d3-4845-9f17-32aadb291779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:37.416561 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74f9f2-67d3-4845-9f17-32aadb291779 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:37.417065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74f9f2-67d3-4845-9f17-32aadb291779 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:37.417540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74f9f2-67d3-4845-9f17-32aadb291779 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:37.437214 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74f9f2-67d3-4845-9f17-32aadb291779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:37.447053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-5d74f9f2-67d3-4845-9f17-32aadb291779 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:37.447053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:37.447053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:37.447053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:37.447053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:37.447053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:37.447053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:37.447053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:37.447053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:37.447053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:37.447053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:37.447053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:37.447053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:37.447053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:37.447053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:37.447053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:37.448024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:37.448024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:37.448024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:37.448024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:37.448024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:37.448024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:37.448024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:37.448024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:37.448024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:37.448024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:37.448024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:37.448024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:37.448024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:37.448024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:37.448024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:37.448024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:37.448826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:37.448826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:37.448826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:37.448826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:37.448826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:37.448826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:37.448826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:37.448826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:37.448826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:37.448826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:37.448826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:37.448826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:37.451663 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 246/484] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:37.454497 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 239/485] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:37.461093 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74f9f2-67d3-4845-9f17-32aadb291779 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:37.518274 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e74486-107c-493f-9ec6-d251150b93ca None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:37.626327 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74f9f2-67d3-4845-9f17-32aadb291779 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:37.628537 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:37.680059 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e74486-107c-493f-9ec6-d251150b93ca None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:37.681134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6ab96-edde-4c76-a9b0-4e87286ac40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:37.681931 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6ab96-edde-4c76-a9b0-4e87286ac40d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:37.682335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6ab96-edde-4c76-a9b0-4e87286ac40d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:37.682615 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6ab96-edde-4c76-a9b0-4e87286ac40d None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:37.683376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6ab96-edde-4c76-a9b0-4e87286ac40d None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:37.683687 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6ab96-edde-4c76-a9b0-4e87286ac40d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:37.685119 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6ab96-edde-4c76-a9b0-4e87286ac40d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:37.694830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 247/486] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:55:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:37.696279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f01bfe-dcfb-46ba-b556-ef724a8d3112 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:37.696574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f01bfe-dcfb-46ba-b556-ef724a8d3112 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:37.696965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f01bfe-dcfb-46ba-b556-ef724a8d3112 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:37.698348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 248/487] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:37.703081 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f01bfe-dcfb-46ba-b556-ef724a8d3112 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:37.712039 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:37.724366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243b2eb-af0a-49ee-be20-8fd9637b17ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:37.725823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b2eb-af0a-49ee-be20-8fd9637b17ee None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:37.726320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b2eb-af0a-49ee-be20-8fd9637b17ee None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:37.726791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b2eb-af0a-49ee-be20-8fd9637b17ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:37.742348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243b2eb-af0a-49ee-be20-8fd9637b17ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:37.751380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7243b2eb-af0a-49ee-be20-8fd9637b17ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:37.751380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:37.751380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:37.751380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:37.751380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:37.751380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:37.751380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:37.751380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:37.751380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:37.751380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:37.751380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:37.751380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:37.751380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:37.751380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:37.751380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:37.751380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:37.752896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:37.752896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:37.752896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:37.752896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:37.752896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:37.752896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:37.752896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:37.752896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:37.752896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:37.752896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:37.752896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:37.752896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:37.752896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:37.752896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:37.752896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:37.752896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:37.753977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:37.753977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:37.753977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:37.753977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:37.753977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:37.753977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:37.753977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:37.753977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:37.753977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:37.753977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:37.753977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:37.753977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:37.753977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 240/488] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:37.755330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b5ad6-0590-4a81-9099-efdc6e42240e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:37.755685 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b5ad6-0590-4a81-9099-efdc6e42240e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:37.756060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b5ad6-0590-4a81-9099-efdc6e42240e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:37.773076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-306b5ad6-0590-4a81-9099-efdc6e42240e None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:37.774364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-306b5ad6-0590-4a81-9099-efdc6e42240e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:37.836947 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f01bfe-dcfb-46ba-b556-ef724a8d3112 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:37.858355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 241/489] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:37.859598 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b5ad6-0590-4a81-9099-efdc6e42240e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:37.887986 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814d833-341c-4b68-9da6-0e6f5ef26b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:37.888811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814d833-341c-4b68-9da6-0e6f5ef26b11 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:37.889174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814d833-341c-4b68-9da6-0e6f5ef26b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:37.889529 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814d833-341c-4b68-9da6-0e6f5ef26b11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:37.910010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814d833-341c-4b68-9da6-0e6f5ef26b11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:37.911670 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814d833-341c-4b68-9da6-0e6f5ef26b11 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:37.933580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-8814d833-341c-4b68-9da6-0e6f5ef26b11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:37.933580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:37.933580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:37.933580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:37.933580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:37.933580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:37.933580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:37.933580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:37.933580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:37.933580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:37.933580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:37.933580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:37.933580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:37.933580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:37.933580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:37.934451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:37.934451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:37.934451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:37.934451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:37.934451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:37.934451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:37.934451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:37.934451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:37.934451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:37.934451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:37.934451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:37.934451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:37.934451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:37.934451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:37.934451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:37.934451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:37.934451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:37.935431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:37.935431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:37.935431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:37.935431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:37.935431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 249/490] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:37.936412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814d833-341c-4b68-9da6-0e6f5ef26b11 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:37.956929 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:37.982314 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b5ad6-0590-4a81-9099-efdc6e42240e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:38.000990 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:38.020388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7caf8a6-f486-41af-bd89-6725fffefa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:38.021282 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caf8a6-f486-41af-bd89-6725fffefa95 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:38.021805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caf8a6-f486-41af-bd89-6725fffefa95 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:38.022249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caf8a6-f486-41af-bd89-6725fffefa95 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:38.023231 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7caf8a6-f486-41af-bd89-6725fffefa95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:38.023676 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7caf8a6-f486-41af-bd89-6725fffefa95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:38.025219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7caf8a6-f486-41af-bd89-6725fffefa95 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:38.035239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 242/491] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:55:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:38.040730 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7caf8a6-f486-41af-bd89-6725fffefa95 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:38.046004 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814d833-341c-4b68-9da6-0e6f5ef26b11 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:38.081890 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e17bec-9e68-446b-b31f-55c11ebd59da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:38.082570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e17bec-9e68-446b-b31f-55c11ebd59da None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:38.082661 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e17bec-9e68-446b-b31f-55c11ebd59da None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:38.082951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e17bec-9e68-446b-b31f-55c11ebd59da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:38.096810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e17bec-9e68-446b-b31f-55c11ebd59da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:38.105010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-29e17bec-9e68-446b-b31f-55c11ebd59da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:38.105010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:38.105010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:38.105010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:38.105010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:38.105010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:38.105010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:38.105010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:38.105010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:38.105010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:38.105010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:38.105010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:38.105010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:38.105010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:38.105010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:38.105010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:38.106147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:38.106147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:38.106147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:38.106147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:38.106147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:38.106147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:38.106147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:38.106147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:38.106147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:38.106147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:38.106147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:38.106147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:38.106147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:38.106147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:38.106147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:38.106147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:38.107310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:38.107310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:38.107310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:38.107310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:38.107310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:38.107310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:38.107310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:38.107310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:38.107310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:38.107310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:38.107310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:38.107310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:38.112016 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 250/492] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:38.113080 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e17bec-9e68-446b-b31f-55c11ebd59da None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:38.172907 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7caf8a6-f486-41af-bd89-6725fffefa95 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:38.210602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:38.223585 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54f65a-e147-45d2-a704-94a2cf976b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:38.224979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54f65a-e147-45d2-a704-94a2cf976b1c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:38.225443 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54f65a-e147-45d2-a704-94a2cf976b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:38.226000 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54f65a-e147-45d2-a704-94a2cf976b1c None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:38.226962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54f65a-e147-45d2-a704-94a2cf976b1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:38.227653 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54f65a-e147-45d2-a704-94a2cf976b1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:38.229893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54f65a-e147-45d2-a704-94a2cf976b1c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:38.237768 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e17bec-9e68-446b-b31f-55c11ebd59da None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:38.250623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 243/493] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:38.250623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54f65a-e147-45d2-a704-94a2cf976b1c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:38.277617 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde11972-ea78-4282-9289-739668a8c9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:38.278565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde11972-ea78-4282-9289-739668a8c9ff None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:38.278927 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde11972-ea78-4282-9289-739668a8c9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:38.279213 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde11972-ea78-4282-9289-739668a8c9ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:38.292644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde11972-ea78-4282-9289-739668a8c9ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:38.294126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde11972-ea78-4282-9289-739668a8c9ff None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:38.303324 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:38.314520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-fde11972-ea78-4282-9289-739668a8c9ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:38.314520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:38.314520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:38.314520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:38.314520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:38.314520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:38.314520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:38.314520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:38.314520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:38.314520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:38.314520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:38.314520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:38.314520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:38.314520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:38.314520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:38.315374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:38.315374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:38.315374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:38.315374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:38.315374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:38.315374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:38.315374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:38.315374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:38.315374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:38.315374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:38.315374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:38.315374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:38.315374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:38.315374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:38.315374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:38.315374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:38.315374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:38.316847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:38.316847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:38.316847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:38.316847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:38.316847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 251/494] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:38.316847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde11972-ea78-4282-9289-739668a8c9ff None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:38.380085 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54f65a-e147-45d2-a704-94a2cf976b1c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:38.421907 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084e47b-dd92-4b5a-890c-6ff50be3f1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:38.423363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084e47b-dd92-4b5a-890c-6ff50be3f1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:38.423804 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084e47b-dd92-4b5a-890c-6ff50be3f1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:38.424392 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084e47b-dd92-4b5a-890c-6ff50be3f1b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:38.425834 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084e47b-dd92-4b5a-890c-6ff50be3f1b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:38.426086 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084e47b-dd92-4b5a-890c-6ff50be3f1b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:38.427496 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084e47b-dd92-4b5a-890c-6ff50be3f1b7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:38.428817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde11972-ea78-4282-9289-739668a8c9ff None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:38.436457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 244/495] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:55:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:38.441425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad45f0-0b8b-4c84-9f36-866921e74211 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:38.442358 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad45f0-0b8b-4c84-9f36-866921e74211 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:38.442648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad45f0-0b8b-4c84-9f36-866921e74211 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:38.444483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 245/496] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:38.445052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad45f0-0b8b-4c84-9f36-866921e74211 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:38.465128 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:38.474397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57fc77-a61f-423b-99b9-b6133d8b4ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:38.475340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57fc77-a61f-423b-99b9-b6133d8b4ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:38.475624 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57fc77-a61f-423b-99b9-b6133d8b4ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:38.475928 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57fc77-a61f-423b-99b9-b6133d8b4ac7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:38.484021 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57fc77-a61f-423b-99b9-b6133d8b4ac7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:38.485644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57fc77-a61f-423b-99b9-b6133d8b4ac7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:38.501809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ee57fc77-a61f-423b-99b9-b6133d8b4ac7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:55:38.501809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:38.501809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:38.501809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:38.501809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:38.501809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:38.501809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:38.501809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:38.501809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:38.501809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:38.501809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:38.501809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:38.501809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:38.501809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:38.501809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:38.501809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:38.502887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:38.503974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:38.503974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:38.503974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:38.503974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:38.503974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:38.503974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:38.503974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:38.503974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:38.503974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:55:38.503974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:38.507587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 252/497] 10.222.0.73 () {56 vars in 1093 bytes} [Thu May 19 11:55:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:38.508478 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57fc77-a61f-423b-99b9-b6133d8b4ac7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:38.557032 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:38.560866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad45f0-0b8b-4c84-9f36-866921e74211 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:38.594506 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8946f-aaca-4322-9320-1065da9c9540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:38.595219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8946f-aaca-4322-9320-1065da9c9540 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:38.596044 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8946f-aaca-4322-9320-1065da9c9540 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:38.596328 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8946f-aaca-4322-9320-1065da9c9540 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:38.597048 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8946f-aaca-4322-9320-1065da9c9540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:38.597358 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8946f-aaca-4322-9320-1065da9c9540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:38.598720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8946f-aaca-4322-9320-1065da9c9540 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:38.610176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 246/498] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:38.610309 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57fc77-a61f-423b-99b9-b6133d8b4ac7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:38.611423 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34827a27-07ec-418a-b682-12a51b6d1969 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:38.611720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34827a27-07ec-418a-b682-12a51b6d1969 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:38.612024 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34827a27-07ec-418a-b682-12a51b6d1969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:38.628617 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-34827a27-07ec-418a-b682-12a51b6d1969 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:38.629795 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-34827a27-07ec-418a-b682-12a51b6d1969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:38.643967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29777f8e-5166-4801-b10c-e0cfe6570891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:38.644770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29777f8e-5166-4801-b10c-e0cfe6570891 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:38.645110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29777f8e-5166-4801-b10c-e0cfe6570891 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:38.645397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29777f8e-5166-4801-b10c-e0cfe6570891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:38.655960 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29777f8e-5166-4801-b10c-e0cfe6570891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:38.657411 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29777f8e-5166-4801-b10c-e0cfe6570891 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:38.674943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-29777f8e-5166-4801-b10c-e0cfe6570891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:38.674943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:38.674943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:38.674943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:38.674943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:38.674943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:38.674943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:38.674943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:38.674943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:38.674943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:38.674943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:38.674943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:38.674943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:38.674943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:38.674943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:38.675749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:38.675749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:38.675749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:38.675749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:38.675749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:38.675749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:38.675749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:38.675749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:38.675749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:38.675749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:38.675749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:38.675749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:38.675749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:38.675749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:38.675749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:38.675749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:38.675749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:38.676658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:38.676658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:38.676658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:38.676658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:38.676658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 253/499] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:38.676907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29777f8e-5166-4801-b10c-e0cfe6570891 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:38.701656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 247/500] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:38.702996 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ab36c-cd55-42b5-924e-70f1325706a1 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:38.703290 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ab36c-cd55-42b5-924e-70f1325706a1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:38.703566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ab36c-cd55-42b5-924e-70f1325706a1 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:38.705757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 248/501] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:38.706459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ab36c-cd55-42b5-924e-70f1325706a1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:38.724593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:38.783063 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29777f8e-5166-4801-b10c-e0cfe6570891 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:38.799433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:38.809995 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ab36c-cd55-42b5-924e-70f1325706a1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:38.816085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64f28c-cb0b-4622-a05e-242bae33d067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:38.816755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64f28c-cb0b-4622-a05e-242bae33d067 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:38.817046 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64f28c-cb0b-4622-a05e-242bae33d067 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:38.817327 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64f28c-cb0b-4622-a05e-242bae33d067 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:38.818171 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64f28c-cb0b-4622-a05e-242bae33d067 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:38.818487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64f28c-cb0b-4622-a05e-242bae33d067 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:38.819958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64f28c-cb0b-4622-a05e-242bae33d067 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:38.843605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be55676-e1b3-4fda-84c9-db0b8ac20e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:38.844427 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be55676-e1b3-4fda-84c9-db0b8ac20e25 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:38.844710 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be55676-e1b3-4fda-84c9-db0b8ac20e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:38.844984 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be55676-e1b3-4fda-84c9-db0b8ac20e25 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:38.851881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be55676-e1b3-4fda-84c9-db0b8ac20e25 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:38.853345 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be55676-e1b3-4fda-84c9-db0b8ac20e25 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:38.855674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 254/502] 10.222.0.73 () {56 vars in 1133 bytes} [Thu May 19 11:55:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:38.856523 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64f28c-cb0b-4622-a05e-242bae33d067 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:38.870076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-9be55676-e1b3-4fda-84c9-db0b8ac20e25 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 11:55:38.870076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:38.870076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:38.870076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:38.870076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:38.870076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:38.870076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:38.870076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:38.870076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:38.870076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:38.870076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:38.870076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:38.870076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:38.870076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:38.870076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:38.870076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:38.871162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:38.872077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:38.872077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:38.872077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:38.872077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:38.872077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:38.872077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:38.872077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:38.872077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:38.872077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 11:55:38.872077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:38.872077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 249/503] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:38.872631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f45cef-1816-48f4-9c8b-5c69152e69be None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:38.872723 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f45cef-1816-48f4-9c8b-5c69152e69be None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:38.873000 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f45cef-1816-48f4-9c8b-5c69152e69be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:38.889195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f6f45cef-1816-48f4-9c8b-5c69152e69be None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:38.890367 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f6f45cef-1816-48f4-9c8b-5c69152e69be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:38.953668 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:38.956245 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 250/504] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:38.957054 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f45cef-1816-48f4-9c8b-5c69152e69be None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:38.958402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64f28c-cb0b-4622-a05e-242bae33d067 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:38.993619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bd186-ad3b-4cca-b441-144f984cc032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:38.994277 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bd186-ad3b-4cca-b441-144f984cc032 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:38.994557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bd186-ad3b-4cca-b441-144f984cc032 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:38.994829 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bd186-ad3b-4cca-b441-144f984cc032 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:38.995549 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bd186-ad3b-4cca-b441-144f984cc032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:38.995853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bd186-ad3b-4cca-b441-144f984cc032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:38.997279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bd186-ad3b-4cca-b441-144f984cc032 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:39.008832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 255/505] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:39.009622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bd186-ad3b-4cca-b441-144f984cc032 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:39.036899 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:39.057029 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f45cef-1816-48f4-9c8b-5c69152e69be None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:39.089985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0faca-36cb-4664-9882-2df58024bd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:39.090779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0faca-36cb-4664-9882-2df58024bd00 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:39.091064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0faca-36cb-4664-9882-2df58024bd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:39.091347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0faca-36cb-4664-9882-2df58024bd00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:39.101306 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0faca-36cb-4664-9882-2df58024bd00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:39.108698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bd186-ad3b-4cca-b441-144f984cc032 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:39.109459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d5f0faca-36cb-4664-9882-2df58024bd00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:39.109459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:39.109459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:39.109459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:39.109459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:39.109459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:39.109459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:39.109459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:39.109459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:39.109459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:39.109459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:39.109459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:39.109459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:39.109459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:39.109459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:39.109459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:39.110329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:39.110329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:39.110329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:39.110329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:39.110329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:39.110329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:39.110329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:39.110329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:39.110329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:39.110329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:39.110329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:39.110329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:39.110329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:39.110329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:39.110329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:39.110329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:39.111606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:39.111606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:39.111606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:39.111606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:39.111606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:39.111606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:39.111606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:39.111606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:39.111606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:39.111606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:39.111606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:39.111606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:39.111606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 251/506] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:39.112296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0faca-36cb-4664-9882-2df58024bd00 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:39.148633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abaf7cc-f3d0-4436-a141-b166ecbea065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:39.149276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abaf7cc-f3d0-4436-a141-b166ecbea065 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:39.149558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abaf7cc-f3d0-4436-a141-b166ecbea065 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:39.149837 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abaf7cc-f3d0-4436-a141-b166ecbea065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:39.176879 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:39.213913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0faca-36cb-4664-9882-2df58024bd00 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:39.217571 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abaf7cc-f3d0-4436-a141-b166ecbea065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:39.219027 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abaf7cc-f3d0-4436-a141-b166ecbea065 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:39.247180 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ccec9-9b89-4855-aea7-87ec55bb883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:39.247840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ccec9-9b89-4855-aea7-87ec55bb883f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:39.248150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ccec9-9b89-4855-aea7-87ec55bb883f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:39.248433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ccec9-9b89-4855-aea7-87ec55bb883f None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:39.249271 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ccec9-9b89-4855-aea7-87ec55bb883f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:39.249587 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ccec9-9b89-4855-aea7-87ec55bb883f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:39.251041 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ccec9-9b89-4855-aea7-87ec55bb883f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:39.275774 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:39.287198 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 252/507] 10.222.0.73 () {56 vars in 1137 bytes} [Thu May 19 11:55:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:39.288025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ccec9-9b89-4855-aea7-87ec55bb883f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:39.316122 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 256/508] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:39.316946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abaf7cc-f3d0-4436-a141-b166ecbea065 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:39.373129 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:39.393726 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ccec9-9b89-4855-aea7-87ec55bb883f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:39.414110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abaf7cc-f3d0-4436-a141-b166ecbea065 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:39.427155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a893736-ab02-4358-8228-58359bb3b4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:39.428024 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a893736-ab02-4358-8228-58359bb3b4aa None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:39.428309 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a893736-ab02-4358-8228-58359bb3b4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:39.428585 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a893736-ab02-4358-8228-58359bb3b4aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:39.438313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a893736-ab02-4358-8228-58359bb3b4aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:39.440354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a893736-ab02-4358-8228-58359bb3b4aa None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:39.448168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659037a9-b49b-4087-b594-526ca257e3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:39.448956 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659037a9-b49b-4087-b594-526ca257e3ae None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:39.449237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659037a9-b49b-4087-b594-526ca257e3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:39.449509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659037a9-b49b-4087-b594-526ca257e3ae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:39.456457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659037a9-b49b-4087-b594-526ca257e3ae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:39.457418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-0a893736-ab02-4358-8228-58359bb3b4aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:39.457418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:39.457418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:39.457418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:39.457418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:39.457418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:39.457418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:39.457418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:39.457418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:39.457418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:39.457418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:39.457418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:39.457418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:39.457418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:39.457418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:39.458207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:39.458207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:39.458207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:39.458207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:39.458207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:39.458207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:39.458207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:39.458207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:39.458207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:39.458207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:39.458207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:39.458207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:39.458207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:39.458207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:39.458207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:39.458207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:39.458207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:39.459016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:39.459016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:39.459016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:39.459016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:39.459216 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659037a9-b49b-4087-b594-526ca257e3ae None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:39.459289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 253/509] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:39.459353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a893736-ab02-4358-8228-58359bb3b4aa None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:39.473997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-659037a9-b49b-4087-b594-526ca257e3ae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:55:39.473997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:39.473997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:39.473997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:39.473997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:39.473997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:39.473997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:39.473997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:39.473997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:39.473997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:39.473997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:39.473997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:39.473997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:39.473997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:39.473997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:39.473997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:39.475057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:39.475962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:39.475962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:39.475962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:39.475962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:39.475962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:39.475962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:39.475962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:39.475962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:39.475962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:55:39.475962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:39.475962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 257/510] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:39.475962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659037a9-b49b-4087-b594-526ca257e3ae None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:39.516341 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:39.565994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a893736-ab02-4358-8228-58359bb3b4aa None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:39.573067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659037a9-b49b-4087-b594-526ca257e3ae None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:39.589541 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:39.599177 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442c08d-f690-45b5-a7c4-38015074c37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:39.599837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442c08d-f690-45b5-a7c4-38015074c37f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:39.600152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442c08d-f690-45b5-a7c4-38015074c37f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:39.600440 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442c08d-f690-45b5-a7c4-38015074c37f None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:39.601198 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442c08d-f690-45b5-a7c4-38015074c37f None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:39.601504 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442c08d-f690-45b5-a7c4-38015074c37f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:39.602854 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442c08d-f690-45b5-a7c4-38015074c37f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:39.607136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e03d2-68f1-4896-b7d0-7fb6417a1cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:39.607776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e03d2-68f1-4896-b7d0-7fb6417a1cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:39.608093 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e03d2-68f1-4896-b7d0-7fb6417a1cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:39.608378 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e03d2-68f1-4896-b7d0-7fb6417a1cb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:39.611412 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 254/511] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:55:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:39.612164 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442c08d-f690-45b5-a7c4-38015074c37f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:39.680135 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e03d2-68f1-4896-b7d0-7fb6417a1cb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:39.682254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e03d2-68f1-4896-b7d0-7fb6417a1cb1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:39.711430 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442c08d-f690-45b5-a7c4-38015074c37f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:39.724551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:39.746483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249f074-49ab-4c2c-8ff5-ae8b33dcf4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:39.747268 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249f074-49ab-4c2c-8ff5-ae8b33dcf4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:39.747551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249f074-49ab-4c2c-8ff5-ae8b33dcf4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:39.747826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249f074-49ab-4c2c-8ff5-ae8b33dcf4d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:39.757993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249f074-49ab-4c2c-8ff5-ae8b33dcf4d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:39.759420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249f074-49ab-4c2c-8ff5-ae8b33dcf4d3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:39.775822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-3249f074-49ab-4c2c-8ff5-ae8b33dcf4d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:39.775822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:39.775822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:39.775822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:39.775822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:39.775822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:39.775822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:39.775822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:39.775822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:39.775822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:39.775822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:39.775822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:39.775822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:39.775822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:39.775822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:39.776636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:39.776636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:39.776636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:39.776636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:39.776636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:39.776636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:39.776636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:39.776636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:39.776636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:39.776636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:39.776636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:39.776636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:39.776636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:39.776636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:39.776636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:39.776636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:39.776636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:39.777455 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:39.777455 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:39.777455 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:39.777455 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:39.777455 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 255/512] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:39.778244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249f074-49ab-4c2c-8ff5-ae8b33dcf4d3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:39.778741 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 258/513] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:39.779632 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e03d2-68f1-4896-b7d0-7fb6417a1cb1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:39.798074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:39.877611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e03d2-68f1-4896-b7d0-7fb6417a1cb1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:39.880769 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249f074-49ab-4c2c-8ff5-ae8b33dcf4d3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:39.911069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee2b20-b18a-46ac-b4e1-c58afd438b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:39.911722 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2b20-b18a-46ac-b4e1-c58afd438b15 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:39.912039 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2b20-b18a-46ac-b4e1-c58afd438b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:39.912321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2b20-b18a-46ac-b4e1-c58afd438b15 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:39.913153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee2b20-b18a-46ac-b4e1-c58afd438b15 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:39.913461 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee2b20-b18a-46ac-b4e1-c58afd438b15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:39.913599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f30f8d-dd58-4d7a-a18c-7d6611994e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:39.914249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f30f8d-dd58-4d7a-a18c-7d6611994e1c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:39.914532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f30f8d-dd58-4d7a-a18c-7d6611994e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:39.914808 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f30f8d-dd58-4d7a-a18c-7d6611994e1c None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:39.914906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee2b20-b18a-46ac-b4e1-c58afd438b15 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:39.915520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f30f8d-dd58-4d7a-a18c-7d6611994e1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:39.915825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f30f8d-dd58-4d7a-a18c-7d6611994e1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:39.917199 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f30f8d-dd58-4d7a-a18c-7d6611994e1c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:39.928818 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 256/514] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:39.929590 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f30f8d-dd58-4d7a-a18c-7d6611994e1c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:39.936023 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 259/515] 10.222.0.73 () {56 vars in 1137 bytes} [Thu May 19 11:55:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:39.936765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee2b20-b18a-46ac-b4e1-c58afd438b15 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:39.953511 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:40.011144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:40.027551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f30f8d-dd58-4d7a-a18c-7d6611994e1c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:40.034231 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee2b20-b18a-46ac-b4e1-c58afd438b15 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:40.060795 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde07bf3-ac82-4c24-a634-060e53644ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:40.061575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde07bf3-ac82-4c24-a634-060e53644ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:40.061867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde07bf3-ac82-4c24-a634-060e53644ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:40.062144 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde07bf3-ac82-4c24-a634-060e53644ad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:40.067026 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19cdcd-bc6f-4cb6-aa24-b89278a553ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:40.067674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19cdcd-bc6f-4cb6-aa24-b89278a553ed None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:40.067991 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19cdcd-bc6f-4cb6-aa24-b89278a553ed None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:40.068280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19cdcd-bc6f-4cb6-aa24-b89278a553ed None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:40.068994 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19cdcd-bc6f-4cb6-aa24-b89278a553ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:40.069298 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19cdcd-bc6f-4cb6-aa24-b89278a553ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:40.070650 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19cdcd-bc6f-4cb6-aa24-b89278a553ed None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:40.071970 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde07bf3-ac82-4c24-a634-060e53644ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:40.073373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde07bf3-ac82-4c24-a634-060e53644ad7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:40.081953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 260/516] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:40.081953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19cdcd-bc6f-4cb6-aa24-b89278a553ed None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:40.091458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-bde07bf3-ac82-4c24-a634-060e53644ad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:40.091458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:40.091458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:40.091458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:40.091458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:40.091458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:40.091458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:40.091458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:40.091458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:40.091458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:40.091458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:40.091458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:40.091458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:40.091458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:40.091458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:40.092476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:40.092476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:40.092476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:40.092476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:40.092476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:40.092476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:40.092476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:40.092476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:40.092476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:40.092476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:40.092476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:40.092476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:40.092476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:40.092476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:40.092476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:40.092476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:40.092476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:40.093489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:40.093489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:40.093489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:40.093489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:40.095050 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 257/517] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:40.096355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde07bf3-ac82-4c24-a634-060e53644ad7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:40.174536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:40.184773 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19cdcd-bc6f-4cb6-aa24-b89278a553ed None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:40.197716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde07bf3-ac82-4c24-a634-060e53644ad7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:40.228209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d3b7b-dbba-4c73-93e3-1553e6d6dbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:40.229292 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d3b7b-dbba-4c73-93e3-1553e6d6dbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:40.229591 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d3b7b-dbba-4c73-93e3-1553e6d6dbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:40.229870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d3b7b-dbba-4c73-93e3-1553e6d6dbe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:40.232625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:40.237081 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4e0f9-e5a7-45e1-aa80-a16745650cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:40.237754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4e0f9-e5a7-45e1-aa80-a16745650cfd None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:40.238039 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4e0f9-e5a7-45e1-aa80-a16745650cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:40.238319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4e0f9-e5a7-45e1-aa80-a16745650cfd None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:40.239046 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4e0f9-e5a7-45e1-aa80-a16745650cfd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:40.240521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4e0f9-e5a7-45e1-aa80-a16745650cfd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:40.241394 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d3b7b-dbba-4c73-93e3-1553e6d6dbe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:40.242828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d3b7b-dbba-4c73-93e3-1553e6d6dbe3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:40.260193 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 258/518] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:55:40 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:55:40.260699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ba2d3b7b-dbba-4c73-93e3-1553e6d6dbe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:40.260699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:40.260699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:40.260699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:40.260699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:40.260699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:40.260699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:40.260699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:40.260699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:40.260699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:40.260699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:40.260699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:40.260699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:40.260699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:40.260699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:40.261592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:40.261592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:40.261592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:40.261592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:40.261592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:40.261592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:40.261592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:40.261592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:40.261592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:40.261592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:40.261592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:40.261592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:40.261592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:40.261592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:40.261592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:40.261592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:40.261592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:40.262441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:40.262441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:40.262441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:40.262441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:40.262658 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4e0f9-e5a7-45e1-aa80-a16745650cfd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:40.262725 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 261/519] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:40.262725 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d3b7b-dbba-4c73-93e3-1553e6d6dbe3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:40.380660 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d3b7b-dbba-4c73-93e3-1553e6d6dbe3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:40.400032 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4e0f9-e5a7-45e1-aa80-a16745650cfd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:40.420977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5182166-eaf1-45a5-84e6-dc0279b58d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:40.421788 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5182166-eaf1-45a5-84e6-dc0279b58d6c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:40.422076 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5182166-eaf1-45a5-84e6-dc0279b58d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:40.422836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5182166-eaf1-45a5-84e6-dc0279b58d6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:40.430755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5182166-eaf1-45a5-84e6-dc0279b58d6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:40.432267 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5182166-eaf1-45a5-84e6-dc0279b58d6c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:40.432696 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:40.441335 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0374ac-034a-44cd-a580-7af79d8f0bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:40.444677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0374ac-034a-44cd-a580-7af79d8f0bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:40.444968 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0374ac-034a-44cd-a580-7af79d8f0bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:40.445786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0374ac-034a-44cd-a580-7af79d8f0bd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:40.450166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b5182166-eaf1-45a5-84e6-dc0279b58d6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:40.450166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:40.450166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:40.450166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:40.450166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:40.450166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:40.450166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:40.450166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:40.450166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:40.450166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:40.450166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:40.450166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:40.450166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:40.450166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:40.450166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:40.451044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:40.451044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:40.451044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:40.451044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:40.451044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:40.451044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:40.451044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:40.451044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:40.451044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:40.451044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:40.451044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:40.451044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:40.451044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:40.451044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:40.451044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:40.451044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:40.451044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:40.451987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:40.451987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:40.451987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:40.451987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:40.451987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:40.451987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:40.451987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:40.451987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:40.451987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 262/520] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:40.452562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5182166-eaf1-45a5-84e6-dc0279b58d6c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:40.513160 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:40.530578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0374ac-034a-44cd-a580-7af79d8f0bd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:40.532080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0374ac-034a-44cd-a580-7af79d8f0bd6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:40.567546 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5182166-eaf1-45a5-84e6-dc0279b58d6c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:40.602609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20434aa8-34f2-43b9-8cc4-40db0e128ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:40.603492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20434aa8-34f2-43b9-8cc4-40db0e128ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:40.603948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20434aa8-34f2-43b9-8cc4-40db0e128ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:40.604373 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20434aa8-34f2-43b9-8cc4-40db0e128ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:40.605381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20434aa8-34f2-43b9-8cc4-40db0e128ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:40.605732 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20434aa8-34f2-43b9-8cc4-40db0e128ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:40.607111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20434aa8-34f2-43b9-8cc4-40db0e128ff0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:40.619167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 263/521] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:40.619983 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20434aa8-34f2-43b9-8cc4-40db0e128ff0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:40.642716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 259/522] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:40.643991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0374ac-034a-44cd-a580-7af79d8f0bd6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:40.683855 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:40.730248 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20434aa8-34f2-43b9-8cc4-40db0e128ff0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:40.740253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:40.762234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0374ac-034a-44cd-a580-7af79d8f0bd6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:40.767524 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde13154-91b7-41f9-8fed-b8702242e1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:40.768168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde13154-91b7-41f9-8fed-b8702242e1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:40.768460 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde13154-91b7-41f9-8fed-b8702242e1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:40.768740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde13154-91b7-41f9-8fed-b8702242e1c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:40.769463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde13154-91b7-41f9-8fed-b8702242e1c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:40.769784 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde13154-91b7-41f9-8fed-b8702242e1c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:40.771166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde13154-91b7-41f9-8fed-b8702242e1c6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:40.787252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 264/523] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:40.787252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde13154-91b7-41f9-8fed-b8702242e1c6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:40.807670 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190440e0-db79-4d36-81f8-b145af22e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:40.808378 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190440e0-db79-4d36-81f8-b145af22e731 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:40.808687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190440e0-db79-4d36-81f8-b145af22e731 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:40.808948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190440e0-db79-4d36-81f8-b145af22e731 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:40.809761 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190440e0-db79-4d36-81f8-b145af22e731 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:40.810390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190440e0-db79-4d36-81f8-b145af22e731 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:40.811552 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190440e0-db79-4d36-81f8-b145af22e731 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:40.830649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 260/524] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:55:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:40.831528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190440e0-db79-4d36-81f8-b145af22e731 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:40.896812 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde13154-91b7-41f9-8fed-b8702242e1c6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:40.928866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:40.933262 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d85ed-7c1d-4d16-a80c-7cb92e66c4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:40.934215 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d85ed-7c1d-4d16-a80c-7cb92e66c4cc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:40.934639 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d85ed-7c1d-4d16-a80c-7cb92e66c4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:40.935052 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d85ed-7c1d-4d16-a80c-7cb92e66c4cc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:40.938487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190440e0-db79-4d36-81f8-b145af22e731 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:40.943213 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d85ed-7c1d-4d16-a80c-7cb92e66c4cc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:40.944821 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d85ed-7c1d-4d16-a80c-7cb92e66c4cc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:40.959415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ae7d85ed-7c1d-4d16-a80c-7cb92e66c4cc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:55:40.959415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:40.959415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:40.959415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:40.959415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:40.959415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:40.959415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:40.959415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:40.959415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:40.959415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:40.959415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:40.959415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:40.959415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:40.959415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:40.959415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:40.959415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:40.960531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:40.964811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:40.964811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:40.964811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:40.964811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:40.964811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:40.964811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:40.964811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:40.964811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:40.964811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:55:40.964811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:40.964811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 265/525] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:40.964811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d85ed-7c1d-4d16-a80c-7cb92e66c4cc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:40.980001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac5a02-227a-49fc-8136-cccf6e425ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:40.981059 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac5a02-227a-49fc-8136-cccf6e425ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:40.981346 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac5a02-227a-49fc-8136-cccf6e425ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:40.981626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac5a02-227a-49fc-8136-cccf6e425ac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:40.992540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:40.993828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac5a02-227a-49fc-8136-cccf6e425ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:40.995680 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac5a02-227a-49fc-8136-cccf6e425ac5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:41.014495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-1eac5a02-227a-49fc-8136-cccf6e425ac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:41.014495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:41.014495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:41.014495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:41.014495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:41.014495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:41.014495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:41.014495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:41.014495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:41.014495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:41.014495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:41.014495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:41.014495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:41.014495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:41.014495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:41.015381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:41.015381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:41.015381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:41.015381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:41.015381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:41.015381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:41.015381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:41.015381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:41.015381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:41.015381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:41.015381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:41.015381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:41.015381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:41.015381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:41.015381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:41.015381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:41.015381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:41.016958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:41.016958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:41.016958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:41.016958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:41.016958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 261/526] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:41.016958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac5a02-227a-49fc-8136-cccf6e425ac5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:41.074342 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d85ed-7c1d-4d16-a80c-7cb92e66c4cc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:41.110455 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7f3c4-9f18-4014-b463-5c283783259b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:41.111942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7f3c4-9f18-4014-b463-5c283783259b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:41.112342 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7f3c4-9f18-4014-b463-5c283783259b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:41.112624 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7f3c4-9f18-4014-b463-5c283783259b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:41.119942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7f3c4-9f18-4014-b463-5c283783259b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:41.120896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac5a02-227a-49fc-8136-cccf6e425ac5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:41.121399 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7f3c4-9f18-4014-b463-5c283783259b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:41.136703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-0ab7f3c4-9f18-4014-b463-5c283783259b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:41.136703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:41.136703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:41.136703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:41.136703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:41.136703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:41.136703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:41.136703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:41.136703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:41.136703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:41.136703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:41.136703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:41.136703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:41.136703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:41.136703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:41.137585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:41.137585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:41.137585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:41.137585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:41.137585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:41.137585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:41.137585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:41.137585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:41.137585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:41.137585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:41.137585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:41.137585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:41.137585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:41.137585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:41.137585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:41.137585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:41.137585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:41.138392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:41.138392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:41.138392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:41.138392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:41.138392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:41.138392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:41.138392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:41.138392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:41.138392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 266/527] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:41.139338 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7f3c4-9f18-4014-b463-5c283783259b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:41.158187 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b8f07-fac4-44e5-af76-c8e4beb6712a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:41.158846 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b8f07-fac4-44e5-af76-c8e4beb6712a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:41.159129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b8f07-fac4-44e5-af76-c8e4beb6712a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:41.159407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b8f07-fac4-44e5-af76-c8e4beb6712a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:41.160269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b8f07-fac4-44e5-af76-c8e4beb6712a None admin] RBAC: Adding query filter params (role.id=d21329f1cd364fba8b79529896e00f81, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=bd0c1f0710f3447d94e67048a508781e) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:41.160575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b8f07-fac4-44e5-af76-c8e4beb6712a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:41.162014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b8f07-fac4-44e5-af76-c8e4beb6712a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:41.167705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 262/528] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:55:41 2022] GET /identity/v3/role_assignments?user.id=bd0c1f0710f3447d94e67048a508781e&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=d21329f1cd364fba8b79529896e00f81 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:41.168682 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b8f07-fac4-44e5-af76-c8e4beb6712a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:41.186622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:41.254271 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:41.269492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7f3c4-9f18-4014-b463-5c283783259b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:41.310471 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b8f07-fac4-44e5-af76-c8e4beb6712a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:41.320450 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bd5d7-27ba-4b87-b479-cc7924bbe465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:41.321144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bd5d7-27ba-4b87-b479-cc7924bbe465 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:41.321430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bd5d7-27ba-4b87-b479-cc7924bbe465 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:41.321708 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bd5d7-27ba-4b87-b479-cc7924bbe465 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:41.322571 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bd5d7-27ba-4b87-b479-cc7924bbe465 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:41.322886 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bd5d7-27ba-4b87-b479-cc7924bbe465 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:41.325497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bd5d7-27ba-4b87-b479-cc7924bbe465 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:41.349584 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 267/529] 10.222.0.73 () {56 vars in 1139 bytes} [Thu May 19 11:55:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:41.350829 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bd5d7-27ba-4b87-b479-cc7924bbe465 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:41.359385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1267ff9-64d8-4f6c-9130-3fa188a47ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:41.360096 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1267ff9-64d8-4f6c-9130-3fa188a47ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:41.360383 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1267ff9-64d8-4f6c-9130-3fa188a47ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:41.360697 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1267ff9-64d8-4f6c-9130-3fa188a47ab6 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:41.361466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1267ff9-64d8-4f6c-9130-3fa188a47ab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:41.362455 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1267ff9-64d8-4f6c-9130-3fa188a47ab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:41.363877 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1267ff9-64d8-4f6c-9130-3fa188a47ab6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:41.383268 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 263/530] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:41.383268 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1267ff9-64d8-4f6c-9130-3fa188a47ab6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:41.460645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:41.499147 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1267ff9-64d8-4f6c-9130-3fa188a47ab6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:41.506506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bd5d7-27ba-4b87-b479-cc7924bbe465 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:41.543776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d479b8-91d8-42a9-b452-06108ae2d620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:41.544478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d479b8-91d8-42a9-b452-06108ae2d620 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:41.544763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d479b8-91d8-42a9-b452-06108ae2d620 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:41.545301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d479b8-91d8-42a9-b452-06108ae2d620 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:41.555889 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e5612-d3db-4430-a03d-f23e57573d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:41.556574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e5612-d3db-4430-a03d-f23e57573d97 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:41.556855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e5612-d3db-4430-a03d-f23e57573d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:41.557126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e5612-d3db-4430-a03d-f23e57573d97 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:41.557922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e5612-d3db-4430-a03d-f23e57573d97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:41.558286 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e5612-d3db-4430-a03d-f23e57573d97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:41.559788 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e5612-d3db-4430-a03d-f23e57573d97 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:41.583635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 268/531] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:55:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:41.584414 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e5612-d3db-4430-a03d-f23e57573d97 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:41.593822 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:41.633739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d479b8-91d8-42a9-b452-06108ae2d620 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:41.635202 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d479b8-91d8-42a9-b452-06108ae2d620 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:41.714009 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e5612-d3db-4430-a03d-f23e57573d97 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:41.714643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:41.756882 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aba523-c9c2-4bf3-94ac-ff49f3b9cd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:41.758025 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aba523-c9c2-4bf3-94ac-ff49f3b9cd2c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:41.758516 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aba523-c9c2-4bf3-94ac-ff49f3b9cd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:41.759028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aba523-c9c2-4bf3-94ac-ff49f3b9cd2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:41.759468 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 264/532] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:41.760452 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d479b8-91d8-42a9-b452-06108ae2d620 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:41.768647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aba523-c9c2-4bf3-94ac-ff49f3b9cd2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:41.770894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aba523-c9c2-4bf3-94ac-ff49f3b9cd2c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:41.791047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-78aba523-c9c2-4bf3-94ac-ff49f3b9cd2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:41.791047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:41.791047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:41.791047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:41.791047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:41.791047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:41.791047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:41.791047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:41.791047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:41.791047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:41.791047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:41.791047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:41.791047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:41.791047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:41.791047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:41.791874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:41.791874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:41.791874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:41.791874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:41.791874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:41.791874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:41.791874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:41.791874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:41.791874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:41.791874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:41.791874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:41.791874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:41.791874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:41.791874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:41.791874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:41.791874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:41.791874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:41.792736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:41.792736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:41.792736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:41.792736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:41.792736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:41.792736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:41.792736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:41.792736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:41.798491 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 269/533] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:41.798491 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aba523-c9c2-4bf3-94ac-ff49f3b9cd2c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:41.873121 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d479b8-91d8-42a9-b452-06108ae2d620 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:41.889490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:41.910622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c92dc-8423-48fa-be45-908601428d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:41.911349 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c92dc-8423-48fa-be45-908601428d56 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:41.911551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c92dc-8423-48fa-be45-908601428d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:41.911828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c92dc-8423-48fa-be45-908601428d56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:41.913125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c92dc-8423-48fa-be45-908601428d56 None admin] RBAC: Adding query filter params (role.id=d21329f1cd364fba8b79529896e00f81, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=182c7bb48c184e9983c02ae86709e803) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:41.913125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c92dc-8423-48fa-be45-908601428d56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:41.914571 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c92dc-8423-48fa-be45-908601428d56 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:41.928088 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 265/534] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:55:41 2022] GET /identity/v3/role_assignments?user.id=182c7bb48c184e9983c02ae86709e803&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=d21329f1cd364fba8b79529896e00f81 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:41.929145 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c92dc-8423-48fa-be45-908601428d56 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:41.934788 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aba523-c9c2-4bf3-94ac-ff49f3b9cd2c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:41.979312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde9d29-090b-4d12-8713-d5dd901243d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:41.980542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde9d29-090b-4d12-8713-d5dd901243d2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:41.981053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde9d29-090b-4d12-8713-d5dd901243d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:41.981532 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde9d29-090b-4d12-8713-d5dd901243d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:41.995566 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde9d29-090b-4d12-8713-d5dd901243d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:41.997595 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde9d29-090b-4d12-8713-d5dd901243d2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:41.997702 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:42.019742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-dfde9d29-090b-4d12-8713-d5dd901243d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:42.019742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:42.019742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:42.019742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:42.019742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:42.019742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:42.019742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:42.019742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:42.019742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:42.019742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:42.019742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:42.019742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:42.019742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:42.019742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:42.019742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:42.020666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:42.020666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:42.020666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:42.020666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:42.020666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:42.020666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:42.020666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:42.020666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:42.020666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:42.020666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:42.020666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:42.020666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:42.020666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:42.020666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:42.020666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:42.020666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:42.020666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:42.021494 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:42.021494 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:42.021494 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:42.021494 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:42.024317 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 270/535] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:42.033803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde9d29-090b-4d12-8713-d5dd901243d2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:42.090651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c92dc-8423-48fa-be45-908601428d56 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:42.130641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af789d9d-0b78-4bdd-8fdf-45bd3cecaa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:42.131239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af789d9d-0b78-4bdd-8fdf-45bd3cecaa53 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:42.131526 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af789d9d-0b78-4bdd-8fdf-45bd3cecaa53 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:42.131805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af789d9d-0b78-4bdd-8fdf-45bd3cecaa53 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:42.133140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af789d9d-0b78-4bdd-8fdf-45bd3cecaa53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:42.133140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af789d9d-0b78-4bdd-8fdf-45bd3cecaa53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:42.134609 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af789d9d-0b78-4bdd-8fdf-45bd3cecaa53 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:42.148971 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 266/536] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:55:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:42.159758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af789d9d-0b78-4bdd-8fdf-45bd3cecaa53 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:42.182488 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde9d29-090b-4d12-8713-d5dd901243d2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:42.229214 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:42.281477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:42.284451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af789d9d-0b78-4bdd-8fdf-45bd3cecaa53 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:42.297074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab3d8a-9564-4e74-87d2-80eebc2bb1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:42.297750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3d8a-9564-4e74-87d2-80eebc2bb1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:42.298038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3d8a-9564-4e74-87d2-80eebc2bb1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:42.298347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3d8a-9564-4e74-87d2-80eebc2bb1b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:42.299086 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab3d8a-9564-4e74-87d2-80eebc2bb1b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:42.299398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab3d8a-9564-4e74-87d2-80eebc2bb1b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:42.300813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab3d8a-9564-4e74-87d2-80eebc2bb1b9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:42.325889 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 271/537] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:42.341947 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab3d8a-9564-4e74-87d2-80eebc2bb1b9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:42.358205 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f356958-4dfa-42d1-82fc-1f229637fdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:42.360331 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f356958-4dfa-42d1-82fc-1f229637fdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:42.360672 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f356958-4dfa-42d1-82fc-1f229637fdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:42.360962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f356958-4dfa-42d1-82fc-1f229637fdf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:42.362178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f356958-4dfa-42d1-82fc-1f229637fdf7 None admin] RBAC: Adding query filter params (role.id=d21329f1cd364fba8b79529896e00f81, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=a44bb5fc455a4965ac6904fb548530f2) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:42.362499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f356958-4dfa-42d1-82fc-1f229637fdf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:42.364028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f356958-4dfa-42d1-82fc-1f229637fdf7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:42.374785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 267/538] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:55:42 2022] GET /identity/v3/role_assignments?user.id=a44bb5fc455a4965ac6904fb548530f2&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=d21329f1cd364fba8b79529896e00f81 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:42.541549 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab3d8a-9564-4e74-87d2-80eebc2bb1b9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:42.575803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2074f-1124-4c03-a25c-14f2ef2be7b6 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:42.576480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2074f-1124-4c03-a25c-14f2ef2be7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:42.576982 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2074f-1124-4c03-a25c-14f2ef2be7b6 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:42.578942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 268/539] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:42.583553 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe992ee-09c8-4d93-b9fa-e198bbf9f13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:42.583553 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe992ee-09c8-4d93-b9fa-e198bbf9f13e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:42.583553 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe992ee-09c8-4d93-b9fa-e198bbf9f13e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:42.583553 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe992ee-09c8-4d93-b9fa-e198bbf9f13e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:42.585434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d3d4b-5091-4d9b-a13e-cfdddab64418 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:42.585993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d3d4b-5091-4d9b-a13e-cfdddab64418 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:42.586470 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d3d4b-5091-4d9b-a13e-cfdddab64418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:42.589179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe992ee-09c8-4d93-b9fa-e198bbf9f13e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:42.590777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe992ee-09c8-4d93-b9fa-e198bbf9f13e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:42.607682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-2fe992ee-09c8-4d93-b9fa-e198bbf9f13e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:42.607682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:42.607682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:42.607682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:42.607682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:42.607682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:42.607682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:42.607682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:42.607682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:42.607682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:42.607682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:42.607682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:42.607682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:42.607682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:42.607682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:42.608628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:42.608628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:42.608628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:42.608628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:42.608628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:42.608628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:42.608628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:42.608628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:42.608628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:42.608628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:42.608628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:42.608628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:42.608628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:42.608628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:42.608628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:42.608628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:42.608628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:42.609475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:42.609475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:42.609475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:42.609475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:42.609475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:42.609475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:42.609475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:42.609475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:42.609475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 272/540] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:42.617144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe992ee-09c8-4d93-b9fa-e198bbf9f13e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:42.624052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0a1d3d4b-5091-4d9b-a13e-cfdddab64418 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:42.626761 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0a1d3d4b-5091-4d9b-a13e-cfdddab64418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:42.676705 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:42.747840 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe992ee-09c8-4d93-b9fa-e198bbf9f13e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:42.776008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 269/541] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:42.804863 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d3d4b-5091-4d9b-a13e-cfdddab64418 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:42.820765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc683bb-f127-4162-a70d-f2924b1ceab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:42.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc683bb-f127-4162-a70d-f2924b1ceab1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:42.822200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc683bb-f127-4162-a70d-f2924b1ceab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:42.822653 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc683bb-f127-4162-a70d-f2924b1ceab1 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:42.823633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc683bb-f127-4162-a70d-f2924b1ceab1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:42.824276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc683bb-f127-4162-a70d-f2924b1ceab1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:42.828472 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc683bb-f127-4162-a70d-f2924b1ceab1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:42.853674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 273/542] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:55:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:42.858931 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc683bb-f127-4162-a70d-f2924b1ceab1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:42.996404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:43.012018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:43.021618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc683bb-f127-4162-a70d-f2924b1ceab1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:43.032441 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d3d4b-5091-4d9b-a13e-cfdddab64418 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:43.074113 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc9d0c-985d-4a9a-91cb-8422bb767b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:43.074922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc9d0c-985d-4a9a-91cb-8422bb767b98 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:43.075209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc9d0c-985d-4a9a-91cb-8422bb767b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:43.075490 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc9d0c-985d-4a9a-91cb-8422bb767b98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:43.087249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc9d0c-985d-4a9a-91cb-8422bb767b98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:43.096566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-c2bc9d0c-985d-4a9a-91cb-8422bb767b98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:43.096566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:43.096566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:43.096566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:43.096566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:43.096566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:43.096566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:43.096566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:43.096566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:43.096566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:43.096566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:43.096566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:43.096566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:43.096566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:43.096566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:43.096566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:43.097433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:43.097433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:43.097433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:43.097433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:43.097433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:43.097433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:43.097433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:43.097433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:43.097433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:43.097433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:43.097433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:43.097433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:43.097433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:43.097433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:43.097433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:43.097433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:43.098376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:43.098376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:43.098376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:43.098376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:43.098376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:43.098376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:43.098376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:43.098376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:43.098376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:43.098376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:43.098376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:43.098376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:43.098376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 270/543] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:43.109928 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc9d0c-985d-4a9a-91cb-8422bb767b98 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:43.116110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62428529-4675-4a85-87a6-44716af45cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:43.117033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62428529-4675-4a85-87a6-44716af45cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:43.118309 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62428529-4675-4a85-87a6-44716af45cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:43.118760 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62428529-4675-4a85-87a6-44716af45cc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:43.119787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62428529-4675-4a85-87a6-44716af45cc6 None admin] RBAC: Adding query filter params (role.id=d21329f1cd364fba8b79529896e00f81, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=4897919923a64881ac5540cc5d58df1c) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:43.124755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62428529-4675-4a85-87a6-44716af45cc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:43.126455 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62428529-4675-4a85-87a6-44716af45cc6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:43.136818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 274/544] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:55:42 2022] GET /identity/v3/role_assignments?user.id=4897919923a64881ac5540cc5d58df1c&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=d21329f1cd364fba8b79529896e00f81 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:43.273180 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc9d0c-985d-4a9a-91cb-8422bb767b98 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:43.331015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818ae13-b377-474a-8fc4-fded795749a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:43.331629 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818ae13-b377-474a-8fc4-fded795749a0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:43.331982 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818ae13-b377-474a-8fc4-fded795749a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:43.332200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818ae13-b377-474a-8fc4-fded795749a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:43.332975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818ae13-b377-474a-8fc4-fded795749a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:43.333282 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818ae13-b377-474a-8fc4-fded795749a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:43.334677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818ae13-b377-474a-8fc4-fded795749a0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:43.348439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 271/545] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:55:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:43.354119 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62428529-4675-4a85-87a6-44716af45cc6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:43.482424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62428529-4675-4a85-87a6-44716af45cc6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:43.534031 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb37f3-97ad-4231-b511-85debf3c6c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:43.534845 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb37f3-97ad-4231-b511-85debf3c6c86 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:43.535126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb37f3-97ad-4231-b511-85debf3c6c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:43.535401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb37f3-97ad-4231-b511-85debf3c6c86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:43.549904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb37f3-97ad-4231-b511-85debf3c6c86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:43.551347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb37f3-97ad-4231-b511-85debf3c6c86 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:43.573250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-1fdb37f3-97ad-4231-b511-85debf3c6c86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:43.573250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:43.573250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:43.573250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:43.573250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:43.573250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:43.573250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:43.573250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:43.573250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:43.573250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:43.573250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:43.573250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:43.573250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:43.573250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:43.573250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:43.574165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:43.574165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:43.574165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:43.574165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:43.574165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:43.574165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:43.574165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:43.574165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:43.574165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:43.574165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:43.574165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:43.574165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:43.574165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:43.574165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:43.574165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:43.574165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:43.574165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:43.575451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:43.575451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:43.575451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:43.575451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:43.575451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 275/546] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:43.581435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818ae13-b377-474a-8fc4-fded795749a0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:43.598325 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:43.714907 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818ae13-b377-474a-8fc4-fded795749a0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:43.767465 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24440218-b346-4612-86cf-794fa11dc5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:43.768244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24440218-b346-4612-86cf-794fa11dc5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:43.768535 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24440218-b346-4612-86cf-794fa11dc5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:43.768816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24440218-b346-4612-86cf-794fa11dc5f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:43.769626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24440218-b346-4612-86cf-794fa11dc5f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:43.769942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24440218-b346-4612-86cf-794fa11dc5f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:43.771362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24440218-b346-4612-86cf-794fa11dc5f9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:43.785849 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 272/547] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:43.793008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb37f3-97ad-4231-b511-85debf3c6c86 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:43.829594 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:43.904732 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d0868-4805-44cd-a14f-a45783fce181 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:43.905025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d0868-4805-44cd-a14f-a45783fce181 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:43.905235 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d0868-4805-44cd-a14f-a45783fce181 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:43.908124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 273/548] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:43.914060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdec2a7-67fc-4309-af84-425921c45427 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:43.914345 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdec2a7-67fc-4309-af84-425921c45427 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:43.914626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdec2a7-67fc-4309-af84-425921c45427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:43.948537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8cdec2a7-67fc-4309-af84-425921c45427 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:43.950054 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8cdec2a7-67fc-4309-af84-425921c45427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:43.959941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb37f3-97ad-4231-b511-85debf3c6c86 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:43.991486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb17377-4a27-4967-b35d-8571fc86bc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:43.992304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb17377-4a27-4967-b35d-8571fc86bc86 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:43.992586 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb17377-4a27-4967-b35d-8571fc86bc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:43.992860 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb17377-4a27-4967-b35d-8571fc86bc86 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:44.008117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb17377-4a27-4967-b35d-8571fc86bc86 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:44.009578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb17377-4a27-4967-b35d-8571fc86bc86 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:44.031419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-fdb17377-4a27-4967-b35d-8571fc86bc86 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:55:44.031419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:44.031419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:44.031419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:44.031419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:44.031419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:44.031419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:44.031419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:44.031419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:44.031419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:44.031419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:44.031419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:44.031419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:44.031419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:44.031419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:44.031419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:44.033385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:44.034911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:44.034911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:44.034911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:44.034911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:44.034911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:44.034911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:44.034911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:44.034911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:44.034911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:55:44.034911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:44.034911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 276/549] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:55:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:44.041760 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb17377-4a27-4967-b35d-8571fc86bc86 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:44.074319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:44.083789 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 274/550] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:44.126100 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdec2a7-67fc-4309-af84-425921c45427 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:44.154393 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:44.211241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb17377-4a27-4967-b35d-8571fc86bc86 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:44.286682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f13722-7fc6-4e69-9489-53b225db986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:44.289114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f13722-7fc6-4e69-9489-53b225db986c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:44.289611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f13722-7fc6-4e69-9489-53b225db986c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:44.291028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f13722-7fc6-4e69-9489-53b225db986c None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:44.292130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f13722-7fc6-4e69-9489-53b225db986c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:44.294702 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f13722-7fc6-4e69-9489-53b225db986c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:44.296644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f13722-7fc6-4e69-9489-53b225db986c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:44.307996 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdec2a7-67fc-4309-af84-425921c45427 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:44.321190 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 277/551] 10.222.0.73 () {56 vars in 1135 bytes} [Thu May 19 11:55:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:44.328082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f13722-7fc6-4e69-9489-53b225db986c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:44.391627 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8e025-b7cc-4a0c-b030-8c96b1fda416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:44.392500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8e025-b7cc-4a0c-b030-8c96b1fda416 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:44.392785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8e025-b7cc-4a0c-b030-8c96b1fda416 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:44.393058 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8e025-b7cc-4a0c-b030-8c96b1fda416 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:44.414087 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8e025-b7cc-4a0c-b030-8c96b1fda416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:44.428645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d8c8e025-b7cc-4a0c-b030-8c96b1fda416 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:44.428645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:44.428645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:44.428645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:44.428645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:44.428645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:44.428645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:44.428645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:44.428645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:44.428645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:44.428645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:44.428645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:44.428645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:44.428645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:44.428645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:44.428645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:44.429620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:44.429620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:44.429620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:44.429620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:44.429620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:44.429620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:44.429620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:44.429620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:44.429620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:44.429620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:44.429620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:44.429620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:44.429620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:44.429620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:44.429620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:44.429620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:44.430502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:44.430502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:44.430502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:44.430502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:44.430502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:44.430502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:44.430502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:44.430502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:44.430502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:44.430502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:44.430502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:44.430502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:44.440902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 275/552] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:44.442055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8e025-b7cc-4a0c-b030-8c96b1fda416 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:44.516586 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f13722-7fc6-4e69-9489-53b225db986c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:44.550324 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:44.555336 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:44.563451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c89ad-d210-44ef-93cb-7601907160e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:44.564723 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c89ad-d210-44ef-93cb-7601907160e3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:44.565892 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c89ad-d210-44ef-93cb-7601907160e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:44.566179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c89ad-d210-44ef-93cb-7601907160e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:44.597033 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8e025-b7cc-4a0c-b030-8c96b1fda416 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:44.632831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933b683-f134-44de-9563-016f6618704e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:44.633505 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933b683-f134-44de-9563-016f6618704e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:44.633788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933b683-f134-44de-9563-016f6618704e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:44.634067 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933b683-f134-44de-9563-016f6618704e None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:44.634812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933b683-f134-44de-9563-016f6618704e None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:44.635118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933b683-f134-44de-9563-016f6618704e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:44.636523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933b683-f134-44de-9563-016f6618704e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:44.645574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 276/553] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:55:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:44.646846 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db208dad-ad73-4315-9136-0521ee193d9d None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:44.647188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db208dad-ad73-4315-9136-0521ee193d9d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:44.647472 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db208dad-ad73-4315-9136-0521ee193d9d None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:44.653024 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 277/554] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:44.654298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b6868-34a0-49eb-a81b-c650a8b10658 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:44.654585 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b6868-34a0-49eb-a81b-c650a8b10658 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:44.654913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b6868-34a0-49eb-a81b-c650a8b10658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:44.657557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c89ad-d210-44ef-93cb-7601907160e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:44.659029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c89ad-d210-44ef-93cb-7601907160e3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:44.672416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7a0b6868-34a0-49eb-a81b-c650a8b10658 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:44.674110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7a0b6868-34a0-49eb-a81b-c650a8b10658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:44.752223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 278/555] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:44.753118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b6868-34a0-49eb-a81b-c650a8b10658 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:44.788087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 278/556] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:44.788908 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c89ad-d210-44ef-93cb-7601907160e3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:44.826705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:44.830975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:44.887762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b6868-34a0-49eb-a81b-c650a8b10658 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:44.920930 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c89ad-d210-44ef-93cb-7601907160e3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:44.933043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1010128-0116-4bf0-904e-be07a26697e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:44.933963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1010128-0116-4bf0-904e-be07a26697e7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:44.934350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1010128-0116-4bf0-904e-be07a26697e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:44.934730 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1010128-0116-4bf0-904e-be07a26697e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:44.948554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1010128-0116-4bf0-904e-be07a26697e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:44.950613 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1010128-0116-4bf0-904e-be07a26697e7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:44.961080 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945478a-1227-4fff-b9cf-e01759820dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:44.962183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945478a-1227-4fff-b9cf-e01759820dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:44.962644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945478a-1227-4fff-b9cf-e01759820dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:44.963095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945478a-1227-4fff-b9cf-e01759820dc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:44.973014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-a1010128-0116-4bf0-904e-be07a26697e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:44.973014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:44.973014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:44.973014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:44.973014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:44.973014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:44.973014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:44.973014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:44.973014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:44.973014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:44.973014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:44.973014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:44.973014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:44.973014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:44.973014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:44.973880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:44.973880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:44.973880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:44.973880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:44.973880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:44.973880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:44.973880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:44.973880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:44.973880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:44.973880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:44.973880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:44.973880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:44.973880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:44.973880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:44.973880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:44.973880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:44.973880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:44.974727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:44.974727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:44.974727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:44.974727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:44.978812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 279/557] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:44.979792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1010128-0116-4bf0-904e-be07a26697e7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:44.980019 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945478a-1227-4fff-b9cf-e01759820dc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:44.989396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-4945478a-1227-4fff-b9cf-e01759820dc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:44.989396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:44.989396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:44.989396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:44.989396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:44.989396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:44.989396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:44.989396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:44.989396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:44.989396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:44.989396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:44.989396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:44.989396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:44.989396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:44.989396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:44.989396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:44.990783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:44.990783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:44.990783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:44.990783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:44.990783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:44.990783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:44.990783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:44.990783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:44.990783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:44.990783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:44.990783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:44.990783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:44.990783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:44.990783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:44.990783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:44.990783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:44.991576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:44.991576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:44.991576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:44.991576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:44.991576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:44.991576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:44.991576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:44.991576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:44.991576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:44.991576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:44.991576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:44.991576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:44.998864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 279/558] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:45.000098 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945478a-1227-4fff-b9cf-e01759820dc7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:45.088414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1010128-0116-4bf0-904e-be07a26697e7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:45.090053 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:45.099362 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:45.109470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945478a-1227-4fff-b9cf-e01759820dc7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:45.130640 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ed3cd-276a-4680-9df8-66616197c08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:45.131449 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ed3cd-276a-4680-9df8-66616197c08e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:45.131732 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ed3cd-276a-4680-9df8-66616197c08e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:45.132037 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ed3cd-276a-4680-9df8-66616197c08e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:45.143100 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ed3cd-276a-4680-9df8-66616197c08e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:45.143397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59a59e-015c-4117-8e64-e96c548128f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:45.144092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59a59e-015c-4117-8e64-e96c548128f8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:45.144380 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59a59e-015c-4117-8e64-e96c548128f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:45.144635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ed3cd-276a-4680-9df8-66616197c08e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:45.144731 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59a59e-015c-4117-8e64-e96c548128f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:45.145375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59a59e-015c-4117-8e64-e96c548128f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:45.145686 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59a59e-015c-4117-8e64-e96c548128f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:45.147257 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59a59e-015c-4117-8e64-e96c548128f8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:45.164212 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 280/559] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:45.164212 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59a59e-015c-4117-8e64-e96c548128f8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:45.164439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-282ed3cd-276a-4680-9df8-66616197c08e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:45.164439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:45.164439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:45.164439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:45.164439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:45.164439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:45.164439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:45.164439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:45.164439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:45.164439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:45.164439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:45.164439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:45.164439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:45.164439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:45.164439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:45.165318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:45.165318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:45.165318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:45.165318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:45.165318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:45.165318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:45.165318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:45.165318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:45.165318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:45.165318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:45.165318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:45.165318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:45.165318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:45.165318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:45.165318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:45.165318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:45.165318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:45.166170 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:45.166170 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:45.166170 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:45.166170 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:45.168074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 280/560] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:45.169890 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bb718-a0a6-49fe-970e-d81e356e4611 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:45.171562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bb718-a0a6-49fe-970e-d81e356e4611 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:45.171855 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bb718-a0a6-49fe-970e-d81e356e4611 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:45.173371 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 281/561] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:45.173919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bb718-a0a6-49fe-970e-d81e356e4611 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:45.280839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59a59e-015c-4117-8e64-e96c548128f8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:45.281795 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bb718-a0a6-49fe-970e-d81e356e4611 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:45.317439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39914c6c-ce05-4846-818a-d7beab8baab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:45.317957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb239df-a922-40d1-8db3-8b05c70b3dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:45.318150 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39914c6c-ce05-4846-818a-d7beab8baab8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:45.318381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39914c6c-ce05-4846-818a-d7beab8baab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:45.318654 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39914c6c-ce05-4846-818a-d7beab8baab8 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:45.318763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb239df-a922-40d1-8db3-8b05c70b3dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:45.319015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb239df-a922-40d1-8db3-8b05c70b3dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:45.319318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb239df-a922-40d1-8db3-8b05c70b3dc8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:45.319413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39914c6c-ce05-4846-818a-d7beab8baab8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:45.319692 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39914c6c-ce05-4846-818a-d7beab8baab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:45.321072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39914c6c-ce05-4846-818a-d7beab8baab8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:45.327602 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb239df-a922-40d1-8db3-8b05c70b3dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:45.329068 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb239df-a922-40d1-8db3-8b05c70b3dc8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:45.330026 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 281/562] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:55:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:45.330960 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39914c6c-ce05-4846-818a-d7beab8baab8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:45.348550 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:45.350913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-3cb239df-a922-40d1-8db3-8b05c70b3dc8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:55:45.350913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:45.350913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:45.350913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:45.350913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:45.350913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:45.350913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:45.350913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:45.350913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:45.350913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:45.350913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:45.350913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:45.350913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:45.350913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:45.350913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:45.350913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:45.352069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:45.353895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:45.353895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:45.353895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:45.353895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:45.353895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:45.353895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:45.353895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:45.353895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:45.353895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:55:45.353895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:45.353895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 282/563] 10.222.0.73 () {56 vars in 1093 bytes} [Thu May 19 11:55:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:45.353895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fafd35-e2b7-4622-a2b2-8f92a030cdfa None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:45.353895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fafd35-e2b7-4622-a2b2-8f92a030cdfa None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:45.354620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fafd35-e2b7-4622-a2b2-8f92a030cdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:45.370906 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-12fafd35-e2b7-4622-a2b2-8f92a030cdfa None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:45.372143 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-12fafd35-e2b7-4622-a2b2-8f92a030cdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:45.382713 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:45.445936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 283/564] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:45.446868 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fafd35-e2b7-4622-a2b2-8f92a030cdfa None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:45.461992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39914c6c-ce05-4846-818a-d7beab8baab8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:45.498641 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90052352-e251-41a4-9408-4ae60fa2502e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:45.499489 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90052352-e251-41a4-9408-4ae60fa2502e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:45.499624 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90052352-e251-41a4-9408-4ae60fa2502e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:45.499846 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90052352-e251-41a4-9408-4ae60fa2502e None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:45.500598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90052352-e251-41a4-9408-4ae60fa2502e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:45.500902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90052352-e251-41a4-9408-4ae60fa2502e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:45.502826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90052352-e251-41a4-9408-4ae60fa2502e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:45.520926 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 282/565] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:45.522834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90052352-e251-41a4-9408-4ae60fa2502e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:45.560705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fafd35-e2b7-4622-a2b2-8f92a030cdfa None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:45.596994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea398d-7342-4395-98c9-e275b519bc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:45.598087 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea398d-7342-4395-98c9-e275b519bc54 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:45.598722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea398d-7342-4395-98c9-e275b519bc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:45.598722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea398d-7342-4395-98c9-e275b519bc54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:45.606756 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:45.610169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea398d-7342-4395-98c9-e275b519bc54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:45.612363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea398d-7342-4395-98c9-e275b519bc54 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:45.615197 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:45.631593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-94ea398d-7342-4395-98c9-e275b519bc54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:45.631593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:45.631593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:45.631593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:45.631593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:45.631593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:45.631593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:45.631593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:45.631593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:45.631593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:45.631593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:45.631593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:45.631593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:45.631593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:45.631593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:45.632528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:45.632528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:45.632528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:45.632528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:45.632528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:45.632528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:45.632528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:45.632528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:45.632528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:45.632528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:45.632528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:45.632528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:45.632528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:45.632528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:45.632528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:45.632528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:45.632528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:45.633399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:45.633399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:45.633399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:45.633399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:45.633399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 284/566] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:45.633676 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea398d-7342-4395-98c9-e275b519bc54 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:45.641479 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90052352-e251-41a4-9408-4ae60fa2502e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:45.678866 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c2484-039c-4db4-9211-608f8ac44d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:45.679636 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c2484-039c-4db4-9211-608f8ac44d1f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:45.680020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c2484-039c-4db4-9211-608f8ac44d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:45.680307 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c2484-039c-4db4-9211-608f8ac44d1f None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:45.681146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c2484-039c-4db4-9211-608f8ac44d1f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:45.681607 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c2484-039c-4db4-9211-608f8ac44d1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:45.682942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c2484-039c-4db4-9211-608f8ac44d1f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:45.701126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 283/567] 10.222.0.73 () {56 vars in 1133 bytes} [Thu May 19 11:55:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:45.701943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c2484-039c-4db4-9211-608f8ac44d1f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:45.740885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea398d-7342-4395-98c9-e275b519bc54 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:45.774592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe2040-8de5-4aa7-ad35-5eeba53a2047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:45.775380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe2040-8de5-4aa7-ad35-5eeba53a2047 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:45.775663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe2040-8de5-4aa7-ad35-5eeba53a2047 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:45.775963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe2040-8de5-4aa7-ad35-5eeba53a2047 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:45.786274 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe2040-8de5-4aa7-ad35-5eeba53a2047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:45.793951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7ebe2040-8de5-4aa7-ad35-5eeba53a2047 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:45.793951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:45.793951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:45.793951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:45.793951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:45.793951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:45.793951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:45.793951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:45.793951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:45.793951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:45.793951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:45.793951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:45.793951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:45.793951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:45.793951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:45.793951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:45.794900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:45.794900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:45.794900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:45.794900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:45.794900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:45.794900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:45.794900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:45.794900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:45.794900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:45.794900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:45.794900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:45.794900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:45.794900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:45.794900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:45.794900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:45.794900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:45.796302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:45.796302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:45.796302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:45.796302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:45.796302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:45.796302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:45.796302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:45.796302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:45.796302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:45.796302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:45.796302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:45.796302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:45.796302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 285/568] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:45.796302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe2040-8de5-4aa7-ad35-5eeba53a2047 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:45.805740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c2484-039c-4db4-9211-608f8ac44d1f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:45.836143 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:45.841354 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a4e06-758f-4e63-9d7c-af9f5adf1574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:45.842141 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a4e06-758f-4e63-9d7c-af9f5adf1574 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:45.842423 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a4e06-758f-4e63-9d7c-af9f5adf1574 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:45.842705 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a4e06-758f-4e63-9d7c-af9f5adf1574 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:45.849554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a4e06-758f-4e63-9d7c-af9f5adf1574 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:45.850932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a4e06-758f-4e63-9d7c-af9f5adf1574 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:45.851771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:45.864923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-182a4e06-758f-4e63-9d7c-af9f5adf1574 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:45.864923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:45.864923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:45.864923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:45.864923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:45.864923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:45.864923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:45.864923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:45.864923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:45.864923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:45.864923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:45.864923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:45.864923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:45.864923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:45.864923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:45.865989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:45.865989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:45.865989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:45.865989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:45.865989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:45.865989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:45.865989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:45.865989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:45.865989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:45.865989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:45.865989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:45.865989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:45.865989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:45.865989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:45.865989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:45.865989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:45.865989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:45.866922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:45.866922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:45.866922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:45.866922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:45.866922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:45.866922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:45.866922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:45.866922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:45.866922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 284/569] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:45.867429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dab49f-222f-40e5-94c9-c75401697d23 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:45.867717 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dab49f-222f-40e5-94c9-c75401697d23 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:45.868061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dab49f-222f-40e5-94c9-c75401697d23 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:45.869461 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 285/570] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:45.869997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dab49f-222f-40e5-94c9-c75401697d23 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:45.904447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe2040-8de5-4aa7-ad35-5eeba53a2047 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:45.937654 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bb941-74c7-49e9-b3e1-43558513d7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:45.938321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb941-74c7-49e9-b3e1-43558513d7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:45.938633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb941-74c7-49e9-b3e1-43558513d7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:45.939451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb941-74c7-49e9-b3e1-43558513d7e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:45.940205 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bb941-74c7-49e9-b3e1-43558513d7e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:45.940524 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bb941-74c7-49e9-b3e1-43558513d7e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:45.941903 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bb941-74c7-49e9-b3e1-43558513d7e2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:45.953328 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 286/571] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:45.954110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bb941-74c7-49e9-b3e1-43558513d7e2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:45.970339 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dab49f-222f-40e5-94c9-c75401697d23 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:46.004101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de2839-dd48-4936-bcb2-6e4c55ffe8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:46.004881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de2839-dd48-4936-bcb2-6e4c55ffe8bd None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:46.005158 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de2839-dd48-4936-bcb2-6e4c55ffe8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:46.005427 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de2839-dd48-4936-bcb2-6e4c55ffe8bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:46.015765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de2839-dd48-4936-bcb2-6e4c55ffe8bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:46.017368 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de2839-dd48-4936-bcb2-6e4c55ffe8bd None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:46.033728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b0de2839-dd48-4936-bcb2-6e4c55ffe8bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:46.033728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:46.033728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:46.033728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:46.033728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:46.033728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:46.033728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:46.033728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:46.033728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:46.033728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:46.033728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:46.033728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:46.033728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:46.033728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:46.033728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:46.034589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:46.034589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:46.034589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:46.034589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:46.034589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:46.034589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:46.034589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:46.034589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:46.034589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:46.034589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:46.034589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:46.034589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:46.034589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:46.034589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:46.034589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:46.034589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:46.034589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:46.035456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:46.035456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:46.035456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:46.035456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:46.035456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 286/572] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:46.035728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de2839-dd48-4936-bcb2-6e4c55ffe8bd None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:46.057350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bb941-74c7-49e9-b3e1-43558513d7e2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:46.073972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:46.083821 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:46.091675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce86aee-5098-4a62-9a0b-5379dc7b8347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:46.092364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce86aee-5098-4a62-9a0b-5379dc7b8347 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:46.092653 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce86aee-5098-4a62-9a0b-5379dc7b8347 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:46.092931 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce86aee-5098-4a62-9a0b-5379dc7b8347 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:46.093671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce86aee-5098-4a62-9a0b-5379dc7b8347 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:46.093979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce86aee-5098-4a62-9a0b-5379dc7b8347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:46.095514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce86aee-5098-4a62-9a0b-5379dc7b8347 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:46.103733 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 287/573] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:55:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:46.105069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bd6e7-de54-4f9a-bfc6-e8dccf5b63d6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:46.105359 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bd6e7-de54-4f9a-bfc6-e8dccf5b63d6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:46.105630 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bd6e7-de54-4f9a-bfc6-e8dccf5b63d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:46.122524 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-cb8bd6e7-de54-4f9a-bfc6-e8dccf5b63d6 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:46.123710 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cb8bd6e7-de54-4f9a-bfc6-e8dccf5b63d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:46.139696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de2839-dd48-4936-bcb2-6e4c55ffe8bd None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:46.172197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa3cb7-4558-4f5c-9922-6e41843d49da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:46.172858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa3cb7-4558-4f5c-9922-6e41843d49da None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:46.173652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa3cb7-4558-4f5c-9922-6e41843d49da None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:46.173930 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa3cb7-4558-4f5c-9922-6e41843d49da None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:46.174720 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa3cb7-4558-4f5c-9922-6e41843d49da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:46.175050 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa3cb7-4558-4f5c-9922-6e41843d49da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:46.176503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa3cb7-4558-4f5c-9922-6e41843d49da None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:46.188400 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 287/574] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:55:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:46.189751 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa3cb7-4558-4f5c-9922-6e41843d49da None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:46.192158 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 288/575] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:46.192889 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bd6e7-de54-4f9a-bfc6-e8dccf5b63d6 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:46.290376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa3cb7-4558-4f5c-9922-6e41843d49da None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:46.295447 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:46.296248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bd6e7-de54-4f9a-bfc6-e8dccf5b63d6 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:46.306523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:46.331847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7157e-6fce-4a09-9740-a607bcb1a99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:46.332046 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3c2fd-7a05-48a3-b394-086ccaccb1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:46.332549 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7157e-6fce-4a09-9740-a607bcb1a99c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:46.332673 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3c2fd-7a05-48a3-b394-086ccaccb1af None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:46.332834 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7157e-6fce-4a09-9740-a607bcb1a99c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:46.333024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3c2fd-7a05-48a3-b394-086ccaccb1af None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:46.333116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7157e-6fce-4a09-9740-a607bcb1a99c None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:46.333355 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3c2fd-7a05-48a3-b394-086ccaccb1af None admin] PATH_INFO: `/v3/users/glance` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:46.333819 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7157e-6fce-4a09-9740-a607bcb1a99c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:46.334127 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7157e-6fce-4a09-9740-a607bcb1a99c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:46.335472 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7157e-6fce-4a09-9740-a607bcb1a99c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:46.340544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3c2fd-7a05-48a3-b394-086ccaccb1af None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:46.341953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3c2fd-7a05-48a3-b394-086ccaccb1af None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:46.347304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 289/576] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:46.348132 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7157e-6fce-4a09-9740-a607bcb1a99c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:46.360117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f5d3c2fd-7a05-48a3-b394-086ccaccb1af None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 11:55:46.360117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:46.360117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:46.360117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:46.360117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:46.360117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:46.360117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:46.360117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:46.360117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:46.360117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:46.360117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:46.360117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:46.360117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:46.360117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:46.360117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:46.360117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:46.361662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:46.362578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:46.362578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:46.362578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:46.362578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:46.362578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:46.362578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:46.362578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:46.362578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:46.362578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 11:55:46.362578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:46.362578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 288/577] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:46.363152 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3c2fd-7a05-48a3-b394-086ccaccb1af None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:46.452550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7157e-6fce-4a09-9740-a607bcb1a99c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:46.459147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3c2fd-7a05-48a3-b394-086ccaccb1af None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:46.486398 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889be9e-f9c2-4b72-b618-583ca109180d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:46.487179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889be9e-f9c2-4b72-b618-583ca109180d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:46.487462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889be9e-f9c2-4b72-b618-583ca109180d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:46.487733 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889be9e-f9c2-4b72-b618-583ca109180d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:46.493155 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2476f-6122-4220-902d-472d748ad9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:46.493797 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2476f-6122-4220-902d-472d748ad9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:46.494080 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2476f-6122-4220-902d-472d748ad9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:46.494354 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2476f-6122-4220-902d-472d748ad9c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:46.495182 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2476f-6122-4220-902d-472d748ad9c0 None admin] RBAC: Adding query filter params (role.id=d21329f1cd364fba8b79529896e00f81, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=371dae58e95d403b97e311c6616adab5) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:46.495489 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2476f-6122-4220-902d-472d748ad9c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:46.496948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2476f-6122-4220-902d-472d748ad9c0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:46.498133 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889be9e-f9c2-4b72-b618-583ca109180d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:46.499571 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889be9e-f9c2-4b72-b618-583ca109180d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:46.502276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 289/578] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:55:46 2022] GET /identity/v3/role_assignments?user.id=371dae58e95d403b97e311c6616adab5&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=d21329f1cd364fba8b79529896e00f81 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:46.503043 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2476f-6122-4220-902d-472d748ad9c0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:46.516936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-5889be9e-f9c2-4b72-b618-583ca109180d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:46.516936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:46.516936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:46.516936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:46.516936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:46.516936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:46.516936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:46.516936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:46.516936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:46.516936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:46.516936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:46.516936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:46.516936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:46.516936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:46.516936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:46.517909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:46.517909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:46.517909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:46.517909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:46.517909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:46.517909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:46.517909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:46.517909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:46.517909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:46.517909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:46.517909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:46.517909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:46.517909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:46.517909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:46.517909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:46.517909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:46.517909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:46.518775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:46.518775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:46.518775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:46.518775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:46.520286 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 290/579] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:46.521458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889be9e-f9c2-4b72-b618-583ca109180d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:46.549315 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:46.550320 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:46.635332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2476f-6122-4220-902d-472d748ad9c0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:46.642648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889be9e-f9c2-4b72-b618-583ca109180d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:46.674801 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64549de-1de0-49db-917f-09903fe06bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:46.675603 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64549de-1de0-49db-917f-09903fe06bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:46.675904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64549de-1de0-49db-917f-09903fe06bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:46.676188 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64549de-1de0-49db-917f-09903fe06bb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:46.679127 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0f3bc-b958-4536-b247-c3112258b273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:46.679947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0f3bc-b958-4536-b247-c3112258b273 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:46.680230 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0f3bc-b958-4536-b247-c3112258b273 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:46.680507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0f3bc-b958-4536-b247-c3112258b273 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:46.687486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0f3bc-b958-4536-b247-c3112258b273 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:46.688476 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64549de-1de0-49db-917f-09903fe06bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:46.689010 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0f3bc-b958-4536-b247-c3112258b273 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:46.699315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f64549de-1de0-49db-917f-09903fe06bb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:46.699315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:46.699315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:46.699315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:46.699315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:46.699315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:46.699315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:46.699315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:46.699315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:46.699315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:46.699315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:46.699315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:46.699315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:46.699315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:46.699315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:46.699315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:46.700294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:46.700294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:46.700294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:46.700294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:46.700294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:46.700294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:46.700294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:46.700294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:46.700294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:46.700294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:46.700294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:46.700294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:46.700294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:46.700294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:46.700294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:46.700294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:46.701181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:46.701181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:46.701181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:46.701181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:46.701181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:46.701181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:46.701181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:46.701181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:46.701181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:46.701181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:46.701181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:46.701181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:46.701181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 290/580] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:46.701181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64549de-1de0-49db-917f-09903fe06bb3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:46.704882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b0f0f3bc-b958-4536-b247-c3112258b273 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:46.704882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:46.704882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:46.704882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:46.704882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:46.704882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:46.704882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:46.704882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:46.704882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:46.704882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:46.704882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:46.704882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:46.704882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:46.704882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:46.704882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:46.705745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:46.705745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:46.705745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:46.705745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:46.705745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:46.705745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:46.705745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:46.705745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:46.705745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:46.705745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:46.705745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:46.705745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:46.705745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:46.705745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:46.705745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:46.705745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:46.705745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:46.706619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:46.706619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:46.706619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:46.706619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:46.706619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:46.706619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:46.706619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:46.706619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:46.706619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 291/581] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:46.707088 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0f3bc-b958-4536-b247-c3112258b273 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:46.792958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:46.793760 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:46.806921 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64549de-1de0-49db-917f-09903fe06bb3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:46.815625 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0f3bc-b958-4536-b247-c3112258b273 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:46.843618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20331c4-4fbb-457f-88bb-be64cbf9c1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:46.844320 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20331c4-4fbb-457f-88bb-be64cbf9c1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:46.844605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20331c4-4fbb-457f-88bb-be64cbf9c1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:46.844926 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20331c4-4fbb-457f-88bb-be64cbf9c1f1 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:46.846334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20331c4-4fbb-457f-88bb-be64cbf9c1f1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:46.846747 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20331c4-4fbb-457f-88bb-be64cbf9c1f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:46.848102 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20331c4-4fbb-457f-88bb-be64cbf9c1f1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:46.852440 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51395848-ace2-409f-86a4-f9c630ee754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:46.853102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51395848-ace2-409f-86a4-f9c630ee754e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:46.853385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51395848-ace2-409f-86a4-f9c630ee754e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:46.853662 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51395848-ace2-409f-86a4-f9c630ee754e None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:46.854381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51395848-ace2-409f-86a4-f9c630ee754e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:46.854687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51395848-ace2-409f-86a4-f9c630ee754e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:46.856062 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51395848-ace2-409f-86a4-f9c630ee754e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:46.869970 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 291/582] 10.222.0.73 () {56 vars in 1137 bytes} [Thu May 19 11:55:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:46.869970 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20331c4-4fbb-457f-88bb-be64cbf9c1f1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:46.876683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 292/583] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:46.876683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51395848-ace2-409f-86a4-f9c630ee754e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:46.975608 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20331c4-4fbb-457f-88bb-be64cbf9c1f1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:46.978086 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51395848-ace2-409f-86a4-f9c630ee754e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:47.010482 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bdc8d-35f2-452e-8435-005f8022faad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:47.011149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bdc8d-35f2-452e-8435-005f8022faad None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:47.011434 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bdc8d-35f2-452e-8435-005f8022faad None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:47.011703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bdc8d-35f2-452e-8435-005f8022faad None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:47.012487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bdc8d-35f2-452e-8435-005f8022faad None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:47.012795 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bdc8d-35f2-452e-8435-005f8022faad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:47.012907 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d0636-844b-42f2-a993-1eb9d7daf228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:47.013512 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d0636-844b-42f2-a993-1eb9d7daf228 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:47.013823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d0636-844b-42f2-a993-1eb9d7daf228 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:47.014084 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d0636-844b-42f2-a993-1eb9d7daf228 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:47.014179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bdc8d-35f2-452e-8435-005f8022faad None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:47.014870 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d0636-844b-42f2-a993-1eb9d7daf228 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:47.015186 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d0636-844b-42f2-a993-1eb9d7daf228 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:47.016640 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d0636-844b-42f2-a993-1eb9d7daf228 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:47.027550 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 292/584] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:55:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:47.027550 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bdc8d-35f2-452e-8435-005f8022faad None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:47.030242 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:47.038178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:47.040228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 293/585] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:55:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:47.041797 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d0636-844b-42f2-a993-1eb9d7daf228 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:47.133248 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bdc8d-35f2-452e-8435-005f8022faad None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:47.144607 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d0636-844b-42f2-a993-1eb9d7daf228 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:47.177326 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3688e4c-1547-4ac9-a52f-dc972f4bdf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:47.178403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3688e4c-1547-4ac9-a52f-dc972f4bdf59 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:47.179034 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3688e4c-1547-4ac9-a52f-dc972f4bdf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:47.179464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3688e4c-1547-4ac9-a52f-dc972f4bdf59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:47.179965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2bdea-fff3-4982-abaa-8c9731f8cc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:47.180770 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2bdea-fff3-4982-abaa-8c9731f8cc5c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:47.181057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2bdea-fff3-4982-abaa-8c9731f8cc5c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:47.181834 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2bdea-fff3-4982-abaa-8c9731f8cc5c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:47.189146 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2bdea-fff3-4982-abaa-8c9731f8cc5c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:47.190577 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2bdea-fff3-4982-abaa-8c9731f8cc5c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:47.195988 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3688e4c-1547-4ac9-a52f-dc972f4bdf59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:47.197693 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3688e4c-1547-4ac9-a52f-dc972f4bdf59 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:47.206043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b8f2bdea-fff3-4982-abaa-8c9731f8cc5c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:55:47.206043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:47.206043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:47.206043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:47.206043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:47.206043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:47.206043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:47.206043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:47.206043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:47.206043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:47.206043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:47.206043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:47.206043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:47.206043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:47.206043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:47.206043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:47.206997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:47.207948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:47.207948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:47.207948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:47.207948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:47.207948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:47.207948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:47.207948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:47.207948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:47.207948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:55:47.207948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:47.207948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 294/586] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:47.208557 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2bdea-fff3-4982-abaa-8c9731f8cc5c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:47.221149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f3688e4c-1547-4ac9-a52f-dc972f4bdf59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:47.221149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:47.221149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:47.221149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:47.221149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:47.221149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:47.221149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:47.221149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:47.221149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:47.221149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:47.221149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:47.221149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:47.221149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:47.221149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:47.221149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:47.222042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:47.222042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:47.222042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:47.222042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:47.222042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:47.222042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:47.222042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:47.222042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:47.222042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:47.222042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:47.222042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:47.222042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:47.222042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:47.222042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:47.222042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:47.222042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:47.222042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:47.222902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:47.222902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:47.222902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:47.222902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:47.222902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 293/587] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:47.223177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3688e4c-1547-4ac9-a52f-dc972f4bdf59 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:47.278528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:47.288088 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:47.324161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2bdea-fff3-4982-abaa-8c9731f8cc5c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:47.336128 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3688e4c-1547-4ac9-a52f-dc972f4bdf59 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:47.359043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3241cf3-23ca-428c-918d-97fca8e91aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:47.359840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3241cf3-23ca-428c-918d-97fca8e91aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:47.360152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3241cf3-23ca-428c-918d-97fca8e91aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:47.361048 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3241cf3-23ca-428c-918d-97fca8e91aa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:47.377155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3241cf3-23ca-428c-918d-97fca8e91aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:47.378116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3241cf3-23ca-428c-918d-97fca8e91aa6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:47.380706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d57695-e82e-4894-b260-51eb0e440997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:47.381594 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d57695-e82e-4894-b260-51eb0e440997 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:47.381873 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d57695-e82e-4894-b260-51eb0e440997 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:47.382142 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d57695-e82e-4894-b260-51eb0e440997 None admin] PATH_INFO: `/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/bd0c1f0710f3447d94e67048a508781e/roles/d21329f1cd364fba8b79529896e00f81` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:47.397390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-a3241cf3-23ca-428c-918d-97fca8e91aa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:47.397390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:47.397390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:47.397390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:47.397390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:47.397390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:47.397390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:47.397390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:47.397390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:47.397390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:47.397390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:47.397390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:47.397390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:47.397390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:47.397390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:47.398251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:47.398251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:47.398251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:47.398251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:47.398251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:47.398251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:47.398251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:47.398251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:47.398251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:47.398251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:47.398251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:47.398251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:47.398251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:47.398251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:47.398251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:47.398251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:47.398251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:47.399203 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:47.399203 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:47.399203 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:47.399203 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:47.399416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d57695-e82e-4894-b260-51eb0e440997 None admin] RBAC: Authorizing `identity:create_grant(project_id=d90551d9446e4f2cbd14312d2af9f7c9, user_id=bd0c1f0710f3447d94e67048a508781e, role_id=d21329f1cd364fba8b79529896e00f81)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:47.399416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d57695-e82e-4894-b260-51eb0e440997 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:47.403252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 295/588] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:47.403995 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3241cf3-23ca-428c-918d-97fca8e91aa6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:47.423945 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 294/589] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:55:47 2022] PUT /identity/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/bd0c1f0710f3447d94e67048a508781e/roles/d21329f1cd364fba8b79529896e00f81 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:55:47.423945 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d57695-e82e-4894-b260-51eb0e440997 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:47.563751 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d57695-e82e-4894-b260-51eb0e440997 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:47.564925 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3241cf3-23ca-428c-918d-97fca8e91aa6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:47.578674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:47.587150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:47.620729 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d460d1-0059-4c8f-a39c-2841388cc375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:47.621895 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d460d1-0059-4c8f-a39c-2841388cc375 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:47.622178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d460d1-0059-4c8f-a39c-2841388cc375 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:47.622451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d460d1-0059-4c8f-a39c-2841388cc375 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:47.623203 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d460d1-0059-4c8f-a39c-2841388cc375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:47.623535 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d460d1-0059-4c8f-a39c-2841388cc375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:47.624999 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d460d1-0059-4c8f-a39c-2841388cc375 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:47.625884 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd523f-ba86-4425-bb47-b777e2f88bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:47.627489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd523f-ba86-4425-bb47-b777e2f88bec None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:47.627878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd523f-ba86-4425-bb47-b777e2f88bec None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:47.628186 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd523f-ba86-4425-bb47-b777e2f88bec None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:47.629070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd523f-ba86-4425-bb47-b777e2f88bec None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:47.629365 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd523f-ba86-4425-bb47-b777e2f88bec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:47.630851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd523f-ba86-4425-bb47-b777e2f88bec None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:47.643555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 295/590] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:47.651941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d460d1-0059-4c8f-a39c-2841388cc375 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:47.659638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 296/591] 10.222.0.73 () {56 vars in 1137 bytes} [Thu May 19 11:55:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:47.660800 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd523f-ba86-4425-bb47-b777e2f88bec None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:47.766794 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d460d1-0059-4c8f-a39c-2841388cc375 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:47.790536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd523f-ba86-4425-bb47-b777e2f88bec None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:47.810878 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d0564-2b9d-4642-9b9e-32833966497c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:47.811554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d0564-2b9d-4642-9b9e-32833966497c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:47.811840 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d0564-2b9d-4642-9b9e-32833966497c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:47.812293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d0564-2b9d-4642-9b9e-32833966497c None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:47.813321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d0564-2b9d-4642-9b9e-32833966497c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:47.813665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d0564-2b9d-4642-9b9e-32833966497c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:47.815101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d0564-2b9d-4642-9b9e-32833966497c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:47.832003 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 296/592] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:47.832868 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d0564-2b9d-4642-9b9e-32833966497c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:47.837655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dca0b-ee29-4319-8d27-d37538e6fb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:47.838563 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dca0b-ee29-4319-8d27-d37538e6fb2b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:47.838853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dca0b-ee29-4319-8d27-d37538e6fb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:47.839135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dca0b-ee29-4319-8d27-d37538e6fb2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:47.847451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dca0b-ee29-4319-8d27-d37538e6fb2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:47.848945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dca0b-ee29-4319-8d27-d37538e6fb2b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:47.864722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-110dca0b-ee29-4319-8d27-d37538e6fb2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:47.864722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:47.864722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:47.864722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:47.864722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:47.864722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:47.864722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:47.864722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:47.864722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:47.864722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:47.864722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:47.864722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:47.864722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:47.864722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:47.864722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:47.865582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:47.865582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:47.865582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:47.865582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:47.865582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:47.865582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:47.865582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:47.865582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:47.865582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:47.865582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:47.865582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:47.865582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:47.865582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:47.865582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:47.865582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:47.865582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:47.865582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:47.866421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:47.866421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:47.866421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:47.866421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:47.866421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:47.866421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:47.866421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:47.866421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:47.866421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 297/593] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:47.866887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:47.871935 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dca0b-ee29-4319-8d27-d37538e6fb2b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:47.901964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:47.943593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d0564-2b9d-4642-9b9e-32833966497c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:47.981385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b4d1b-fda7-488c-bf20-e5bcf90348d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:47.982189 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4d1b-fda7-488c-bf20-e5bcf90348d2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:47.982473 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4d1b-fda7-488c-bf20-e5bcf90348d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:47.982747 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4d1b-fda7-488c-bf20-e5bcf90348d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:47.983097 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dca0b-ee29-4319-8d27-d37538e6fb2b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:47.993346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b4d1b-fda7-488c-bf20-e5bcf90348d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:47.994957 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b4d1b-fda7-488c-bf20-e5bcf90348d2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:48.014037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-633b4d1b-fda7-488c-bf20-e5bcf90348d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:48.014037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:48.014037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:48.014037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:48.014037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:48.014037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:48.014037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:48.014037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:48.014037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:48.014037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:48.014037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:48.014037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:48.014037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:48.014037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:48.014037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:48.016053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:48.016053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:48.016053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:48.016053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:48.016053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:48.016053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:48.016053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:48.016053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:48.016053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:48.016053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:48.016053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:48.016053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:48.016053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:48.016053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:48.016053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:48.016053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:48.016053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:48.018709 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:48.018709 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:48.018709 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:48.018709 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:48.018709 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 297/594] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:48.018709 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b4d1b-fda7-488c-bf20-e5bcf90348d2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:48.023958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001ac97-fafe-4735-8a03-4010729c21aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:48.023958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001ac97-fafe-4735-8a03-4010729c21aa None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:48.023958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001ac97-fafe-4735-8a03-4010729c21aa None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:48.023958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001ac97-fafe-4735-8a03-4010729c21aa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:48.029961 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001ac97-fafe-4735-8a03-4010729c21aa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:48.031508 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001ac97-fafe-4735-8a03-4010729c21aa None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:48.047004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-9001ac97-fafe-4735-8a03-4010729c21aa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:55:48.047004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:48.047004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:48.047004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:48.047004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:48.047004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:48.047004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:48.047004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:48.047004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:48.047004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:48.047004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:48.047004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:48.047004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:48.047004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:48.047004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:48.047004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:48.048494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:48.049419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:48.049419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:48.049419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:48.049419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:48.049419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:48.049419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:48.049419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:48.049419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:48.049419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:55:48.049419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:48.053310 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 298/595] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:48.054434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001ac97-fafe-4735-8a03-4010729c21aa None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:48.111301 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:48.139273 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b4d1b-fda7-488c-bf20-e5bcf90348d2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:48.157455 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:48.169049 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001ac97-fafe-4735-8a03-4010729c21aa None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:48.193388 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2b0cd-6553-4263-9dc7-9172f7da6e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:48.194614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2b0cd-6553-4263-9dc7-9172f7da6e21 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:48.195523 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2b0cd-6553-4263-9dc7-9172f7da6e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:48.196168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2b0cd-6553-4263-9dc7-9172f7da6e21 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:48.197253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2b0cd-6553-4263-9dc7-9172f7da6e21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:48.197950 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2b0cd-6553-4263-9dc7-9172f7da6e21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:48.200279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2b0cd-6553-4263-9dc7-9172f7da6e21 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:48.209881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678618f-1dee-43d8-beee-c9c74833c036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:48.210911 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678618f-1dee-43d8-beee-c9c74833c036 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:48.211382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678618f-1dee-43d8-beee-c9c74833c036 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:48.211840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678618f-1dee-43d8-beee-c9c74833c036 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:48.212893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678618f-1dee-43d8-beee-c9c74833c036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:48.213380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678618f-1dee-43d8-beee-c9c74833c036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:48.214298 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 298/596] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:55:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:48.215219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678618f-1dee-43d8-beee-c9c74833c036 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:48.215327 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2b0cd-6553-4263-9dc7-9172f7da6e21 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:48.229512 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 299/597] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:48.230787 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678618f-1dee-43d8-beee-c9c74833c036 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:48.336243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2b0cd-6553-4263-9dc7-9172f7da6e21 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:48.349815 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678618f-1dee-43d8-beee-c9c74833c036 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:48.381006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bedf6-08a9-4cb6-87ec-ffd9cbd3d6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:48.382097 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bedf6-08a9-4cb6-87ec-ffd9cbd3d6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:48.382097 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bedf6-08a9-4cb6-87ec-ffd9cbd3d6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:48.382097 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bedf6-08a9-4cb6-87ec-ffd9cbd3d6f6 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:48.382949 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bedf6-08a9-4cb6-87ec-ffd9cbd3d6f6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:48.383259 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bedf6-08a9-4cb6-87ec-ffd9cbd3d6f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:48.384724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bedf6-08a9-4cb6-87ec-ffd9cbd3d6f6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:48.392919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d4b57-868d-4f9b-abc3-b0f4baed1948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:48.394059 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d4b57-868d-4f9b-abc3-b0f4baed1948 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:48.394347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d4b57-868d-4f9b-abc3-b0f4baed1948 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:48.394625 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d4b57-868d-4f9b-abc3-b0f4baed1948 None admin] PATH_INFO: `/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/182c7bb48c184e9983c02ae86709e803/roles/d21329f1cd364fba8b79529896e00f81` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:48.401610 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:48.406666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 299/598] 10.222.0.73 () {56 vars in 1139 bytes} [Thu May 19 11:55:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:48.407773 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bedf6-08a9-4cb6-87ec-ffd9cbd3d6f6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:48.418663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d4b57-868d-4f9b-abc3-b0f4baed1948 None admin] RBAC: Authorizing `identity:create_grant(project_id=d90551d9446e4f2cbd14312d2af9f7c9, user_id=182c7bb48c184e9983c02ae86709e803, role_id=d21329f1cd364fba8b79529896e00f81)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:48.420559 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d4b57-868d-4f9b-abc3-b0f4baed1948 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:48.432966 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:48.439711 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 300/599] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:55:48 2022] PUT /identity/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/182c7bb48c184e9983c02ae86709e803/roles/d21329f1cd364fba8b79529896e00f81 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:55:48.450248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d4b57-868d-4f9b-abc3-b0f4baed1948 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:48.601483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d4b57-868d-4f9b-abc3-b0f4baed1948 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:48.619302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bedf6-08a9-4cb6-87ec-ffd9cbd3d6f6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:48.643783 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c459f3f-62d6-4423-9e65-ae7636972a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:48.647944 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c459f3f-62d6-4423-9e65-ae7636972a1e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:48.647944 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c459f3f-62d6-4423-9e65-ae7636972a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:48.647944 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c459f3f-62d6-4423-9e65-ae7636972a1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:48.667957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c459f3f-62d6-4423-9e65-ae7636972a1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:48.667957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c459f3f-62d6-4423-9e65-ae7636972a1e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:48.684776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-8c459f3f-62d6-4423-9e65-ae7636972a1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:48.684776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:48.684776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:48.684776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:48.684776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:48.684776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:48.684776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:48.684776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:48.684776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:48.684776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:48.684776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:48.684776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:48.684776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:48.684776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:48.684776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:48.685720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:48.685720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:48.685720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:48.685720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:48.685720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:48.685720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:48.685720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:48.685720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:48.685720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:48.685720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:48.685720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:48.685720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:48.685720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:48.685720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:48.685720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:48.685720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:48.685720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:48.686611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:48.686611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:48.686611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:48.686611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:48.695953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 301/600] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:48.695953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c459f3f-62d6-4423-9e65-ae7636972a1e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:48.708758 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20832558-67e7-407b-ac41-710c7def1a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:48.710641 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20832558-67e7-407b-ac41-710c7def1a62 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:48.710928 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20832558-67e7-407b-ac41-710c7def1a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:48.711258 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20832558-67e7-407b-ac41-710c7def1a62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:48.730831 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20832558-67e7-407b-ac41-710c7def1a62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:48.732315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20832558-67e7-407b-ac41-710c7def1a62 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:48.758424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-20832558-67e7-407b-ac41-710c7def1a62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:48.758424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:48.758424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:48.758424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:48.758424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:48.758424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:48.758424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:48.758424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:48.758424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:48.758424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:48.758424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:48.758424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:48.758424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:48.758424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:48.758424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:48.759401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:48.759401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:48.759401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:48.759401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:48.759401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:48.759401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:48.759401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:48.759401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:48.759401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:48.759401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:48.759401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:48.759401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:48.759401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:48.759401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:48.759401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:48.759401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:48.759401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:48.760359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:48.760359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:48.760359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:48.760359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:48.760359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:48.760359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:48.760359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:48.760359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:48.760811 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:48.760897 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 300/601] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:48.770393 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20832558-67e7-407b-ac41-710c7def1a62 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:48.823958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c459f3f-62d6-4423-9e65-ae7636972a1e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:48.887942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:48.898612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7d55e-f326-4678-b0b2-392b49c3283e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:48.903940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7d55e-f326-4678-b0b2-392b49c3283e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:48.903940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7d55e-f326-4678-b0b2-392b49c3283e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:48.903940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7d55e-f326-4678-b0b2-392b49c3283e None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:48.903940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7d55e-f326-4678-b0b2-392b49c3283e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:48.903940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7d55e-f326-4678-b0b2-392b49c3283e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:48.903940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7d55e-f326-4678-b0b2-392b49c3283e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:48.926102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 302/602] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:48.939937 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7d55e-f326-4678-b0b2-392b49c3283e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:48.972032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20832558-67e7-407b-ac41-710c7def1a62 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:49.017865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f67313-5f0e-4e39-9125-dc8c1d87a6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:49.018954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f67313-5f0e-4e39-9125-dc8c1d87a6fc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:49.019245 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f67313-5f0e-4e39-9125-dc8c1d87a6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:49.019526 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f67313-5f0e-4e39-9125-dc8c1d87a6fc None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:49.021432 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f67313-5f0e-4e39-9125-dc8c1d87a6fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:49.021751 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f67313-5f0e-4e39-9125-dc8c1d87a6fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:49.023194 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f67313-5f0e-4e39-9125-dc8c1d87a6fc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:49.047674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 301/603] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:55:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:49.047674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fac903-3024-4516-9d87-2bd9db2a3d9f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:49.047674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fac903-3024-4516-9d87-2bd9db2a3d9f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:49.047674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fac903-3024-4516-9d87-2bd9db2a3d9f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:49.047674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 302/604] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:49.049227 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fac903-3024-4516-9d87-2bd9db2a3d9f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:49.159268 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7d55e-f326-4678-b0b2-392b49c3283e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:49.177536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:49.203926 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fc439-29a5-457a-8ee2-9f791ec81948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:49.205468 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fc439-29a5-457a-8ee2-9f791ec81948 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:49.205936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fc439-29a5-457a-8ee2-9f791ec81948 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:49.206374 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fc439-29a5-457a-8ee2-9f791ec81948 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:49.209013 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fac903-3024-4516-9d87-2bd9db2a3d9f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:49.213846 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fc439-29a5-457a-8ee2-9f791ec81948 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:49.215502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fc439-29a5-457a-8ee2-9f791ec81948 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:49.230458 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:49.232189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-f76fc439-29a5-457a-8ee2-9f791ec81948 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:49.232189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:49.232189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:49.232189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:49.232189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:49.232189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:49.232189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:49.232189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:49.232189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:49.232189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:49.232189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:49.232189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:49.232189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:49.232189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:49.232189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:49.234487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:49.234487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:49.234487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:49.234487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:49.234487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:49.234487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:49.234487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:49.234487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:49.234487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:49.234487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:49.234487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:49.234487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:49.234487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:49.234487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:49.234487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:49.234487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:49.234487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:49.235674 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:49.235674 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:49.235674 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:49.235674 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:49.235674 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:49.235674 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:49.235674 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:49.235674 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:49.241043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 303/605] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:49.243360 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf957e5b-8213-46c3-b327-274fff42d6a2 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:49.243816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf957e5b-8213-46c3-b327-274fff42d6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:49.244319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf957e5b-8213-46c3-b327-274fff42d6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:49.246106 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00591d51-1a99-4849-a959-5ed8d0fe97f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:49.247193 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00591d51-1a99-4849-a959-5ed8d0fe97f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:49.247484 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00591d51-1a99-4849-a959-5ed8d0fe97f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:49.247763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00591d51-1a99-4849-a959-5ed8d0fe97f4 None admin] PATH_INFO: `/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/a44bb5fc455a4965ac6904fb548530f2/roles/d21329f1cd364fba8b79529896e00f81` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:49.263411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-cf957e5b-8213-46c3-b327-274fff42d6a2 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:49.264321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00591d51-1a99-4849-a959-5ed8d0fe97f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d90551d9446e4f2cbd14312d2af9f7c9, user_id=a44bb5fc455a4965ac6904fb548530f2, role_id=d21329f1cd364fba8b79529896e00f81)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:49.265042 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cf957e5b-8213-46c3-b327-274fff42d6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:49.266087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00591d51-1a99-4849-a959-5ed8d0fe97f4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:49.282502 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 303/606] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:55:49 2022] PUT /identity/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/a44bb5fc455a4965ac6904fb548530f2/roles/d21329f1cd364fba8b79529896e00f81 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:55:49.283387 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00591d51-1a99-4849-a959-5ed8d0fe97f4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:49.348891 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 304/607] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:49.390826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf957e5b-8213-46c3-b327-274fff42d6a2 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:49.438258 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00591d51-1a99-4849-a959-5ed8d0fe97f4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:49.507174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72bf3c-062f-4717-bc2e-ab643cb626d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:49.507857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72bf3c-062f-4717-bc2e-ab643cb626d1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:49.508167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72bf3c-062f-4717-bc2e-ab643cb626d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:49.508450 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72bf3c-062f-4717-bc2e-ab643cb626d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:49.509256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72bf3c-062f-4717-bc2e-ab643cb626d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:49.509569 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72bf3c-062f-4717-bc2e-ab643cb626d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:49.511013 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72bf3c-062f-4717-bc2e-ab643cb626d1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:49.524982 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 304/608] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:55:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:49.530742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72bf3c-062f-4717-bc2e-ab643cb626d1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:49.537568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf957e5b-8213-46c3-b327-274fff42d6a2 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:49.539381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:49.578095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:49.583945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ab4e4-fcbb-4a15-822b-199fd71fcd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:49.585110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ab4e4-fcbb-4a15-822b-199fd71fcd95 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:49.585584 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ab4e4-fcbb-4a15-822b-199fd71fcd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:49.586188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ab4e4-fcbb-4a15-822b-199fd71fcd95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:49.606182 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ab4e4-fcbb-4a15-822b-199fd71fcd95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:49.622885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7a3ab4e4-fcbb-4a15-822b-199fd71fcd95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:49.622885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:49.622885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:49.622885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:49.622885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:49.622885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:49.622885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:49.622885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:49.622885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:49.622885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:49.622885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:49.622885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:49.622885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:49.622885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:49.622885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:49.622885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:49.623977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:49.623977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:49.623977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:49.623977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:49.623977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:49.623977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:49.623977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:49.623977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:49.623977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:49.623977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:49.623977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:49.623977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:49.623977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:49.623977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:49.623977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:49.623977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:49.624831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:49.624831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:49.624831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:49.624831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:49.624831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:49.624831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:49.624831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:49.624831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:49.624831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:49.624831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:49.624831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:49.624831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:49.628703 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 305/609] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:49.635959 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ab4e4-fcbb-4a15-822b-199fd71fcd95 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:49.712241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72bf3c-062f-4717-bc2e-ab643cb626d1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:49.775805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5eeaa-3d0b-43c8-a5c4-acdf5f387d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:49.776736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5eeaa-3d0b-43c8-a5c4-acdf5f387d5d None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:49.777016 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5eeaa-3d0b-43c8-a5c4-acdf5f387d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:49.777287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5eeaa-3d0b-43c8-a5c4-acdf5f387d5d None admin] PATH_INFO: `/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/4897919923a64881ac5540cc5d58df1c/roles/d21329f1cd364fba8b79529896e00f81` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:49.803041 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5eeaa-3d0b-43c8-a5c4-acdf5f387d5d None admin] RBAC: Authorizing `identity:create_grant(project_id=d90551d9446e4f2cbd14312d2af9f7c9, user_id=4897919923a64881ac5540cc5d58df1c, role_id=d21329f1cd364fba8b79529896e00f81)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:49.804527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5eeaa-3d0b-43c8-a5c4-acdf5f387d5d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:49.818662 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ab4e4-fcbb-4a15-822b-199fd71fcd95 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:49.828907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 305/610] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:55:49 2022] PUT /identity/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/4897919923a64881ac5540cc5d58df1c/roles/d21329f1cd364fba8b79529896e00f81 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:55:49.886666 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec1465-c704-489e-a4b5-f3b1b2926896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:49.887369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec1465-c704-489e-a4b5-f3b1b2926896 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:49.887655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec1465-c704-489e-a4b5-f3b1b2926896 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:49.887961 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec1465-c704-489e-a4b5-f3b1b2926896 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:49.888782 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec1465-c704-489e-a4b5-f3b1b2926896 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:49.889099 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec1465-c704-489e-a4b5-f3b1b2926896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:49.890507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec1465-c704-489e-a4b5-f3b1b2926896 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:49.900975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 306/611] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:55:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:49.903524 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83597224-7243-4e1c-8b96-26bab7f12070 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:49.903820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83597224-7243-4e1c-8b96-26bab7f12070 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:49.904129 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83597224-7243-4e1c-8b96-26bab7f12070 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:49.905746 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 306/612] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:49.906234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec1465-c704-489e-a4b5-f3b1b2926896 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:49.911376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9ca8e-7900-46fe-be9a-bc527ae26c2c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:49.912071 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9ca8e-7900-46fe-be9a-bc527ae26c2c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:49.912607 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9ca8e-7900-46fe-be9a-bc527ae26c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:49.933339 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-74a9ca8e-7900-46fe-be9a-bc527ae26c2c None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:49.934947 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-74a9ca8e-7900-46fe-be9a-bc527ae26c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:49.950480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:50.031718 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 307/613] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:55:50.066611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9ca8e-7900-46fe-be9a-bc527ae26c2c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:50.067956 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec1465-c704-489e-a4b5-f3b1b2926896 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:50.089865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:50.111119 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d624f50-7ec9-4e48-8e92-e87998a3f257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:50.111944 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d624f50-7ec9-4e48-8e92-e87998a3f257 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:50.112249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d624f50-7ec9-4e48-8e92-e87998a3f257 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:50.112536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d624f50-7ec9-4e48-8e92-e87998a3f257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:50.123957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d624f50-7ec9-4e48-8e92-e87998a3f257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:50.125416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d624f50-7ec9-4e48-8e92-e87998a3f257 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:50.144234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-0d624f50-7ec9-4e48-8e92-e87998a3f257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:50.144234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:50.144234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:50.144234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:50.144234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:50.144234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:50.144234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:50.144234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:50.144234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:50.144234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:50.144234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:50.144234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:50.144234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:50.144234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:50.144234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:50.145173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:50.145173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:50.145173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:50.145173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:50.145173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:50.145173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:50.145173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:50.145173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:50.145173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:50.145173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:50.145173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:50.145173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:50.145173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:50.145173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:50.145173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:50.145173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:50.145173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:50.146298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:50.146298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:50.146298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:50.146298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:50.146298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 307/614] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:50.150884 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d624f50-7ec9-4e48-8e92-e87998a3f257 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:50.257825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9ca8e-7900-46fe-be9a-bc527ae26c2c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:50.282378 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:50.329707 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d624f50-7ec9-4e48-8e92-e87998a3f257 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:50.335267 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383c2c3-471c-40d7-8967-9cc70beba9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:50.336111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383c2c3-471c-40d7-8967-9cc70beba9ae None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:50.336396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383c2c3-471c-40d7-8967-9cc70beba9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:50.336675 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383c2c3-471c-40d7-8967-9cc70beba9ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:50.357834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383c2c3-471c-40d7-8967-9cc70beba9ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:50.376757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f383c2c3-471c-40d7-8967-9cc70beba9ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:50.376757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:50.376757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:50.376757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:50.376757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:50.376757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:50.376757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:50.376757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:50.376757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:50.376757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:50.376757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:50.376757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:50.376757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:50.376757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:50.376757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:50.376757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:50.377726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:50.377726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:50.377726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:50.377726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:50.377726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:50.377726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:50.377726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:50.377726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:50.377726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:50.377726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:50.377726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:50.377726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:50.377726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:50.377726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:50.377726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:50.377726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:50.379422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:50.379422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:50.379422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:50.379422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:50.379422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:50.379422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:50.379422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:50.379422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:50.379422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:50.379422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:50.379422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:50.379422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:50.379422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 308/615] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:50.385451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383c2c3-471c-40d7-8967-9cc70beba9ae None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:50.412308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94866824-e145-447f-aba6-e5763b5e1909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:50.413042 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94866824-e145-447f-aba6-e5763b5e1909 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:50.413332 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94866824-e145-447f-aba6-e5763b5e1909 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:50.413615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94866824-e145-447f-aba6-e5763b5e1909 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:50.414398 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94866824-e145-447f-aba6-e5763b5e1909 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:50.414719 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94866824-e145-447f-aba6-e5763b5e1909 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:50.418226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94866824-e145-447f-aba6-e5763b5e1909 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:50.446109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 308/616] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:50.450211 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94866824-e145-447f-aba6-e5763b5e1909 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:50.517419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:50.558095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94866824-e145-447f-aba6-e5763b5e1909 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:50.586682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383c2c3-471c-40d7-8967-9cc70beba9ae None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:50.595356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00304825-1bf8-433f-9803-ac91a6f8023f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:50.596180 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304825-1bf8-433f-9803-ac91a6f8023f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:50.596463 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304825-1bf8-433f-9803-ac91a6f8023f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:50.596739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304825-1bf8-433f-9803-ac91a6f8023f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:50.599597 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:50.606513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00304825-1bf8-433f-9803-ac91a6f8023f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:50.608278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00304825-1bf8-433f-9803-ac91a6f8023f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:50.624516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-00304825-1bf8-433f-9803-ac91a6f8023f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:55:50.624516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:50.624516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:50.624516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:50.624516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:50.624516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:50.624516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:50.624516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:50.624516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:50.624516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:50.624516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:50.624516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:50.624516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:50.624516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:50.624516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:50.624516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:50.625484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:50.626969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:50.626969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:50.626969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:50.626969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:50.626969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:50.626969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:50.626969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:50.626969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:50.626969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:55:50.626969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:50.629725 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 309/617] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:55:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:50.635238 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00304825-1bf8-433f-9803-ac91a6f8023f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:50.674624 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd672af-745f-4827-9578-b1ddeeffdde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:50.675365 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd672af-745f-4827-9578-b1ddeeffdde4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:50.675658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd672af-745f-4827-9578-b1ddeeffdde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:50.675963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd672af-745f-4827-9578-b1ddeeffdde4 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:50.676738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd672af-745f-4827-9578-b1ddeeffdde4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:50.677050 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd672af-745f-4827-9578-b1ddeeffdde4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:50.678508 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd672af-745f-4827-9578-b1ddeeffdde4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:50.687673 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 309/618] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:55:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:50.693897 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd672af-745f-4827-9578-b1ddeeffdde4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:50.746008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00304825-1bf8-433f-9803-ac91a6f8023f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:50.783134 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a5ba1-0035-486b-9835-e9393ccb0ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:50.784355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a5ba1-0035-486b-9835-e9393ccb0ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:50.784805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a5ba1-0035-486b-9835-e9393ccb0ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:50.785241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a5ba1-0035-486b-9835-e9393ccb0ce7 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:50.786231 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a5ba1-0035-486b-9835-e9393ccb0ce7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:50.787087 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a5ba1-0035-486b-9835-e9393ccb0ce7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:50.789007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a5ba1-0035-486b-9835-e9393ccb0ce7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:50.799990 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd672af-745f-4827-9578-b1ddeeffdde4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:50.813258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 310/619] 10.222.0.73 () {56 vars in 1135 bytes} [Thu May 19 11:55:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:50.818663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a5ba1-0035-486b-9835-e9393ccb0ce7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:50.838183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd1f19-713c-4490-bacb-6f44a72b3769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:50.838839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd1f19-713c-4490-bacb-6f44a72b3769 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:50.839223 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd1f19-713c-4490-bacb-6f44a72b3769 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:50.839677 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd1f19-713c-4490-bacb-6f44a72b3769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:50.851665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd1f19-713c-4490-bacb-6f44a72b3769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:50.853358 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd1f19-713c-4490-bacb-6f44a72b3769 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:50.856314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:50.872504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-dfbd1f19-713c-4490-bacb-6f44a72b3769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:50.872504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:50.872504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:50.872504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:50.872504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:50.872504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:50.872504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:50.872504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:50.872504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:50.872504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:50.872504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:50.872504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:50.872504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:50.872504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:50.872504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:50.873567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:50.873567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:50.873567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:50.873567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:50.873567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:50.873567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:50.873567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:50.873567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:50.873567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:50.873567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:50.873567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:50.873567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:50.873567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:50.873567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:50.873567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:50.873567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:50.873567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:50.874413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:50.874413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:50.874413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:50.874413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:50.874648 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 310/620] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:50.880034 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd1f19-713c-4490-bacb-6f44a72b3769 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:50.886265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:50.934978 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a5ba1-0035-486b-9835-e9393ccb0ce7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:50.973478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28567167-d59f-467d-8da1-3d21abaa592e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:50.974672 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28567167-d59f-467d-8da1-3d21abaa592e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:50.975154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28567167-d59f-467d-8da1-3d21abaa592e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:50.975623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28567167-d59f-467d-8da1-3d21abaa592e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:50.988447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28567167-d59f-467d-8da1-3d21abaa592e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:50.990319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28567167-d59f-467d-8da1-3d21abaa592e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:51.009249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-28567167-d59f-467d-8da1-3d21abaa592e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:51.009249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:51.009249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:51.009249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:51.009249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:51.009249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:51.009249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:51.009249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:51.009249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:51.009249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:51.009249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:51.009249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:51.009249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:51.009249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:51.009249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:51.010183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:51.010183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:51.010183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:51.010183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:51.010183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:51.010183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:51.010183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:51.010183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:51.010183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:51.010183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:51.010183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:51.010183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:51.010183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:51.010183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:51.010183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:51.010183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:51.010183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:51.011064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:51.011064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:51.011064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:51.011064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:51.013320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 311/621] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:51.018505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd1f19-713c-4490-bacb-6f44a72b3769 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:51.019142 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28567167-d59f-467d-8da1-3d21abaa592e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:51.055388 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88c6b2-9d5f-4dff-8454-551e41fe3d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:51.056116 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88c6b2-9d5f-4dff-8454-551e41fe3d82 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:51.056451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88c6b2-9d5f-4dff-8454-551e41fe3d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:51.056729 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88c6b2-9d5f-4dff-8454-551e41fe3d82 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:51.057845 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88c6b2-9d5f-4dff-8454-551e41fe3d82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:51.057845 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88c6b2-9d5f-4dff-8454-551e41fe3d82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:51.059198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88c6b2-9d5f-4dff-8454-551e41fe3d82 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:51.072404 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 311/622] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:51.077873 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88c6b2-9d5f-4dff-8454-551e41fe3d82 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:51.127524 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28567167-d59f-467d-8da1-3d21abaa592e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:51.135617 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:51.164212 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:51.167033 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340f848-723c-40b2-b238-58f8e322da85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:51.167871 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340f848-723c-40b2-b238-58f8e322da85 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:51.168391 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340f848-723c-40b2-b238-58f8e322da85 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:51.168816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340f848-723c-40b2-b238-58f8e322da85 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:51.169692 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340f848-723c-40b2-b238-58f8e322da85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:51.170551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340f848-723c-40b2-b238-58f8e322da85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:51.172280 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340f848-723c-40b2-b238-58f8e322da85 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:51.182641 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88c6b2-9d5f-4dff-8454-551e41fe3d82 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:51.184732 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 312/623] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:51.190200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340f848-723c-40b2-b238-58f8e322da85 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:51.220545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d9586-478a-4ae0-9c45-202fe219e8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:51.221629 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d9586-478a-4ae0-9c45-202fe219e8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:51.221920 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d9586-478a-4ae0-9c45-202fe219e8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:51.222198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d9586-478a-4ae0-9c45-202fe219e8d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:51.231461 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d9586-478a-4ae0-9c45-202fe219e8d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:51.233756 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d9586-478a-4ae0-9c45-202fe219e8d4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:51.251237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-1a6d9586-478a-4ae0-9c45-202fe219e8d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:55:51.251237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:51.251237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:51.251237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:51.251237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:51.251237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:51.251237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:51.251237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:51.251237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:51.251237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:51.251237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:51.251237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:51.251237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:51.251237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:51.251237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:51.251237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:51.252228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:51.253163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:51.253163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:51.253163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:51.253163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:51.253163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:51.253163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:51.253163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:51.253163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:51.253163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:55:51.253163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:51.253704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 312/624] 10.222.0.73 () {56 vars in 1093 bytes} [Thu May 19 11:55:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:51.257127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef076e2b-3cdd-43e4-b7ca-f8e90ca91e93 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:51.257626 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef076e2b-3cdd-43e4-b7ca-f8e90ca91e93 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:51.258096 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef076e2b-3cdd-43e4-b7ca-f8e90ca91e93 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:51.259603 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 313/625] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:51.260650 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef076e2b-3cdd-43e4-b7ca-f8e90ca91e93 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:51.316863 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340f848-723c-40b2-b238-58f8e322da85 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:51.357887 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d6c09-3a3e-427a-b6d4-c2ad4127a5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:51.359030 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d6c09-3a3e-427a-b6d4-c2ad4127a5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:51.359441 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d6c09-3a3e-427a-b6d4-c2ad4127a5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:51.359729 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d6c09-3a3e-427a-b6d4-c2ad4127a5e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:51.368225 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d6c09-3a3e-427a-b6d4-c2ad4127a5e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:51.369676 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d6c09-3a3e-427a-b6d4-c2ad4127a5e1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:51.384273 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef076e2b-3cdd-43e4-b7ca-f8e90ca91e93 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:51.387536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:51.389977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d89d6c09-3a3e-427a-b6d4-c2ad4127a5e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:51.389977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:51.389977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:51.389977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:51.389977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:51.389977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:51.389977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:51.389977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:51.389977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:51.389977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:51.389977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:51.389977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:51.389977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:51.389977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:51.389977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:51.390860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:51.390860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:51.390860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:51.390860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:51.390860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:51.390860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:51.390860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:51.390860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:51.390860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:51.390860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:51.390860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:51.390860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:51.390860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:51.390860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:51.390860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:51.390860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:51.390860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:51.392339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:51.392339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:51.392339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:51.392339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:51.392339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:51.392339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:51.392339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:51.392339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:51.396166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 313/626] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:51.397538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe2b5b-dea6-4410-bc58-bfaa8617d75f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:51.397763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe2b5b-dea6-4410-bc58-bfaa8617d75f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:51.398043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe2b5b-dea6-4410-bc58-bfaa8617d75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:51.419930 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8abe2b5b-dea6-4410-bc58-bfaa8617d75f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:51.421579 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8abe2b5b-dea6-4410-bc58-bfaa8617d75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:51.431658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c590857-f95a-4138-9ac3-6316c61cb583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:51.432854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c590857-f95a-4138-9ac3-6316c61cb583 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:51.433357 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c590857-f95a-4138-9ac3-6316c61cb583 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:51.434464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c590857-f95a-4138-9ac3-6316c61cb583 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:51.436028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c590857-f95a-4138-9ac3-6316c61cb583 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:51.436881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c590857-f95a-4138-9ac3-6316c61cb583 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:51.439528 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c590857-f95a-4138-9ac3-6316c61cb583 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:51.447952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:51.470508 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 314/627] 10.222.0.73 () {56 vars in 1133 bytes} [Thu May 19 11:55:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:51.470508 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c590857-f95a-4138-9ac3-6316c61cb583 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:51.512226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 314/628] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:51.512986 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe2b5b-dea6-4410-bc58-bfaa8617d75f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:51.594710 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c590857-f95a-4138-9ac3-6316c61cb583 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:51.631424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dbe1e-be09-4a00-ab47-4fb0071bff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:51.632070 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dbe1e-be09-4a00-ab47-4fb0071bff22 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:51.632356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dbe1e-be09-4a00-ab47-4fb0071bff22 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:51.632631 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dbe1e-be09-4a00-ab47-4fb0071bff22 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:51.633427 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1dbe1e-be09-4a00-ab47-4fb0071bff22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:51.633723 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1dbe1e-be09-4a00-ab47-4fb0071bff22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:51.635144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1dbe1e-be09-4a00-ab47-4fb0071bff22 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:51.644972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe2b5b-dea6-4410-bc58-bfaa8617d75f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:51.652088 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 315/629] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:55:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:51.652969 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dbe1e-be09-4a00-ab47-4fb0071bff22 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:51.678615 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:51.690198 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2ba4e-897e-420d-935c-d0f052e05671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:51.691294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2ba4e-897e-420d-935c-d0f052e05671 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:51.691792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2ba4e-897e-420d-935c-d0f052e05671 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:51.693055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2ba4e-897e-420d-935c-d0f052e05671 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:51.725738 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:51.765035 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dbe1e-be09-4a00-ab47-4fb0071bff22 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:51.783502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2ba4e-897e-420d-935c-d0f052e05671 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:51.785286 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2ba4e-897e-420d-935c-d0f052e05671 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:51.801551 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630390d-ec1c-4753-8cfc-26b8e4ead624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:51.802350 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630390d-ec1c-4753-8cfc-26b8e4ead624 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:51.802628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630390d-ec1c-4753-8cfc-26b8e4ead624 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:51.802900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630390d-ec1c-4753-8cfc-26b8e4ead624 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:51.813314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630390d-ec1c-4753-8cfc-26b8e4ead624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:51.821601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f630390d-ec1c-4753-8cfc-26b8e4ead624 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:51.821601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:51.821601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:51.821601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:51.821601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:51.821601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:51.821601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:51.821601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:51.821601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:51.821601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:51.821601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:51.821601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:51.821601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:51.821601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:51.821601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:51.821601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:51.822519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:51.822519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:51.822519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:51.822519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:51.822519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:51.822519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:51.822519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:51.822519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:51.822519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:51.822519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:51.822519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:51.822519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:51.822519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:51.822519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:51.822519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:51.822519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:51.823325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:51.823325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:51.823325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:51.823325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:51.823325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:51.823325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:51.823325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:51.823325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:51.823325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:51.823325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:51.823325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:51.823325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:51.823325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 316/630] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:51.824066 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630390d-ec1c-4753-8cfc-26b8e4ead624 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:51.913843 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:51.932343 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 315/631] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:51.934095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2ba4e-897e-420d-935c-d0f052e05671 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:51.942900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630390d-ec1c-4753-8cfc-26b8e4ead624 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:51.978111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd1fef-836b-45af-8b27-e87ff4b57b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:51.979018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd1fef-836b-45af-8b27-e87ff4b57b28 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:51.979649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd1fef-836b-45af-8b27-e87ff4b57b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:51.979944 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd1fef-836b-45af-8b27-e87ff4b57b28 None admin] PATH_INFO: `/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/371dae58e95d403b97e311c6616adab5/roles/d21329f1cd364fba8b79529896e00f81` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:51.995191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:51.999262 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd1fef-836b-45af-8b27-e87ff4b57b28 None admin] RBAC: Authorizing `identity:create_grant(project_id=d90551d9446e4f2cbd14312d2af9f7c9, user_id=371dae58e95d403b97e311c6616adab5, role_id=d21329f1cd364fba8b79529896e00f81)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:52.001866 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd1fef-836b-45af-8b27-e87ff4b57b28 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:52.019334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 317/632] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:55:51 2022] PUT /identity/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/371dae58e95d403b97e311c6616adab5/roles/d21329f1cd364fba8b79529896e00f81 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:55:52.026186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd1fef-836b-45af-8b27-e87ff4b57b28 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:52.048558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2ba4e-897e-420d-935c-d0f052e05671 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:52.090410 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476215a-8743-4a5c-af90-046fe95365f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:52.091092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476215a-8743-4a5c-af90-046fe95365f3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:52.091432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476215a-8743-4a5c-af90-046fe95365f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:52.091716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476215a-8743-4a5c-af90-046fe95365f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:52.092526 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476215a-8743-4a5c-af90-046fe95365f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:52.092841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476215a-8743-4a5c-af90-046fe95365f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:52.094306 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476215a-8743-4a5c-af90-046fe95365f3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:52.104196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 316/633] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:55:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:52.105737 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949b8f9-5c9d-4604-8891-03a6947cbd4c None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:52.106170 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949b8f9-5c9d-4604-8891-03a6947cbd4c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:52.106569 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949b8f9-5c9d-4604-8891-03a6947cbd4c None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:52.112373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 317/634] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:52.113295 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949b8f9-5c9d-4604-8891-03a6947cbd4c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:52.161132 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd1fef-836b-45af-8b27-e87ff4b57b28 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:52.196181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:52.206421 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94b3bb-31d9-4d30-9bc6-80a5ea2123c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:52.207516 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94b3bb-31d9-4d30-9bc6-80a5ea2123c6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:52.207972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94b3bb-31d9-4d30-9bc6-80a5ea2123c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:52.208387 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94b3bb-31d9-4d30-9bc6-80a5ea2123c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:52.220692 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94b3bb-31d9-4d30-9bc6-80a5ea2123c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:52.222417 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94b3bb-31d9-4d30-9bc6-80a5ea2123c6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:52.236522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949b8f9-5c9d-4604-8891-03a6947cbd4c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:52.242958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-cc94b3bb-31d9-4d30-9bc6-80a5ea2123c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:52.242958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:52.242958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:52.242958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:52.242958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:52.242958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:52.242958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:52.242958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:52.242958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:52.242958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:52.242958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:52.242958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:52.242958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:52.242958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:52.242958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:52.244056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:52.244056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:52.244056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:52.244056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:52.244056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:52.244056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:52.244056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:52.244056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:52.244056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:52.244056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:52.244056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:52.244056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:52.244056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:52.244056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:52.244056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:52.244056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:52.244056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:52.245118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:52.245118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:52.245118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:52.245118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:52.251400 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 318/635] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:52.253158 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48712df8-e5f1-4b9d-ae7e-0af0e5ff2a1d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:52.253594 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48712df8-e5f1-4b9d-ae7e-0af0e5ff2a1d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:52.254015 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48712df8-e5f1-4b9d-ae7e-0af0e5ff2a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:52.260530 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:52.272660 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-48712df8-e5f1-4b9d-ae7e-0af0e5ff2a1d None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:52.273672 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-48712df8-e5f1-4b9d-ae7e-0af0e5ff2a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:52.280966 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954f105-168d-4189-aa09-fd43f2af06fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:52.282102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954f105-168d-4189-aa09-fd43f2af06fe None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:52.283124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954f105-168d-4189-aa09-fd43f2af06fe None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:52.283618 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954f105-168d-4189-aa09-fd43f2af06fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:52.296311 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954f105-168d-4189-aa09-fd43f2af06fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:52.297936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954f105-168d-4189-aa09-fd43f2af06fe None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:52.316257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7954f105-168d-4189-aa09-fd43f2af06fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:52.316257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:52.316257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:52.316257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:52.316257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:52.316257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:52.316257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:52.316257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:52.316257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:52.316257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:52.316257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:52.316257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:52.316257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:52.316257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:52.316257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:52.317200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:52.317200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:52.317200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:52.317200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:52.317200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:52.317200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:52.317200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:52.317200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:52.317200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:52.317200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:52.317200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:52.317200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:52.317200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:52.317200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:52.317200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:52.317200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:52.317200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:52.318063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:52.318063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:52.318063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:52.318063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:52.318063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 318/636] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:52.318684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954f105-168d-4189-aa09-fd43f2af06fe None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:52.367938 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 319/637] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:52.367938 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48712df8-e5f1-4b9d-ae7e-0af0e5ff2a1d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:52.467178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954f105-168d-4189-aa09-fd43f2af06fe None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:52.492515 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48712df8-e5f1-4b9d-ae7e-0af0e5ff2a1d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:52.508007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:52.515075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8676e4-cd21-4457-9312-c154585e7890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:52.516632 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8676e4-cd21-4457-9312-c154585e7890 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:52.517147 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8676e4-cd21-4457-9312-c154585e7890 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:52.517991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8676e4-cd21-4457-9312-c154585e7890 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:52.519242 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8676e4-cd21-4457-9312-c154585e7890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:52.519957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8676e4-cd21-4457-9312-c154585e7890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:52.521815 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8676e4-cd21-4457-9312-c154585e7890 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:52.529955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8966518-2105-4e00-850c-7d3ff1a53752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:52.530621 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8966518-2105-4e00-850c-7d3ff1a53752 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:52.530901 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8966518-2105-4e00-850c-7d3ff1a53752 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:52.531167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8966518-2105-4e00-850c-7d3ff1a53752 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:52.531896 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8966518-2105-4e00-850c-7d3ff1a53752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:52.532843 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8966518-2105-4e00-850c-7d3ff1a53752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:52.534321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8966518-2105-4e00-850c-7d3ff1a53752 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:52.539300 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 319/638] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:52.540395 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8676e4-cd21-4457-9312-c154585e7890 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:52.551804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 320/639] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:52.552841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8966518-2105-4e00-850c-7d3ff1a53752 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:52.578926 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:52.656209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8676e4-cd21-4457-9312-c154585e7890 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:52.672948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8966518-2105-4e00-850c-7d3ff1a53752 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:52.696215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780848c8-178e-43b0-8a7f-0ba4b87256c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:52.697012 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780848c8-178e-43b0-8a7f-0ba4b87256c2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:52.697294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780848c8-178e-43b0-8a7f-0ba4b87256c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:52.697569 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780848c8-178e-43b0-8a7f-0ba4b87256c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:52.708509 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780848c8-178e-43b0-8a7f-0ba4b87256c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:52.713555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2c045-86ee-4d84-b696-b93bf3d0b57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:52.714594 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2c045-86ee-4d84-b696-b93bf3d0b57f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:52.715086 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2c045-86ee-4d84-b696-b93bf3d0b57f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:52.715564 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2c045-86ee-4d84-b696-b93bf3d0b57f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:52.716192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-780848c8-178e-43b0-8a7f-0ba4b87256c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:52.716192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:52.716192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:52.716192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:52.716192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:52.716192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:52.716192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:52.716192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:52.716192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:52.716192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:52.716192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:52.716192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:52.716192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:52.716192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:52.716192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:52.716192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:52.717070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:52.717070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:52.717070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:52.717070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:52.717070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:52.717070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:52.717070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:52.717070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:52.717070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:52.717070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:52.717070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:52.717070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:52.717070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:52.717070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:52.717070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:52.717070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:52.717947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:52.717947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:52.717947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:52.717947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:52.717947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:52.717947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:52.717947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:52.717947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:52.717947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:52.717947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:52.717947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:52.717947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:52.717947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 320/640] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:52.718643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780848c8-178e-43b0-8a7f-0ba4b87256c2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:52.729389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2c045-86ee-4d84-b696-b93bf3d0b57f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:52.731499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2c045-86ee-4d84-b696-b93bf3d0b57f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:52.747457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b8e2c045-86ee-4d84-b696-b93bf3d0b57f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:52.747457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:52.747457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:52.747457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:52.747457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:52.747457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:52.747457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:52.747457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:52.747457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:52.747457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:52.747457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:52.747457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:52.747457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:52.747457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:52.747457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:52.748468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:52.748468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:52.748468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:52.748468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:52.748468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:52.748468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:52.748468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:52.748468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:52.748468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:52.748468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:52.748468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:52.748468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:52.748468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:52.748468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:52.748468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:52.748468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:52.748468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:52.749347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:52.749347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:52.749347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:52.749347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:52.749347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:52.749347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:52.749347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:52.749347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:52.749347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 321/641] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:52.749838 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e432f-7188-4e7e-81fc-2bd1b854de99 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:52.750656 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e432f-7188-4e7e-81fc-2bd1b854de99 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:52.750656 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e432f-7188-4e7e-81fc-2bd1b854de99 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:52.751795 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 322/642] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:52.756345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e432f-7188-4e7e-81fc-2bd1b854de99 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:52.798398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:52.821069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:52.833405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780848c8-178e-43b0-8a7f-0ba4b87256c2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:52.871402 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b07003-00f3-4646-8abd-7bdc527c957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:52.872248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b07003-00f3-4646-8abd-7bdc527c957d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:52.872456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e432f-7188-4e7e-81fc-2bd1b854de99 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:52.872884 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b07003-00f3-4646-8abd-7bdc527c957d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:52.872884 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b07003-00f3-4646-8abd-7bdc527c957d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:52.881441 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b07003-00f3-4646-8abd-7bdc527c957d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:52.883218 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b07003-00f3-4646-8abd-7bdc527c957d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:52.901428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-20b07003-00f3-4646-8abd-7bdc527c957d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 11:55:52.901428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:52.901428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:52.901428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:52.901428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:52.901428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:52.901428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:52.901428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:52.901428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:52.901428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:52.901428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:52.901428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:52.901428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:52.901428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:52.901428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:52.901428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:52.902409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:52.903411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:52.903411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:52.903411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:52.903411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:52.903411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:52.903411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:52.903411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:52.903411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:52.903411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 11:55:52.903411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:52.903411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 321/643] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:52.903411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b07003-00f3-4646-8abd-7bdc527c957d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:52.912400 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166967c-9fc4-434c-8f68-6d49a4d8d93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:52.913099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166967c-9fc4-434c-8f68-6d49a4d8d93b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:52.913388 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166967c-9fc4-434c-8f68-6d49a4d8d93b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:52.913670 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166967c-9fc4-434c-8f68-6d49a4d8d93b None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:52.914531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166967c-9fc4-434c-8f68-6d49a4d8d93b None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:52.914847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166967c-9fc4-434c-8f68-6d49a4d8d93b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:52.916384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166967c-9fc4-434c-8f68-6d49a4d8d93b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:52.931011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 323/644] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:55:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:52.931011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c15e26-a328-4716-b5b3-581fa8d8ebd5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:52.931011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c15e26-a328-4716-b5b3-581fa8d8ebd5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:52.931011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c15e26-a328-4716-b5b3-581fa8d8ebd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:52.951052 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e0c15e26-a328-4716-b5b3-581fa8d8ebd5 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:52.952288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e0c15e26-a328-4716-b5b3-581fa8d8ebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:53.006939 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b07003-00f3-4646-8abd-7bdc527c957d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:53.035939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 324/645] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:53.035939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c15e26-a328-4716-b5b3-581fa8d8ebd5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:53.052377 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c24be-53c8-4bec-85fb-a9c9a0f692eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:53.053379 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c24be-53c8-4bec-85fb-a9c9a0f692eb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:53.053512 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c24be-53c8-4bec-85fb-a9c9a0f692eb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:53.053895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c24be-53c8-4bec-85fb-a9c9a0f692eb None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:53.054530 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c24be-53c8-4bec-85fb-a9c9a0f692eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:53.054841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c24be-53c8-4bec-85fb-a9c9a0f692eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:53.056337 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c24be-53c8-4bec-85fb-a9c9a0f692eb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:53.062963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:53.069924 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 322/646] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:55:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:53.070997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c24be-53c8-4bec-85fb-a9c9a0f692eb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:53.085023 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:53.139210 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c15e26-a328-4716-b5b3-581fa8d8ebd5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:53.173144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9d18b-a3b5-48a7-b8b0-b12fe06adc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:53.173808 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9d18b-a3b5-48a7-b8b0-b12fe06adc65 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:53.174091 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9d18b-a3b5-48a7-b8b0-b12fe06adc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:53.174366 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9d18b-a3b5-48a7-b8b0-b12fe06adc65 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:53.175200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9d18b-a3b5-48a7-b8b0-b12fe06adc65 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:53.175505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9d18b-a3b5-48a7-b8b0-b12fe06adc65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:53.176949 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9d18b-a3b5-48a7-b8b0-b12fe06adc65 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:53.180672 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c24be-53c8-4bec-85fb-a9c9a0f692eb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:53.194518 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 325/647] 10.222.0.73 () {56 vars in 1137 bytes} [Thu May 19 11:55:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:53.195327 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9d18b-a3b5-48a7-b8b0-b12fe06adc65 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:53.221367 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aa3c1-c1ff-45ae-bbd1-cf8a34fdea53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:53.222749 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aa3c1-c1ff-45ae-bbd1-cf8a34fdea53 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:53.223390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aa3c1-c1ff-45ae-bbd1-cf8a34fdea53 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:53.224206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aa3c1-c1ff-45ae-bbd1-cf8a34fdea53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:53.237244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3aa3c1-c1ff-45ae-bbd1-cf8a34fdea53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:53.240058 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3aa3c1-c1ff-45ae-bbd1-cf8a34fdea53 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:53.265414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-dd3aa3c1-c1ff-45ae-bbd1-cf8a34fdea53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:53.265414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:53.265414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:53.265414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:53.265414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:53.265414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:53.265414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:53.265414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:53.265414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:53.265414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:53.265414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:53.265414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:53.265414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:53.265414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:53.265414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:53.267659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:53.267659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:53.267659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:53.267659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:53.267659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:53.267659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:53.267659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:53.267659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:53.267659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:53.267659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:53.267659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:53.267659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:53.267659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:53.267659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:53.267659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:53.267659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:53.267659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:53.268764 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:53.268764 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:53.268764 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:53.268764 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:53.268764 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 323/648] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:53.272414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aa3c1-c1ff-45ae-bbd1-cf8a34fdea53 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:53.288685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:53.307355 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9d18b-a3b5-48a7-b8b0-b12fe06adc65 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:53.339118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:53.342454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf9064-e8b2-4db3-a4a9-b776f3a15637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:53.343381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf9064-e8b2-4db3-a4a9-b776f3a15637 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:53.343675 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf9064-e8b2-4db3-a4a9-b776f3a15637 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:53.343985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf9064-e8b2-4db3-a4a9-b776f3a15637 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:53.355435 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf9064-e8b2-4db3-a4a9-b776f3a15637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:53.363204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-5dbf9064-e8b2-4db3-a4a9-b776f3a15637 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:53.363204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:53.363204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:53.363204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:53.363204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:53.363204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:53.363204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:53.363204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:53.363204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:53.363204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:53.363204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:53.363204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:53.363204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:53.363204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:53.363204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:53.363204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:53.364360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:53.364360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:53.364360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:53.364360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:53.364360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:53.364360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:53.364360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:53.364360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:53.364360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:53.364360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:53.364360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:53.364360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:53.364360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:53.364360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:53.364360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:53.364360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:53.365209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:53.365209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:53.365209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:53.365209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:53.365209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:53.365209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:53.365209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:53.365209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:53.365209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:53.365209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:53.365209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:53.365209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:53.365209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 326/649] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:53.365904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf9064-e8b2-4db3-a4a9-b776f3a15637 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:53.390687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aa3c1-c1ff-45ae-bbd1-cf8a34fdea53 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:53.426725 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbcf53-b4af-4fbb-8997-1fee34b0644d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:53.427385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbcf53-b4af-4fbb-8997-1fee34b0644d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:53.427675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbcf53-b4af-4fbb-8997-1fee34b0644d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:53.427983 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbcf53-b4af-4fbb-8997-1fee34b0644d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:53.428821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbcf53-b4af-4fbb-8997-1fee34b0644d None admin] RBAC: Adding query filter params (role.id=d21329f1cd364fba8b79529896e00f81, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=bd0c1f0710f3447d94e67048a508781e) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:53.429138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbcf53-b4af-4fbb-8997-1fee34b0644d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:53.430565 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbcf53-b4af-4fbb-8997-1fee34b0644d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:53.444321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 324/650] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:55:53 2022] GET /identity/v3/role_assignments?user.id=bd0c1f0710f3447d94e67048a508781e&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=d21329f1cd364fba8b79529896e00f81 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:53.445101 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbcf53-b4af-4fbb-8997-1fee34b0644d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:53.486321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf9064-e8b2-4db3-a4a9-b776f3a15637 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:53.523866 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1b836-b11c-4bb1-acba-4e21148dc306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:53.524346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1b836-b11c-4bb1-acba-4e21148dc306 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:53.524625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1b836-b11c-4bb1-acba-4e21148dc306 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:53.524896 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1b836-b11c-4bb1-acba-4e21148dc306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:53.542272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:53.586807 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbcf53-b4af-4fbb-8997-1fee34b0644d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:53.617925 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1b836-b11c-4bb1-acba-4e21148dc306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:53.619443 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1b836-b11c-4bb1-acba-4e21148dc306 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:53.621150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:53.633127 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff60420-9c81-4dad-ac7e-6d93961d5f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:53.633805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60420-9c81-4dad-ac7e-6d93961d5f1f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:53.634595 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60420-9c81-4dad-ac7e-6d93961d5f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:53.634952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60420-9c81-4dad-ac7e-6d93961d5f1f None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:53.635934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff60420-9c81-4dad-ac7e-6d93961d5f1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:53.637045 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff60420-9c81-4dad-ac7e-6d93961d5f1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:53.638179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff60420-9c81-4dad-ac7e-6d93961d5f1f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:53.651872 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 325/651] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:53.653005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff60420-9c81-4dad-ac7e-6d93961d5f1f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:53.754090 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 327/652] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:53.755633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1b836-b11c-4bb1-acba-4e21148dc306 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:53.779590 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff60420-9c81-4dad-ac7e-6d93961d5f1f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:53.810531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:53.821197 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9280333-2db8-4cca-8d29-fe1575d06c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:53.822095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9280333-2db8-4cca-8d29-fe1575d06c44 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:53.822485 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9280333-2db8-4cca-8d29-fe1575d06c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:53.822884 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9280333-2db8-4cca-8d29-fe1575d06c44 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:53.823850 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9280333-2db8-4cca-8d29-fe1575d06c44 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:53.824317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9280333-2db8-4cca-8d29-fe1575d06c44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:53.825889 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9280333-2db8-4cca-8d29-fe1575d06c44 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:53.835261 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 326/653] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:55:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:53.840581 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9280333-2db8-4cca-8d29-fe1575d06c44 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:53.869074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1b836-b11c-4bb1-acba-4e21148dc306 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:53.904307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:53.905403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35aa4d-f3f3-47b5-9158-8b861ab9b637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:53.906731 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35aa4d-f3f3-47b5-9158-8b861ab9b637 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:53.907692 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35aa4d-f3f3-47b5-9158-8b861ab9b637 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:53.908151 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35aa4d-f3f3-47b5-9158-8b861ab9b637 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:53.916428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35aa4d-f3f3-47b5-9158-8b861ab9b637 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:53.918153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35aa4d-f3f3-47b5-9158-8b861ab9b637 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:53.934349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ab35aa4d-f3f3-47b5-9158-8b861ab9b637 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:55:53.934349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:53.934349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:53.934349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:53.934349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:53.934349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:53.934349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:53.934349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:53.934349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:53.934349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:53.934349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:53.934349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:53.934349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:53.934349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:53.934349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:53.934349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:53.935492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:53.937014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:53.937014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:53.937014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:53.937014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:53.937014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:53.937014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:53.937014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:53.937014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:53.937014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:55:53.937014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:53.939283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 328/654] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:53.940329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35aa4d-f3f3-47b5-9158-8b861ab9b637 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:53.972338 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9280333-2db8-4cca-8d29-fe1575d06c44 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:54.009087 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3bbe5-5224-4948-8d6c-21ea73cc0413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:54.010053 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3bbe5-5224-4948-8d6c-21ea73cc0413 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:54.010435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3bbe5-5224-4948-8d6c-21ea73cc0413 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:54.010811 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3bbe5-5224-4948-8d6c-21ea73cc0413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:54.022653 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3bbe5-5224-4948-8d6c-21ea73cc0413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:54.024364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3bbe5-5224-4948-8d6c-21ea73cc0413 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:54.043768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-0de3bbe5-5224-4948-8d6c-21ea73cc0413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:54.043768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:54.043768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:54.043768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:54.043768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:54.043768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:54.043768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:54.043768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:54.043768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:54.043768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:54.043768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:54.043768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:54.043768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:54.043768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:54.043768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:54.044864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:54.044864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:54.044864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:54.044864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:54.044864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:54.044864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:54.044864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:54.044864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:54.044864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:54.044864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:54.044864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:54.044864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:54.044864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:54.044864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:54.044864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:54.044864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:54.044864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:54.046195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:54.046195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:54.046195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:54.046195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:54.047837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 327/655] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:54.049411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3bbe5-5224-4948-8d6c-21ea73cc0413 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:54.051793 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35aa4d-f3f3-47b5-9158-8b861ab9b637 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:54.054595 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:54.088124 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89de645-5e05-4600-a411-11a4e9e6a7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:54.088917 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de645-5e05-4600-a411-11a4e9e6a7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:54.089202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de645-5e05-4600-a411-11a4e9e6a7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:54.089479 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de645-5e05-4600-a411-11a4e9e6a7a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:54.100532 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89de645-5e05-4600-a411-11a4e9e6a7a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:54.102138 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89de645-5e05-4600-a411-11a4e9e6a7a9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:54.121676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b89de645-5e05-4600-a411-11a4e9e6a7a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:54.121676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:54.121676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:54.121676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:54.121676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:54.121676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:54.121676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:54.121676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:54.121676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:54.121676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:54.121676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:54.121676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:54.121676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:54.121676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:54.121676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:54.122612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:54.122612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:54.122612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:54.122612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:54.122612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:54.122612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:54.122612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:54.122612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:54.122612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:54.122612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:54.122612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:54.122612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:54.122612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:54.122612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:54.122612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:54.122612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:54.122612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:54.123480 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:54.123480 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:54.123480 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:54.123480 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:54.127428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 329/656] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:54.128306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89de645-5e05-4600-a411-11a4e9e6a7a9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:54.165749 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3bbe5-5224-4948-8d6c-21ea73cc0413 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:54.168514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:54.203321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17f536-fbc2-48df-a9d0-5342ff27391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:54.204653 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17f536-fbc2-48df-a9d0-5342ff27391a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:54.205159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17f536-fbc2-48df-a9d0-5342ff27391a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:54.205361 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17f536-fbc2-48df-a9d0-5342ff27391a None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:54.206244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17f536-fbc2-48df-a9d0-5342ff27391a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:54.206559 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17f536-fbc2-48df-a9d0-5342ff27391a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:54.208197 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17f536-fbc2-48df-a9d0-5342ff27391a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:54.235300 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 328/657] 10.222.0.73 () {56 vars in 1137 bytes} [Thu May 19 11:55:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:54.236408 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17f536-fbc2-48df-a9d0-5342ff27391a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:54.247105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89de645-5e05-4600-a411-11a4e9e6a7a9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:54.285486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59eee7-2327-4bb4-ab7a-abcafa6c1b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:54.286510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59eee7-2327-4bb4-ab7a-abcafa6c1b0f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:54.287021 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59eee7-2327-4bb4-ab7a-abcafa6c1b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:54.287502 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59eee7-2327-4bb4-ab7a-abcafa6c1b0f None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:54.288666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59eee7-2327-4bb4-ab7a-abcafa6c1b0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:54.289199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59eee7-2327-4bb4-ab7a-abcafa6c1b0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:54.290886 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59eee7-2327-4bb4-ab7a-abcafa6c1b0f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:54.308725 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 330/658] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:54.310034 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59eee7-2327-4bb4-ab7a-abcafa6c1b0f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:54.331293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:54.362979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17f536-fbc2-48df-a9d0-5342ff27391a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:54.412883 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48abe39-22f8-4f60-a343-d0d49243dc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:54.413550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48abe39-22f8-4f60-a343-d0d49243dc05 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:54.413848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48abe39-22f8-4f60-a343-d0d49243dc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:54.414127 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48abe39-22f8-4f60-a343-d0d49243dc05 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:54.414885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48abe39-22f8-4f60-a343-d0d49243dc05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:54.415174 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48abe39-22f8-4f60-a343-d0d49243dc05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:54.416592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48abe39-22f8-4f60-a343-d0d49243dc05 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:54.431373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 329/659] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:54.431373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48abe39-22f8-4f60-a343-d0d49243dc05 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:54.439794 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59eee7-2327-4bb4-ab7a-abcafa6c1b0f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:54.451001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:54.477675 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308b57e-5bc1-4bb4-8b36-aaf7f71bb583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:54.478333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308b57e-5bc1-4bb4-8b36-aaf7f71bb583 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:54.478616 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308b57e-5bc1-4bb4-8b36-aaf7f71bb583 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:54.478927 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308b57e-5bc1-4bb4-8b36-aaf7f71bb583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:54.536543 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48abe39-22f8-4f60-a343-d0d49243dc05 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:54.549442 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308b57e-5bc1-4bb4-8b36-aaf7f71bb583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:54.550890 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308b57e-5bc1-4bb4-8b36-aaf7f71bb583 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:54.570790 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:54.574793 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbaec9-4878-44d7-b560-6980e13deceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:54.575583 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbaec9-4878-44d7-b560-6980e13deceb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:54.576346 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbaec9-4878-44d7-b560-6980e13deceb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:54.576723 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbaec9-4878-44d7-b560-6980e13deceb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:54.586901 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbaec9-4878-44d7-b560-6980e13deceb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:54.589482 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbaec9-4878-44d7-b560-6980e13deceb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:54.612417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-80bbaec9-4878-44d7-b560-6980e13deceb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:54.612417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:54.612417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:54.612417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:54.612417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:54.612417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:54.612417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:54.612417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:54.612417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:54.612417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:54.612417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:54.612417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:54.612417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:54.612417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:54.612417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:54.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:54.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:54.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:54.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:54.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:54.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:54.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:54.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:54.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:54.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:54.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:54.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:54.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:54.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:54.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:54.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:54.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:54.614185 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:54.614185 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:54.614185 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:54.614185 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:54.614185 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:54.614185 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:54.614185 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:54.614185 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:54.614185 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 330/660] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:54.616128 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f78ae-1594-46e5-a409-cb892cd8dd19 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:54.616617 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f78ae-1594-46e5-a409-cb892cd8dd19 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:54.617103 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f78ae-1594-46e5-a409-cb892cd8dd19 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:54.624229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 331/661] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:54.625063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f78ae-1594-46e5-a409-cb892cd8dd19 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:54.675730 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 331/662] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:54.676525 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308b57e-5bc1-4bb4-8b36-aaf7f71bb583 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:54.717145 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:54.742222 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f78ae-1594-46e5-a409-cb892cd8dd19 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:54.781401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308b57e-5bc1-4bb4-8b36-aaf7f71bb583 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:54.787853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b52267-b4fd-4fb7-8881-dcaef63621df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:54.787853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b52267-b4fd-4fb7-8881-dcaef63621df None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:54.787853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b52267-b4fd-4fb7-8881-dcaef63621df None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:54.787853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b52267-b4fd-4fb7-8881-dcaef63621df None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:54.794696 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b52267-b4fd-4fb7-8881-dcaef63621df None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:54.796437 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b52267-b4fd-4fb7-8881-dcaef63621df None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:54.802638 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:54.812466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d7b52267-b4fd-4fb7-8881-dcaef63621df None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:55:54.812466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:54.812466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:54.812466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:54.812466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:54.812466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:54.812466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:54.812466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:54.812466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:54.812466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:54.812466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:54.812466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:54.812466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:54.812466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:54.812466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:54.812466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:54.814162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:54.815169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:54.815169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:54.815169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:54.815169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:54.815169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:54.815169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:54.815169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:54.815169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:54.815169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 11:55:54.815169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:54.815169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 332/663] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:54.815809 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34724ffe-a3be-443d-987c-0a0c98fe7e80 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:54.815809 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34724ffe-a3be-443d-987c-0a0c98fe7e80 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:54.816661 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34724ffe-a3be-443d-987c-0a0c98fe7e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:54.827526 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019bda7-d02a-4e0a-b240-dd0e1a5945bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:54.828154 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019bda7-d02a-4e0a-b240-dd0e1a5945bf None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:54.828494 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019bda7-d02a-4e0a-b240-dd0e1a5945bf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:54.828771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019bda7-d02a-4e0a-b240-dd0e1a5945bf None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:54.829628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019bda7-d02a-4e0a-b240-dd0e1a5945bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:54.829945 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019bda7-d02a-4e0a-b240-dd0e1a5945bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:54.831368 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019bda7-d02a-4e0a-b240-dd0e1a5945bf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:54.834034 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-34724ffe-a3be-443d-987c-0a0c98fe7e80 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:54.835108 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-34724ffe-a3be-443d-987c-0a0c98fe7e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:54.843705 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 332/664] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:55:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:54.848855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019bda7-d02a-4e0a-b240-dd0e1a5945bf None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:54.908220 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 333/665] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:54.909139 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34724ffe-a3be-443d-987c-0a0c98fe7e80 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:54.960742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019bda7-d02a-4e0a-b240-dd0e1a5945bf None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:54.987442 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:54.996119 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b574b-c750-4d0f-a551-4c5b413906a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:54.996918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b574b-c750-4d0f-a551-4c5b413906a5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:54.997206 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b574b-c750-4d0f-a551-4c5b413906a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:54.997486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b574b-c750-4d0f-a551-4c5b413906a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:55.009455 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b574b-c750-4d0f-a551-4c5b413906a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:55.010692 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b574b-c750-4d0f-a551-4c5b413906a5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:55.026382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34724ffe-a3be-443d-987c-0a0c98fe7e80 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:55.027972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f13b574b-c750-4d0f-a551-4c5b413906a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:55.027972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:55.027972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:55.027972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:55.027972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:55.027972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:55.027972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:55.027972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:55.027972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:55.027972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:55.027972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:55.027972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:55.027972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:55.027972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:55.027972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:55.028853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:55.028853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:55.028853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:55.028853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:55.028853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:55.028853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:55.028853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:55.028853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:55.028853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:55.028853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:55.028853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:55.028853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:55.028853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:55.028853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:55.028853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:55.028853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:55.028853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:55.031107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:55.031107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:55.031107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:55.031107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:55.031107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 333/666] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:55.031107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b574b-c750-4d0f-a551-4c5b413906a5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:55.062999 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:55.066108 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7951b-e736-4037-9d7c-602af5d52ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:55.066861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7951b-e736-4037-9d7c-602af5d52ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:55.067156 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7951b-e736-4037-9d7c-602af5d52ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:55.067434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7951b-e736-4037-9d7c-602af5d52ee6 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:55.068307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7951b-e736-4037-9d7c-602af5d52ee6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:55.068633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7951b-e736-4037-9d7c-602af5d52ee6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:55.070062 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7951b-e736-4037-9d7c-602af5d52ee6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:55.091473 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 334/667] 10.222.0.73 () {56 vars in 1139 bytes} [Thu May 19 11:55:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:55.093014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7951b-e736-4037-9d7c-602af5d52ee6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:55.144778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b574b-c750-4d0f-a551-4c5b413906a5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:55.180525 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f59b12-5111-4998-af0b-07c4b831cc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:55.181165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f59b12-5111-4998-af0b-07c4b831cc96 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:55.181446 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f59b12-5111-4998-af0b-07c4b831cc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:55.181867 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f59b12-5111-4998-af0b-07c4b831cc96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:55.182536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f59b12-5111-4998-af0b-07c4b831cc96 None admin] RBAC: Adding query filter params (role.id=d21329f1cd364fba8b79529896e00f81, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=182c7bb48c184e9983c02ae86709e803) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:55.182847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f59b12-5111-4998-af0b-07c4b831cc96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:55.184286 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f59b12-5111-4998-af0b-07c4b831cc96 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:55.196093 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 334/668] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:55:55 2022] GET /identity/v3/role_assignments?user.id=182c7bb48c184e9983c02ae86709e803&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=d21329f1cd364fba8b79529896e00f81 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:55.196995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f59b12-5111-4998-af0b-07c4b831cc96 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:55.206941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7951b-e736-4037-9d7c-602af5d52ee6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:55.248156 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:55.260461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344d3d6-86c5-4075-9041-eec15a459b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:55.261675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344d3d6-86c5-4075-9041-eec15a459b9c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:55.262929 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344d3d6-86c5-4075-9041-eec15a459b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:55.263425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344d3d6-86c5-4075-9041-eec15a459b9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:55.280477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344d3d6-86c5-4075-9041-eec15a459b9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:55.292001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-8344d3d6-86c5-4075-9041-eec15a459b9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:55.292001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:55.292001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:55.292001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:55.292001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:55.292001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:55.292001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:55.292001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:55.292001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:55.292001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:55.292001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:55.292001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:55.292001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:55.292001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:55.292001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:55.292001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:55.293028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:55.293028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:55.293028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:55.293028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:55.293028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:55.293028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:55.293028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:55.293028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:55.293028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:55.293028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:55.293028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:55.293028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:55.293028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:55.293028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:55.293028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:55.293028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:55.293866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:55.293866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:55.293866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:55.293866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:55.293866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:55.293866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:55.293866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:55.293866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:55.293866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:55.293866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:55.293866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:55:55.293866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:55.297372 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 335/669] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:55:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:55.299128 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344d3d6-86c5-4075-9041-eec15a459b9c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:55.314141 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:55.324968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f59b12-5111-4998-af0b-07c4b831cc96 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:55.386429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18788527-1381-4430-b8c2-62b3195d7929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:55.390683 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18788527-1381-4430-b8c2-62b3195d7929 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:55.390683 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18788527-1381-4430-b8c2-62b3195d7929 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:55.390683 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18788527-1381-4430-b8c2-62b3195d7929 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:55.390683 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18788527-1381-4430-b8c2-62b3195d7929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:55.390683 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18788527-1381-4430-b8c2-62b3195d7929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:55.391590 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18788527-1381-4430-b8c2-62b3195d7929 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:55.407012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 335/670] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:55.409247 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18788527-1381-4430-b8c2-62b3195d7929 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:55.452615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344d3d6-86c5-4075-9041-eec15a459b9c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:55.499971 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9776-d423-44c5-a742-142dead44b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:55.501308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9776-d423-44c5-a742-142dead44b17 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:55.501308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9776-d423-44c5-a742-142dead44b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:55.501308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9776-d423-44c5-a742-142dead44b17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:55.538149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18788527-1381-4430-b8c2-62b3195d7929 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:55.574319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:55.583730 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca9ce1-dc3c-4e7c-9c82-62df2f3a119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:55.584868 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca9ce1-dc3c-4e7c-9c82-62df2f3a119a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:55.585156 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca9ce1-dc3c-4e7c-9c82-62df2f3a119a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:55.585597 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca9ce1-dc3c-4e7c-9c82-62df2f3a119a None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:55.586510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca9ce1-dc3c-4e7c-9c82-62df2f3a119a None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:55.586825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca9ce1-dc3c-4e7c-9c82-62df2f3a119a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:55.588333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca9ce1-dc3c-4e7c-9c82-62df2f3a119a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:55.592290 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb9776-d423-44c5-a742-142dead44b17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:55.594318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb9776-d423-44c5-a742-142dead44b17 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:55.600795 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 336/671] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:55:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:55.601714 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca9ce1-dc3c-4e7c-9c82-62df2f3a119a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:55.631341 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:55.712309 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 336/672] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:55.713587 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9776-d423-44c5-a742-142dead44b17 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:55.748531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca9ce1-dc3c-4e7c-9c82-62df2f3a119a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:55.786449 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a2466-df7d-414e-b519-d389150ef6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:55.787282 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a2466-df7d-414e-b519-d389150ef6ae None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:55.787554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a2466-df7d-414e-b519-d389150ef6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:55.787836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a2466-df7d-414e-b519-d389150ef6ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:55.795704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a2466-df7d-414e-b519-d389150ef6ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:55.797200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a2466-df7d-414e-b519-d389150ef6ae None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:55.805745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:55.812126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-285a2466-df7d-414e-b519-d389150ef6ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:55.812126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:55.812126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:55.812126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:55.812126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:55.812126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:55.812126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:55.812126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:55.812126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:55.812126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:55.812126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:55.812126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:55.812126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:55.812126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:55.812126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:55.813095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:55.813095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:55.813095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:55.813095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:55.813095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:55.813095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:55.813095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:55.813095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:55.813095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:55.813095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:55.813095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:55.813095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:55.813095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:55.813095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:55.813095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:55.813095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:55.813095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:55.814008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:55.814008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:55.814008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:55.814008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:55.814008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:55.814008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:55.814008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:55.814008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:55.814008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 337/673] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:55.814946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a2466-df7d-414e-b519-d389150ef6ae None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:55.821841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9776-d423-44c5-a742-142dead44b17 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:55.860214 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d6852-a6bd-4116-b17d-faf97145336e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:55.861414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d6852-a6bd-4116-b17d-faf97145336e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:55.861699 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d6852-a6bd-4116-b17d-faf97145336e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:55.861977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d6852-a6bd-4116-b17d-faf97145336e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:55.873056 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d6852-a6bd-4116-b17d-faf97145336e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:55.874509 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d6852-a6bd-4116-b17d-faf97145336e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:55.894005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-ab2d6852-a6bd-4116-b17d-faf97145336e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:55.894005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:55.894005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:55.894005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:55.894005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:55.894005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:55.894005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:55.894005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:55.894005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:55.894005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:55.894005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:55.894005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:55.894005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:55.894005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:55.894005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:55.894951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:55.894951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:55.894951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:55.894951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:55.894951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:55.894951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:55.894951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:55.894951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:55.894951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:55.894951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:55.894951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:55.894951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:55.894951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:55.894951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:55.894951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:55.894951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:55.894951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:55.895830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:55.895830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:55.895830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:55.895830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:55.897441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:55.899716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 337/674] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:55.901090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1584c-a056-4652-a5a6-212778919821 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:55.901391 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1584c-a056-4652-a5a6-212778919821 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:55.901676 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1584c-a056-4652-a5a6-212778919821 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:55.906909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 338/675] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:55.906909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1584c-a056-4652-a5a6-212778919821 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:55.929605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a2466-df7d-414e-b519-d389150ef6ae None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:55.964674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb491cdd-238e-4d71-b627-86def81dc065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:55.965491 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb491cdd-238e-4d71-b627-86def81dc065 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:55.965775 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb491cdd-238e-4d71-b627-86def81dc065 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:55.966051 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb491cdd-238e-4d71-b627-86def81dc065 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:55.977192 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb491cdd-238e-4d71-b627-86def81dc065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:55.978453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb491cdd-238e-4d71-b627-86def81dc065 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:55.995770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-bb491cdd-238e-4d71-b627-86def81dc065 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:55.995770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:55.995770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:55.995770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:55.995770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:55.995770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:55.995770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:55.995770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:55.995770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:55.995770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:55.995770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:55.995770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:55.995770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:55.995770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:55.995770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:55.996704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:55.996704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:55.996704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:55.996704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:55.996704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:55.996704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:55.996704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:55.996704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:55.996704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:55.996704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:55.996704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:55.996704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:55.996704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:55.996704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:55.996704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:55.996704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:55.996704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:55.997599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:55.997599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:55.997599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:55.997599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:55.997599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 338/676] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:55.997877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb491cdd-238e-4d71-b627-86def81dc065 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:56.020785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1584c-a056-4652-a5a6-212778919821 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:56.057074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfa9a5-5c23-48ce-b0c2-04efeef7956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:56.058693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfa9a5-5c23-48ce-b0c2-04efeef7956d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:56.059049 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfa9a5-5c23-48ce-b0c2-04efeef7956d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:56.059327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfa9a5-5c23-48ce-b0c2-04efeef7956d None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:56.060143 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bfa9a5-5c23-48ce-b0c2-04efeef7956d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:56.060458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bfa9a5-5c23-48ce-b0c2-04efeef7956d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:56.062156 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bfa9a5-5c23-48ce-b0c2-04efeef7956d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:56.070176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:56.075977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 339/677] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:55:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:56.077204 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21afa21-8c77-4ce1-b8d8-d4b5818ae013 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:56.077493 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21afa21-8c77-4ce1-b8d8-d4b5818ae013 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:56.077774 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21afa21-8c77-4ce1-b8d8-d4b5818ae013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:56.095246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b21afa21-8c77-4ce1-b8d8-d4b5818ae013 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:56.096453 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b21afa21-8c77-4ce1-b8d8-d4b5818ae013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:56.107293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb491cdd-238e-4d71-b627-86def81dc065 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:56.133755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:56.145727 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac937f-7921-475e-bf74-51cdf08c9eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:56.146456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac937f-7921-475e-bf74-51cdf08c9eed None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:56.146739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac937f-7921-475e-bf74-51cdf08c9eed None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:56.147014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac937f-7921-475e-bf74-51cdf08c9eed None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:56.147747 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac937f-7921-475e-bf74-51cdf08c9eed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:56.148087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac937f-7921-475e-bf74-51cdf08c9eed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:56.149453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac937f-7921-475e-bf74-51cdf08c9eed None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:56.165235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 339/678] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:56.165235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac937f-7921-475e-bf74-51cdf08c9eed None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:56.175217 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 340/679] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:56.176158 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21afa21-8c77-4ce1-b8d8-d4b5818ae013 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:56.285345 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21afa21-8c77-4ce1-b8d8-d4b5818ae013 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:56.287817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac937f-7921-475e-bf74-51cdf08c9eed None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:56.314921 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:56.324152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9b2e2-f3ed-4517-9cb5-da517a86e2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:56.324812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9b2e2-f3ed-4517-9cb5-da517a86e2ff None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:56.324991 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980afa3-412e-482b-8859-e29e9115acea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:56.325121 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9b2e2-f3ed-4517-9cb5-da517a86e2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:56.325363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9b2e2-f3ed-4517-9cb5-da517a86e2ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:56.325648 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980afa3-412e-482b-8859-e29e9115acea None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:56.325931 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980afa3-412e-482b-8859-e29e9115acea None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:56.326194 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9b2e2-f3ed-4517-9cb5-da517a86e2ff None admin] RBAC: Adding query filter params (role.id=d21329f1cd364fba8b79529896e00f81, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=a44bb5fc455a4965ac6904fb548530f2) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:56.326288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980afa3-412e-482b-8859-e29e9115acea None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:56.326507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9b2e2-f3ed-4517-9cb5-da517a86e2ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:56.326910 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980afa3-412e-482b-8859-e29e9115acea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:56.327218 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980afa3-412e-482b-8859-e29e9115acea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:56.327933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9b2e2-f3ed-4517-9cb5-da517a86e2ff None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:56.328624 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980afa3-412e-482b-8859-e29e9115acea None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:56.341750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 341/680] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:55:56 2022] GET /identity/v3/role_assignments?user.id=a44bb5fc455a4965ac6904fb548530f2&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=d21329f1cd364fba8b79529896e00f81 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:56.341750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9b2e2-f3ed-4517-9cb5-da517a86e2ff None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:56.342040 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 340/681] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:56.342867 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980afa3-412e-482b-8859-e29e9115acea None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:56.416545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:56.481297 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980afa3-412e-482b-8859-e29e9115acea None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:56.491121 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9b2e2-f3ed-4517-9cb5-da517a86e2ff None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:56.521744 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cf8b2-2775-42ce-90de-e6cd85b25aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:56.522561 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cf8b2-2775-42ce-90de-e6cd85b25aed None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:56.522834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cf8b2-2775-42ce-90de-e6cd85b25aed None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:56.523107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cf8b2-2775-42ce-90de-e6cd85b25aed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:56.535495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cf8b2-2775-42ce-90de-e6cd85b25aed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:55:56.538429 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56369430-d198-412a-95f4-ea480deb49f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:56.539358 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56369430-d198-412a-95f4-ea480deb49f4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:56.539757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56369430-d198-412a-95f4-ea480deb49f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:56.540163 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56369430-d198-412a-95f4-ea480deb49f4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:56.543468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-162cf8b2-2775-42ce-90de-e6cd85b25aed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:56.543468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:56.543468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:56.543468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:56.543468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:56.543468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:56.543468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:56.543468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:56.543468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:56.543468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:56.543468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:56.543468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:56.543468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:55:56.543468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:55:56.543468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:55:56.543468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:55:56.544474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:55:56.544474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:55:56.544474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:55:56.544474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:55:56.544474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:56.544474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:56.544474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:56.544474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:56.544474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:56.544474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:56.544474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:56.544474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:56.544474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:56.544474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:56.544474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:56.544474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:56.545570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:56.545570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:56.545570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:56.545570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:56.545570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:55:56.545570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:55:56.545570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:55:56.545570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:55:56.545570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:55:56.545570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:55:56.545570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:55:56.545570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:56.545570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 341/682] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:55:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:56.546288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cf8b2-2775-42ce-90de-e6cd85b25aed None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:56.552779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56369430-d198-412a-95f4-ea480deb49f4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:56.556144 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56369430-d198-412a-95f4-ea480deb49f4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:56.577481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-56369430-d198-412a-95f4-ea480deb49f4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:55:56.577481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:56.577481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:56.577481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:56.577481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:56.577481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:56.577481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:56.577481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:56.577481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:56.577481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:56.577481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:56.577481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:56.577481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:56.577481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:56.577481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:56.577481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:56.578454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:56.579942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:56.579942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:56.579942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:56.579942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:56.579942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:56.579942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:56.579942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:56.579942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:56.579942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:55:56.579942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:56.585121 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 342/683] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:55:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:56.585121 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56369430-d198-412a-95f4-ea480deb49f4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:56.654080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:56.688147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cf8b2-2775-42ce-90de-e6cd85b25aed None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:56.697657 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:56.712231 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56369430-d198-412a-95f4-ea480deb49f4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:56.735674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2baa8-5a43-42ea-83a4-e3d41decbe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:56.737163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2baa8-5a43-42ea-83a4-e3d41decbe41 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:56.737454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2baa8-5a43-42ea-83a4-e3d41decbe41 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:56.737995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2baa8-5a43-42ea-83a4-e3d41decbe41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:56.747121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2baa8-5a43-42ea-83a4-e3d41decbe41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:56.747726 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459db72-e7ec-4b29-ab01-59d103f8dfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:56.748446 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459db72-e7ec-4b29-ab01-59d103f8dfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:56.748577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2baa8-5a43-42ea-83a4-e3d41decbe41 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:56.748737 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459db72-e7ec-4b29-ab01-59d103f8dfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:56.749015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459db72-e7ec-4b29-ab01-59d103f8dfd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:56.749772 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459db72-e7ec-4b29-ab01-59d103f8dfd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:56.750085 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459db72-e7ec-4b29-ab01-59d103f8dfd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:56.751998 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459db72-e7ec-4b29-ab01-59d103f8dfd1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:56.761010 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 343/684] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:55:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:56.761824 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459db72-e7ec-4b29-ab01-59d103f8dfd1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:56.767207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-6ae2baa8-5a43-42ea-83a4-e3d41decbe41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:56.767207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:56.767207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:56.767207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:56.767207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:56.767207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:56.767207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:56.767207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:56.767207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:56.767207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:56.767207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:56.767207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:56.767207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:56.767207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:56.767207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:56.768126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:56.768126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:56.768126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:56.768126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:56.768126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:56.768126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:56.768126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:56.768126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:56.768126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:56.768126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:56.768126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:56.768126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:56.768126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:56.768126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:56.768126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:56.768126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:56.768126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:56.768995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:56.768995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:56.768995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:56.768995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:56.768995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:56.768995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:56.768995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:56.768995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:56.768995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 342/685] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:56.769485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2baa8-5a43-42ea-83a4-e3d41decbe41 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:56.878012 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459db72-e7ec-4b29-ab01-59d103f8dfd1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:56.893438 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:56.910406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2baa8-5a43-42ea-83a4-e3d41decbe41 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:56.923270 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07500d7-cac5-478c-b866-7fd1eed9e9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:56.924369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07500d7-cac5-478c-b866-7fd1eed9e9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:56.925173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07500d7-cac5-478c-b866-7fd1eed9e9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:56.926210 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07500d7-cac5-478c-b866-7fd1eed9e9d6 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:56.927585 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07500d7-cac5-478c-b866-7fd1eed9e9d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:56.928150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07500d7-cac5-478c-b866-7fd1eed9e9d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:56.930448 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07500d7-cac5-478c-b866-7fd1eed9e9d6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:56.948008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d3a0a-e3de-455c-8424-e930db422bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:56.948734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d3a0a-e3de-455c-8424-e930db422bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:56.949022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d3a0a-e3de-455c-8424-e930db422bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:56.949299 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d3a0a-e3de-455c-8424-e930db422bd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:56.955980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 344/686] 10.222.0.73 () {56 vars in 1135 bytes} [Thu May 19 11:55:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:56.957102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07500d7-cac5-478c-b866-7fd1eed9e9d6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:56.967523 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d3a0a-e3de-455c-8424-e930db422bd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:56.969095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d3a0a-e3de-455c-8424-e930db422bd1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:56.986909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-d07d3a0a-e3de-455c-8424-e930db422bd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:56.986909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:56.986909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:56.986909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:56.986909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:56.986909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:56.986909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:56.986909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:56.986909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:56.986909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:56.986909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:56.986909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:56.986909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:56.986909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:56.986909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:56.988029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:56.988029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:56.988029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:56.988029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:56.988029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:56.988029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:56.988029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:56.988029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:56.988029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:56.988029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:56.988029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:56.988029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:56.988029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:56.988029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:56.988029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:56.988029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:56.988029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:56.988917 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:56.988917 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:56.988917 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:56.988917 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:56.993169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 343/687] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:56.994070 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d3a0a-e3de-455c-8424-e930db422bd1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:57.016065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:57.087031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07500d7-cac5-478c-b866-7fd1eed9e9d6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:57.104074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d3a0a-e3de-455c-8424-e930db422bd1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:57.132874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fb9c3-acd2-45a5-8b9a-a788121c05c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:57.134224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fb9c3-acd2-45a5-8b9a-a788121c05c9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:57.134696 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fb9c3-acd2-45a5-8b9a-a788121c05c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:57.135395 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fb9c3-acd2-45a5-8b9a-a788121c05c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:57.136382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fb9c3-acd2-45a5-8b9a-a788121c05c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:57.136969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fb9c3-acd2-45a5-8b9a-a788121c05c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:57.139142 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fb9c3-acd2-45a5-8b9a-a788121c05c9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:57.142577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a525f-fb3a-4294-9000-3a05d93b0048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:57.143354 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a525f-fb3a-4294-9000-3a05d93b0048 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:57.143738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a525f-fb3a-4294-9000-3a05d93b0048 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:57.144149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a525f-fb3a-4294-9000-3a05d93b0048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:57.158078 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 345/688] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:55:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:57.158078 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fb9c3-acd2-45a5-8b9a-a788121c05c9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:57.196571 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:57.238336 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a525f-fb3a-4294-9000-3a05d93b0048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:57.241104 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a525f-fb3a-4294-9000-3a05d93b0048 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:57.264114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:57.274478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fb9c3-acd2-45a5-8b9a-a788121c05c9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:57.315892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee7657-2be5-46ec-a22b-5abdccdc646d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:57.317089 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee7657-2be5-46ec-a22b-5abdccdc646d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:57.317855 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee7657-2be5-46ec-a22b-5abdccdc646d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:57.318600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee7657-2be5-46ec-a22b-5abdccdc646d None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:57.319545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee7657-2be5-46ec-a22b-5abdccdc646d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:57.320102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee7657-2be5-46ec-a22b-5abdccdc646d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:57.322343 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee7657-2be5-46ec-a22b-5abdccdc646d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:57.337431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 346/689] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:57.338600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee7657-2be5-46ec-a22b-5abdccdc646d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:57.377270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 344/690] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:57.378324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a525f-fb3a-4294-9000-3a05d93b0048 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:57.460515 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:57.472303 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee7657-2be5-46ec-a22b-5abdccdc646d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:57.491283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a525f-fb3a-4294-9000-3a05d93b0048 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:57.510492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:57.514952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c73f3-92aa-4bf7-804c-19cafc408834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:57.516384 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c73f3-92aa-4bf7-804c-19cafc408834 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:57.517171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c73f3-92aa-4bf7-804c-19cafc408834 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:57.517669 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c73f3-92aa-4bf7-804c-19cafc408834 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:57.519183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c73f3-92aa-4bf7-804c-19cafc408834 None admin] RBAC: Adding query filter params (role.id=d21329f1cd364fba8b79529896e00f81, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=4897919923a64881ac5540cc5d58df1c) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:57.519851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c73f3-92aa-4bf7-804c-19cafc408834 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:57.521762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c73f3-92aa-4bf7-804c-19cafc408834 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:57.534273 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43dccd-90a2-46bf-a2cb-1033fec119ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:57.534273 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43dccd-90a2-46bf-a2cb-1033fec119ba None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:57.534273 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43dccd-90a2-46bf-a2cb-1033fec119ba None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:57.534273 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43dccd-90a2-46bf-a2cb-1033fec119ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:57.534970 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 347/691] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:55:57 2022] GET /identity/v3/role_assignments?user.id=4897919923a64881ac5540cc5d58df1c&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=d21329f1cd364fba8b79529896e00f81 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:57.536631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c73f3-92aa-4bf7-804c-19cafc408834 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:57.547278 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43dccd-90a2-46bf-a2cb-1033fec119ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:57.549448 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43dccd-90a2-46bf-a2cb-1033fec119ba None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:57.566099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-6e43dccd-90a2-46bf-a2cb-1033fec119ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:55:57.566099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:57.566099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:57.566099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:57.566099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:57.566099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:57.566099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:57.566099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:57.566099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:57.566099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:57.566099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:57.566099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:57.566099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:55:57.566099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:55:57.566099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:55:57.566099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:57.567430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:57.568490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:57.568490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:57.568490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:55:57.568490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:55:57.568490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:55:57.568490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:55:57.568490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:55:57.568490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:55:57.568490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:55:57.568490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:57.568490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 345/692] 10.222.0.73 () {56 vars in 1093 bytes} [Thu May 19 11:55:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:57.569294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43447d5c-9af5-4b43-938c-180a5b1264b1 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:57.569583 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43447d5c-9af5-4b43-938c-180a5b1264b1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:57.569858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43447d5c-9af5-4b43-938c-180a5b1264b1 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:57.575903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 346/693] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:57.576920 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43447d5c-9af5-4b43-938c-180a5b1264b1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:57.662796 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c73f3-92aa-4bf7-804c-19cafc408834 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:57.704406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43447d5c-9af5-4b43-938c-180a5b1264b1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:57.705840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7e368-4f5d-4b6f-a599-50b40c68c158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:57.706829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7e368-4f5d-4b6f-a599-50b40c68c158 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:57.707266 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7e368-4f5d-4b6f-a599-50b40c68c158 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:57.707715 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7e368-4f5d-4b6f-a599-50b40c68c158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:57.748702 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52653a2-e4f7-4b79-b118-1ea43644374c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:57.749322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52653a2-e4f7-4b79-b118-1ea43644374c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:57.749609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52653a2-e4f7-4b79-b118-1ea43644374c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:57.749878 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52653a2-e4f7-4b79-b118-1ea43644374c None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:57.750774 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52653a2-e4f7-4b79-b118-1ea43644374c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:57.751089 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52653a2-e4f7-4b79-b118-1ea43644374c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:57.752584 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52653a2-e4f7-4b79-b118-1ea43644374c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:57.775184 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 347/694] 10.222.0.73 () {56 vars in 1133 bytes} [Thu May 19 11:55:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:57.776737 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e40d75-e8a3-4fe3-ad44-95e4e1ce3e33 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:57.777039 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e40d75-e8a3-4fe3-ad44-95e4e1ce3e33 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:57.777326 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e40d75-e8a3-4fe3-ad44-95e4e1ce3e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:57.796452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-72e40d75-e8a3-4fe3-ad44-95e4e1ce3e33 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:57.798323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-72e40d75-e8a3-4fe3-ad44-95e4e1ce3e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:57.833011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:57.848656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7e368-4f5d-4b6f-a599-50b40c68c158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:57.850122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7e368-4f5d-4b6f-a599-50b40c68c158 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:57.871195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-acb7e368-4f5d-4b6f-a599-50b40c68c158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:57.871195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:57.871195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:57.871195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:57.871195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:57.871195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:57.871195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:57.871195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:57.871195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:57.871195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:57.871195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:57.871195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:57.871195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:57.871195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:57.871195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:57.872176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:57.872176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:57.872176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:57.872176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:57.872176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:57.872176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:57.872176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:57.872176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:57.872176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:57.872176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:57.872176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:57.872176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:57.872176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:57.872176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:57.872176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:57.872176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:57.872176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:57.873319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:57.873319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:57.873319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:57.873319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:57.873319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 348/695] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:57.873927 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7e368-4f5d-4b6f-a599-50b40c68c158 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:57.882504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 348/696] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:57.884071 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e40d75-e8a3-4fe3-ad44-95e4e1ce3e33 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:57.885226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:57.995113 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7e368-4f5d-4b6f-a599-50b40c68c158 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:58.011736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e40d75-e8a3-4fe3-ad44-95e4e1ce3e33 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:58.034151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06325c06-8a60-4e93-8b8e-ff83f67c9e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:58.035177 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06325c06-8a60-4e93-8b8e-ff83f67c9e46 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:58.035673 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06325c06-8a60-4e93-8b8e-ff83f67c9e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:58.036183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06325c06-8a60-4e93-8b8e-ff83f67c9e46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:58.049154 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0dea6-000f-4038-b7e4-04f8379f531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:58.049827 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0dea6-000f-4038-b7e4-04f8379f531b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:58.050112 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0dea6-000f-4038-b7e4-04f8379f531b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:58.050387 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0dea6-000f-4038-b7e4-04f8379f531b None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:58.051386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0dea6-000f-4038-b7e4-04f8379f531b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:58.051567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0dea6-000f-4038-b7e4-04f8379f531b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:58.052948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0dea6-000f-4038-b7e4-04f8379f531b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:58.065544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 349/697] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:58.066553 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0dea6-000f-4038-b7e4-04f8379f531b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:58.097784 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:58.125343 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06325c06-8a60-4e93-8b8e-ff83f67c9e46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:58.127551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06325c06-8a60-4e93-8b8e-ff83f67c9e46 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:58.138817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:58.181942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0dea6-000f-4038-b7e4-04f8379f531b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:58.226604 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47288a58-20a0-4aea-a0fd-ee9abfa7c9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:58.228064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47288a58-20a0-4aea-a0fd-ee9abfa7c9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:58.228558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47288a58-20a0-4aea-a0fd-ee9abfa7c9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:58.229181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47288a58-20a0-4aea-a0fd-ee9abfa7c9e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:58.244321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47288a58-20a0-4aea-a0fd-ee9abfa7c9e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:58.246144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47288a58-20a0-4aea-a0fd-ee9abfa7c9e8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:58.246417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 349/698] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:55:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:55:58.247659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06325c06-8a60-4e93-8b8e-ff83f67c9e46 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:58.278499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-47288a58-20a0-4aea-a0fd-ee9abfa7c9e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:58.278499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:58.278499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:58.278499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:58.278499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:58.278499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:58.278499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:58.278499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:58.278499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:58.278499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:58.278499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:58.278499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:58.278499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:58.278499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:58.278499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:58.279416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:58.279416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:58.279416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:58.279416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:58.279416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:58.279416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:58.279416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:58.279416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:58.279416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:58.279416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:58.279416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:58.279416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:58.279416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:58.279416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:58.279416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:58.279416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:58.279416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:58.280323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:58.280323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:58.280323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:58.280323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:58.285894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 350/699] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:58.285894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47288a58-20a0-4aea-a0fd-ee9abfa7c9e8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:58.367100 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06325c06-8a60-4e93-8b8e-ff83f67c9e46 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:58.386926 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:58.402265 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:58.430389 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee9d14-669e-466b-ad9a-e7c6079b270c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:58.431823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee9d14-669e-466b-ad9a-e7c6079b270c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:58.432708 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee9d14-669e-466b-ad9a-e7c6079b270c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:58.433426 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee9d14-669e-466b-ad9a-e7c6079b270c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:58.435118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47288a58-20a0-4aea-a0fd-ee9abfa7c9e8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:58.442911 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee9d14-669e-466b-ad9a-e7c6079b270c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:58.445246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee9d14-669e-466b-ad9a-e7c6079b270c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:58.467451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-e4ee9d14-669e-466b-ad9a-e7c6079b270c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:58.467451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:58.467451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:58.467451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:58.467451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:58.467451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:58.467451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:58.467451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:58.467451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:58.467451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:58.467451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:58.467451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:58.467451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:58.467451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:58.467451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:58.468444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:58.468444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:58.468444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:58.468444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:58.468444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:58.468444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:58.468444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:58.468444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:58.468444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:58.468444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:58.468444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:58.468444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:58.468444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:58.468444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:58.468444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:58.468444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:58.468444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:58.469317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:58.469317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:58.469317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:58.469317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:58.469317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:58.469317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:58.469317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:58.469317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:58.472405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 350/700] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:58.473435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee9d14-669e-466b-ad9a-e7c6079b270c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:58.481032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acd8c4-ab5c-4951-91fa-9d452b6a1283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:58.482247 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acd8c4-ab5c-4951-91fa-9d452b6a1283 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:58.482604 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acd8c4-ab5c-4951-91fa-9d452b6a1283 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:58.482952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acd8c4-ab5c-4951-91fa-9d452b6a1283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:58.496634 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acd8c4-ab5c-4951-91fa-9d452b6a1283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:58.498425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acd8c4-ab5c-4951-91fa-9d452b6a1283 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:58.519495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-36acd8c4-ab5c-4951-91fa-9d452b6a1283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:58.519495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:58.519495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:58.519495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:58.519495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:58.519495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:58.519495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:58.519495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:58.519495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:58.519495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:58.519495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:58.519495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:58.519495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:55:58.519495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:55:58.519495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:55:58.520721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:55:58.520721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:58.520721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:58.520721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:58.520721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:58.520721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:58.520721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:58.520721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:58.520721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:58.520721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:58.520721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:58.520721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:58.520721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:58.520721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:58.520721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:58.520721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:58.520721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:58.521752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:55:58.521752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:55:58.521752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:55:58.521752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:58.521990 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 351/701] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:58.522839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acd8c4-ab5c-4951-91fa-9d452b6a1283 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:58.615735 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee9d14-669e-466b-ad9a-e7c6079b270c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:58.648670 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acd8c4-ab5c-4951-91fa-9d452b6a1283 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:58.662732 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd2a5c-2a1f-4b60-b088-dd73397c86e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:58.664167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd2a5c-2a1f-4b60-b088-dd73397c86e7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:58.664875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd2a5c-2a1f-4b60-b088-dd73397c86e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:58.665306 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd2a5c-2a1f-4b60-b088-dd73397c86e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:58.666444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd2a5c-2a1f-4b60-b088-dd73397c86e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:58.667275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd2a5c-2a1f-4b60-b088-dd73397c86e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:58.669118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd2a5c-2a1f-4b60-b088-dd73397c86e7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:58.680468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:58.689157 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c9825-9ebb-4d3f-8640-49558c7992e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:58.689828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c9825-9ebb-4d3f-8640-49558c7992e8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:58.690149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c9825-9ebb-4d3f-8640-49558c7992e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:58.694539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c9825-9ebb-4d3f-8640-49558c7992e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:58.694539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c9825-9ebb-4d3f-8640-49558c7992e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:58.694539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c9825-9ebb-4d3f-8640-49558c7992e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:58.694539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c9825-9ebb-4d3f-8640-49558c7992e8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:58.695560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 351/702] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:58.697635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd2a5c-2a1f-4b60-b088-dd73397c86e7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:58.713223 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 352/703] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:55:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:58.714114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c9825-9ebb-4d3f-8640-49558c7992e8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:58.732933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:58.821102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd2a5c-2a1f-4b60-b088-dd73397c86e7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:58.838660 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c9825-9ebb-4d3f-8640-49558c7992e8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:58.861035 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3375d-09c7-4f10-a7da-446b7d3dd078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:58.861716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3375d-09c7-4f10-a7da-446b7d3dd078 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:58.861999 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3375d-09c7-4f10-a7da-446b7d3dd078 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:58.862276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3375d-09c7-4f10-a7da-446b7d3dd078 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:58.863045 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3375d-09c7-4f10-a7da-446b7d3dd078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:58.863328 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3375d-09c7-4f10-a7da-446b7d3dd078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:58.864912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3375d-09c7-4f10-a7da-446b7d3dd078 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:58.880557 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 352/704] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:58.881812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3375d-09c7-4f10-a7da-446b7d3dd078 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:58.885679 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9fcea-89d9-44dc-9285-6b7e632d9eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:58.886370 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9fcea-89d9-44dc-9285-6b7e632d9eae None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:58.886709 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9fcea-89d9-44dc-9285-6b7e632d9eae None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:58.886989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9fcea-89d9-44dc-9285-6b7e632d9eae None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:58.887712 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9fcea-89d9-44dc-9285-6b7e632d9eae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:58.889178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9fcea-89d9-44dc-9285-6b7e632d9eae None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:58.912143 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 353/705] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:55:58 2022] POST /identity/v3/users => generated 254 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:55:58.913294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bf1d3-e9e1-4dae-a692-9e03eda19f87 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:58.913657 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bf1d3-e9e1-4dae-a692-9e03eda19f87 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:58.913920 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bf1d3-e9e1-4dae-a692-9e03eda19f87 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:58.919634 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 354/706] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:55:58.919634 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bf1d3-e9e1-4dae-a692-9e03eda19f87 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:58.977047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:59.026951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:59.041420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3375d-09c7-4f10-a7da-446b7d3dd078 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:59.043969 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bf1d3-e9e1-4dae-a692-9e03eda19f87 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:59.082372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab9e12-d025-461b-b980-1cfac21e22bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:59.083365 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab9e12-d025-461b-b980-1cfac21e22bc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:59.083789 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab9e12-d025-461b-b980-1cfac21e22bc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:59.084255 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab9e12-d025-461b-b980-1cfac21e22bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:59.087968 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8690d-b4c4-4101-987b-9c70fa165ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:59.088984 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8690d-b4c4-4101-987b-9c70fa165ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:59.089448 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8690d-b4c4-4101-987b-9c70fa165ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:59.089898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8690d-b4c4-4101-987b-9c70fa165ca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:59.090922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8690d-b4c4-4101-987b-9c70fa165ca2 None admin] RBAC: Adding query filter params (role.id=d21329f1cd364fba8b79529896e00f81, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=371dae58e95d403b97e311c6616adab5) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:59.091426 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8690d-b4c4-4101-987b-9c70fa165ca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:59.093179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab9e12-d025-461b-b980-1cfac21e22bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:59.093558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8690d-b4c4-4101-987b-9c70fa165ca2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:59.095365 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab9e12-d025-461b-b980-1cfac21e22bc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:59.108614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 353/707] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:55:58 2022] GET /identity/v3/role_assignments?user.id=371dae58e95d403b97e311c6616adab5&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=d21329f1cd364fba8b79529896e00f81 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:59.111580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ea4a2-a18e-47cf-8753-53c8d1635eb7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:59.112142 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ea4a2-a18e-47cf-8753-53c8d1635eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:59.112749 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ea4a2-a18e-47cf-8753-53c8d1635eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:59.114389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-85ab9e12-d025-461b-b980-1cfac21e22bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:59.114389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:59.114389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:59.114389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:59.114389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:59.114389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:59.114389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:59.114389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:59.114389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:59.114389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:59.114389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:59.114389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:59.114389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:55:59.114389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:55:59.114389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:55:59.115239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:55:59.115239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:59.115239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:59.115239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:59.115239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:59.115239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:59.115239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:59.115239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:59.115239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:55:59.115239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:59.115239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:59.115239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:59.115239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:59.115239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:59.115239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:59.115239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:59.115239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:59.116131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:55:59.116131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:55:59.116131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:55:59.116131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:55:59.116131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:55:59.116131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:55:59.116131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:55:59.116131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:55:59.121686 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 355/708] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:55:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:55:59.122498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab9e12-d025-461b-b980-1cfac21e22bc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:59.151465 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2e8ea4a2-a18e-47cf-8753-53c8d1635eb7 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:55:59.152646 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2e8ea4a2-a18e-47cf-8753-53c8d1635eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:55:59.236923 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 354/709] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:55:59.243862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab9e12-d025-461b-b980-1cfac21e22bc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:59.252306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:59.264195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ea4a2-a18e-47cf-8753-53c8d1635eb7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:59.291229 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f5b49-dc34-44d3-b9df-b680f3238029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:59.292430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f5b49-dc34-44d3-b9df-b680f3238029 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:59.292979 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f5b49-dc34-44d3-b9df-b680f3238029 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:59.293464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f5b49-dc34-44d3-b9df-b680f3238029 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:59.294523 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f5b49-dc34-44d3-b9df-b680f3238029 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:59.295456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f5b49-dc34-44d3-b9df-b680f3238029 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:59.297182 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f5b49-dc34-44d3-b9df-b680f3238029 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:59.315603 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 356/710] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:55:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:59.319466 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f5b49-dc34-44d3-b9df-b680f3238029 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:59.377102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:59.400616 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ea4a2-a18e-47cf-8753-53c8d1635eb7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:59.444330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcbae9-1f4e-467c-a149-e7500a7ab904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:59.445475 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcbae9-1f4e-467c-a149-e7500a7ab904 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:59.445848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcbae9-1f4e-467c-a149-e7500a7ab904 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:59.446233 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcbae9-1f4e-467c-a149-e7500a7ab904 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:59.447135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcbae9-1f4e-467c-a149-e7500a7ab904 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:59.449301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcbae9-1f4e-467c-a149-e7500a7ab904 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:59.457821 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f5b49-dc34-44d3-b9df-b680f3238029 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:59.467055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-c9dcbae9-1f4e-467c-a149-e7500a7ab904 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:55:59.467055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:59.467055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:55:59.467055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:55:59.467055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:55:59.467055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:55:59.467055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:55:59.467055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:55:59.467055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:55:59.467055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:59.467055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:55:59.467055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:59.467055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:55:59.467055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:55:59.467055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:55:59.467055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:55:59.468140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:55:59.468140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:55:59.468140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:55:59.468140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:55:59.468140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:55:59.468140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:55:59.468140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:55:59.468140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:55:59.468140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:55:59.468140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:55:59.468140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:55:59.468140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:55:59.468140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:55:59.468140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:55:59.468140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:55:59.468140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:55:59.469031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:55:59.469031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:55:59.469031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:55:59.469031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:55:59.469031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:55:59.469031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:55:59.469031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:55:59.469031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:55:59.469031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:55:59.469031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:55:59.469031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:55:59.469031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:55:59.469031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:55:59.469031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:55:59.469031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:55:59.471991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 355/711] 10.222.0.73 () {56 vars in 1129 bytes} [Thu May 19 11:55:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:55:59.476831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcbae9-1f4e-467c-a149-e7500a7ab904 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:59.506373 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448b7e0-e578-44c2-82c9-9216e45ccf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:59.507412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448b7e0-e578-44c2-82c9-9216e45ccf17 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:59.507906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448b7e0-e578-44c2-82c9-9216e45ccf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:59.508552 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448b7e0-e578-44c2-82c9-9216e45ccf17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:59.509918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448b7e0-e578-44c2-82c9-9216e45ccf17 None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=bd0c1f0710f3447d94e67048a508781e) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:59.510524 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448b7e0-e578-44c2-82c9-9216e45ccf17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:59.512280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448b7e0-e578-44c2-82c9-9216e45ccf17 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:59.524047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 357/712] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:55:59 2022] GET /identity/v3/role_assignments?user.id=bd0c1f0710f3447d94e67048a508781e&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:55:59.593979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcbae9-1f4e-467c-a149-e7500a7ab904 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:59.641664 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50185d-4703-472d-ac73-aa89a51260b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:59.642366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50185d-4703-472d-ac73-aa89a51260b0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:59.642652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50185d-4703-472d-ac73-aa89a51260b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:59.642930 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50185d-4703-472d-ac73-aa89a51260b0 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:59.643659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50185d-4703-472d-ac73-aa89a51260b0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:59.644035 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50185d-4703-472d-ac73-aa89a51260b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:59.645432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50185d-4703-472d-ac73-aa89a51260b0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:59.651155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 356/713] 10.222.0.73 () {56 vars in 1124 bytes} [Thu May 19 11:55:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:55:59.656738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448b7e0-e578-44c2-82c9-9216e45ccf17 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:55:59.698857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:55:59.778811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448b7e0-e578-44c2-82c9-9216e45ccf17 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:55:59.814491 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc03c7f-42d8-422a-9ecd-62f279478a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:55:59.815167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc03c7f-42d8-422a-9ecd-62f279478a24 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:55:59.815451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc03c7f-42d8-422a-9ecd-62f279478a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:55:59.815729 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc03c7f-42d8-422a-9ecd-62f279478a24 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:55:59.816483 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc03c7f-42d8-422a-9ecd-62f279478a24 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:55:59.816796 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc03c7f-42d8-422a-9ecd-62f279478a24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:55:59.818174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc03c7f-42d8-422a-9ecd-62f279478a24 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:55:59.824652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 358/714] 10.222.0.73 () {56 vars in 1124 bytes} [Thu May 19 11:55:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:00.119413 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0c00b-bcdd-44eb-a1be-71ba95e9e09c None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:00.119821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0c00b-bcdd-44eb-a1be-71ba95e9e09c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:00.120052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0c00b-bcdd-44eb-a1be-71ba95e9e09c None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:00.121681 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 357/715] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:00.127117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71f6d7-7009-488f-b91c-057af527c51e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:00.128086 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71f6d7-7009-488f-b91c-057af527c51e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:00.128607 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71f6d7-7009-488f-b91c-057af527c51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:00.153859 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-4b71f6d7-7009-488f-b91c-057af527c51e None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:00.155444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4b71f6d7-7009-488f-b91c-057af527c51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:00.243551 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 359/716] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:00.275523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0c00b-bcdd-44eb-a1be-71ba95e9e09c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:00.289638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:00.426712 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0c00b-bcdd-44eb-a1be-71ba95e9e09c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:00.479457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea28f9-128c-4bf6-ae6f-3c4392d703ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:00.480669 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea28f9-128c-4bf6-ae6f-3c4392d703ce None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:00.481195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea28f9-128c-4bf6-ae6f-3c4392d703ce None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:00.481683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea28f9-128c-4bf6-ae6f-3c4392d703ce None admin] PATH_INFO: `/v3/services/network` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:00.482545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea28f9-128c-4bf6-ae6f-3c4392d703ce None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:00.484158 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea28f9-128c-4bf6-ae6f-3c4392d703ce None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:00.499904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-55ea28f9-128c-4bf6-ae6f-3c4392d703ce None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:56:00.499904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:00.499904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:00.499904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:00.499904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:00.499904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:00.499904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:00.499904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:00.499904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:56:00.499904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:00.499904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:00.499904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:00.499904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:00.499904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:00.499904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:00.499904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:00.499904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:00.501060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:00.501060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:00.501060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:00.501060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:00.501060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:00.501060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:00.501060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:00.501060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:00.501060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:00.501060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:00.501060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:00.501060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:00.501060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:00.501060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:00.501060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:00.501060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:00.501919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:00.501919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:00.501919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:00.501919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:00.501919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:00.501919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:00.501919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:00.501919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:00.501919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:00.501919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:00.501919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:00.501919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:00.501919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:56:00.501919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:00.504442 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 358/717] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:00 2022] GET /identity/v3/services/network => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:00.510578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71f6d7-7009-488f-b91c-057af527c51e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:00.564939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:00.662060 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71f6d7-7009-488f-b91c-057af527c51e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:00.713520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7eb88-ec1e-48cb-b088-17bf05d9d2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:00.714208 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7eb88-ec1e-48cb-b088-17bf05d9d2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:00.714495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7eb88-ec1e-48cb-b088-17bf05d9d2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:00.714778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7eb88-ec1e-48cb-b088-17bf05d9d2a6 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:00.715502 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7eb88-ec1e-48cb-b088-17bf05d9d2a6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:00.715812 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7eb88-ec1e-48cb-b088-17bf05d9d2a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:00.717226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7eb88-ec1e-48cb-b088-17bf05d9d2a6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:00.725048 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 360/718] 10.222.0.73 () {56 vars in 1112 bytes} [Thu May 19 11:56:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:00.730426 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea28f9-128c-4bf6-ae6f-3c4392d703ce None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:00.873439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:00.909176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea28f9-128c-4bf6-ae6f-3c4392d703ce None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:00.961862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ce02b-a742-4a13-ac63-60092da77678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:00.962461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ce02b-a742-4a13-ac63-60092da77678 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:00.962753 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ce02b-a742-4a13-ac63-60092da77678 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:00.963044 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ce02b-a742-4a13-ac63-60092da77678 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:00.963762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ce02b-a742-4a13-ac63-60092da77678 None admin] RBAC: Adding query filter params (type=network) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:00.964107 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ce02b-a742-4a13-ac63-60092da77678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:00.965472 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ce02b-a742-4a13-ac63-60092da77678 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:00.972268 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 359/719] 10.222.0.73 () {56 vars in 1112 bytes} [Thu May 19 11:56:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:01.952628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc27c51-06c2-431e-8991-5ced77dbc089 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:01.953156 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc27c51-06c2-431e-8991-5ced77dbc089 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:01.953156 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc27c51-06c2-431e-8991-5ced77dbc089 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:01.954794 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 361/720] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:01.960077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba705689-8b26-4216-942c-f6aacd238ec7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:01.960501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba705689-8b26-4216-942c-f6aacd238ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:01.960673 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba705689-8b26-4216-942c-f6aacd238ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:01.978247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ba705689-8b26-4216-942c-f6aacd238ec7 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:01.979425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ba705689-8b26-4216-942c-f6aacd238ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:02.050327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 360/721] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 11:56:02.072167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc27c51-06c2-431e-8991-5ced77dbc089 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:02.124195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a0480-9ddc-43f2-925b-41f807757845 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:02.124509 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a0480-9ddc-43f2-925b-41f807757845 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:02.124756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a0480-9ddc-43f2-925b-41f807757845 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:02.126152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 361/722] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:02.131481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aed19c-819e-46f1-a492-1861625fb3db None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:02.131775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aed19c-819e-46f1-a492-1861625fb3db None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:02.132296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aed19c-819e-46f1-a492-1861625fb3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:02.166612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c6aed19c-819e-46f1-a492-1861625fb3db None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:02.167833 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c6aed19c-819e-46f1-a492-1861625fb3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:02.182072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:02.195659 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc27c51-06c2-431e-8991-5ced77dbc089 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:02.236445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6eaa2-8b81-4946-be83-68bf166465aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:02.237720 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6eaa2-8b81-4946-be83-68bf166465aa None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:02.238468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6eaa2-8b81-4946-be83-68bf166465aa None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:02.238945 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6eaa2-8b81-4946-be83-68bf166465aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:02.251798 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6eaa2-8b81-4946-be83-68bf166465aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:02.261402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f3e6eaa2-8b81-4946-be83-68bf166465aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:02.261402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:02.261402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:02.261402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:02.261402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:02.261402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:02.261402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:02.261402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:02.261402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:02.261402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:02.261402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:02.261402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:02.261402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:02.261402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:02.261402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:02.261402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:02.262385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:02.262385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:02.262385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:02.262385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:02.262385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:02.262385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:02.262385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:02.262385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:02.262385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:02.262385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:02.262385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:02.262385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:02.262385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:02.262385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:02.262385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:02.262385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:02.263209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:02.263209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:02.263209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:02.263209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:02.263209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:02.263209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:02.263209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:02.263209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:02.263209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:02.263209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:02.263209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:02.263209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:02.270382 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 362/723] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:56:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:02.272927 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6eaa2-8b81-4946-be83-68bf166465aa None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:02.333110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:02.344465 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 362/724] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:02.366246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aed19c-819e-46f1-a492-1861625fb3db None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:02.437116 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6eaa2-8b81-4946-be83-68bf166465aa None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:02.488937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1096683-e579-43cc-836c-ed4fd93eff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:02.490524 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1096683-e579-43cc-836c-ed4fd93eff42 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:02.491018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1096683-e579-43cc-836c-ed4fd93eff42 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:02.491492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1096683-e579-43cc-836c-ed4fd93eff42 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:02.492518 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1096683-e579-43cc-836c-ed4fd93eff42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:02.493147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1096683-e579-43cc-836c-ed4fd93eff42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:02.495355 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1096683-e579-43cc-836c-ed4fd93eff42 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:02.513130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 363/725] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:56:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:02.513534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4256c0d-d8ef-4031-88a2-39bb35981816 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:02.513836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4256c0d-d8ef-4031-88a2-39bb35981816 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:02.514121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4256c0d-d8ef-4031-88a2-39bb35981816 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:02.515515 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 364/726] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:02.519107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4256c0d-d8ef-4031-88a2-39bb35981816 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:02.535312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:02.549919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aed19c-819e-46f1-a492-1861625fb3db None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:02.589863 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bb0bb-16e3-49b0-8fda-f6fe48768979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:02.591266 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bb0bb-16e3-49b0-8fda-f6fe48768979 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:02.591805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bb0bb-16e3-49b0-8fda-f6fe48768979 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:02.592308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bb0bb-16e3-49b0-8fda-f6fe48768979 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:02.604410 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bb0bb-16e3-49b0-8fda-f6fe48768979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:02.613131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-3c8bb0bb-16e3-49b0-8fda-f6fe48768979 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:56:02.613131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:02.613131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:02.613131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:02.613131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:02.613131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:02.613131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:02.613131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:02.613131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:02.613131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:02.613131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:02.613131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:02.613131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:02.613131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:02.613131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:02.613131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:02.614064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:02.614064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:02.614064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:02.614064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:02.614064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:02.614064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:02.614064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:02.614064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:02.614064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:02.614064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:02.614064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:02.614064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:02.614064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:02.614064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:02.614064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:02.614064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:02.614882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:02.614882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:02.614882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:02.614882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:02.614882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:02.614882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:02.614882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:02.614882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:02.614882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:02.614882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:02.614882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:56:02.614882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:02.618256 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 363/727] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:56:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:02.620714 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59678232-d82f-47f7-9744-c6d0c41c591b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:02.621223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59678232-d82f-47f7-9744-c6d0c41c591b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:02.621698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59678232-d82f-47f7-9744-c6d0c41c591b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:02.633759 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4256c0d-d8ef-4031-88a2-39bb35981816 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:02.641898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-59678232-d82f-47f7-9744-c6d0c41c591b None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:02.643414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-59678232-d82f-47f7-9744-c6d0c41c591b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:02.673079 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee187fa-aa10-49f3-9204-641edd6a4849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:02.673885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee187fa-aa10-49f3-9204-641edd6a4849 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:02.674174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee187fa-aa10-49f3-9204-641edd6a4849 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:02.674458 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee187fa-aa10-49f3-9204-641edd6a4849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:02.685675 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee187fa-aa10-49f3-9204-641edd6a4849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:02.687122 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee187fa-aa10-49f3-9204-641edd6a4849 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:02.702603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:02.706457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-0ee187fa-aa10-49f3-9204-641edd6a4849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:02.706457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:02.706457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:02.706457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:02.706457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:02.706457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:02.706457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:02.706457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:02.706457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:02.706457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:02.706457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:02.706457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:02.706457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:02.706457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:02.706457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:02.707316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:02.707316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:02.707316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:02.707316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:02.707316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:02.707316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:02.707316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:02.707316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:02.707316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:02.707316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:02.707316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:02.707316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:02.707316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:02.707316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:02.707316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:02.707316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:02.707316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:02.708235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:02.708235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:02.708235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:02.708235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:02.708235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 365/728] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:02.708504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee187fa-aa10-49f3-9204-641edd6a4849 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:02.731963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 364/729] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:02.731963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0579b67-d62c-4840-ba17-4cd767be2bb9 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:02.731963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0579b67-d62c-4840-ba17-4cd767be2bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:02.731963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0579b67-d62c-4840-ba17-4cd767be2bb9 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:02.731963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 365/730] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:02.731963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0579b67-d62c-4840-ba17-4cd767be2bb9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:02.785141 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:02.826545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee187fa-aa10-49f3-9204-641edd6a4849 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:02.840650 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0579b67-d62c-4840-ba17-4cd767be2bb9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:02.861920 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a85ee-e155-444b-8563-8494552512e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:02.862588 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a85ee-e155-444b-8563-8494552512e8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:02.862878 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a85ee-e155-444b-8563-8494552512e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:02.863156 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a85ee-e155-444b-8563-8494552512e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:02.863902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a85ee-e155-444b-8563-8494552512e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:02.864240 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a85ee-e155-444b-8563-8494552512e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:02.865606 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a85ee-e155-444b-8563-8494552512e8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:02.878345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 366/731] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:56:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:02.878345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34614503-82d3-4a81-81d7-889a453a60fd None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:02.878345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34614503-82d3-4a81-81d7-889a453a60fd None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:02.878345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34614503-82d3-4a81-81d7-889a453a60fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:02.881320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610224e8-fb14-4cb2-9c9e-e3ac7ae027c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:02.881986 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610224e8-fb14-4cb2-9c9e-e3ac7ae027c3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:02.882456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610224e8-fb14-4cb2-9c9e-e3ac7ae027c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:02.882743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610224e8-fb14-4cb2-9c9e-e3ac7ae027c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:02.884317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610224e8-fb14-4cb2-9c9e-e3ac7ae027c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:02.884637 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610224e8-fb14-4cb2-9c9e-e3ac7ae027c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:02.885995 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610224e8-fb14-4cb2-9c9e-e3ac7ae027c3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:02.894727 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-34614503-82d3-4a81-81d7-889a453a60fd None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:02.895908 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-34614503-82d3-4a81-81d7-889a453a60fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:02.898669 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 366/732] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:02.899470 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610224e8-fb14-4cb2-9c9e-e3ac7ae027c3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:02.955039 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:02.967961 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 367/733] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:02.969346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34614503-82d3-4a81-81d7-889a453a60fd None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:03.026327 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:03.026727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610224e8-fb14-4cb2-9c9e-e3ac7ae027c3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:03.062674 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a57422-b5da-4a80-bb22-a710f9b8ad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:03.064055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a57422-b5da-4a80-bb22-a710f9b8ad4d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:03.064685 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a57422-b5da-4a80-bb22-a710f9b8ad4d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:03.064685 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a57422-b5da-4a80-bb22-a710f9b8ad4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:03.076647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34614503-82d3-4a81-81d7-889a453a60fd None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:03.077600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a57422-b5da-4a80-bb22-a710f9b8ad4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:03.088005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-71a57422-b5da-4a80-bb22-a710f9b8ad4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:03.088005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:03.088005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:03.088005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:03.088005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:03.088005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:03.088005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:03.088005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:03.088005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:03.088005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:03.088005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:03.088005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:03.088005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:03.088005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:03.088005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:03.088005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:03.089019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:03.089019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:03.089019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:03.089019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:03.089019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:03.089019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:03.089019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:03.089019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:03.089019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:03.089019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:03.089019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:03.089019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:03.089019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:03.089019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:03.089019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:03.089019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:03.089851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:03.089851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:03.089851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:03.089851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:03.089851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:03.089851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:03.089851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:03.089851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:03.089851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:03.089851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:03.089851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:03.089851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:03.091122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 367/734] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:56:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:03.091287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a57422-b5da-4a80-bb22-a710f9b8ad4d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:03.115828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235decae-eb6d-4e3b-8ae5-a5ad14e8b304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:03.116715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235decae-eb6d-4e3b-8ae5-a5ad14e8b304 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:03.116958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235decae-eb6d-4e3b-8ae5-a5ad14e8b304 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:03.117227 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235decae-eb6d-4e3b-8ae5-a5ad14e8b304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:03.128226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235decae-eb6d-4e3b-8ae5-a5ad14e8b304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:03.129658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235decae-eb6d-4e3b-8ae5-a5ad14e8b304 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:03.147563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-235decae-eb6d-4e3b-8ae5-a5ad14e8b304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:03.147563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:03.147563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:03.147563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:03.147563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:03.147563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:03.147563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:03.147563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:03.147563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:03.147563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:03.147563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:03.147563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:03.147563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:03.147563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:03.147563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:03.148505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:03.148505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:03.148505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:03.148505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:03.148505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:03.148505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:03.148505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:03.148505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:03.148505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:03.148505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:03.148505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:03.148505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:03.148505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:03.148505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:03.148505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:03.148505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:03.148505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:03.153939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:03.153939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:03.153939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:03.153939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:03.153939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 368/735] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:03.153939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235decae-eb6d-4e3b-8ae5-a5ad14e8b304 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:03.204820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a57422-b5da-4a80-bb22-a710f9b8ad4d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:03.214538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:03.242690 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1537942-4c59-4988-ab19-a1bdcb55f8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:03.244488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1537942-4c59-4988-ab19-a1bdcb55f8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:03.245089 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1537942-4c59-4988-ab19-a1bdcb55f8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:03.245381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1537942-4c59-4988-ab19-a1bdcb55f8b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:03.261407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1537942-4c59-4988-ab19-a1bdcb55f8b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:03.261968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235decae-eb6d-4e3b-8ae5-a5ad14e8b304 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:03.262849 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1537942-4c59-4988-ab19-a1bdcb55f8b4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:03.269569 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:03.280575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-e1537942-4c59-4988-ab19-a1bdcb55f8b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:56:03.280575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:03.280575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:03.280575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:03.280575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:03.280575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:03.280575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:03.280575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:03.280575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:03.280575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:03.280575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:03.280575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:03.280575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:56:03.280575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:56:03.280575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:56:03.280575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:03.281751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:03.282717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:03.282717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:03.282717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:56:03.282717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:56:03.282717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:56:03.282717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:56:03.282717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:56:03.282717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:56:03.282717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:56:03.282717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:03.282717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 368/736] 10.222.0.73 () {56 vars in 1093 bytes} [Thu May 19 11:56:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:03.282717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1537942-4c59-4988-ab19-a1bdcb55f8b4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:03.302701 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6cd32-39e2-414d-9104-075cc032ace0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:03.303561 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6cd32-39e2-414d-9104-075cc032ace0 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:03.303685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6cd32-39e2-414d-9104-075cc032ace0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:03.303942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6cd32-39e2-414d-9104-075cc032ace0 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:03.304667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6cd32-39e2-414d-9104-075cc032ace0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:03.306038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6cd32-39e2-414d-9104-075cc032ace0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:03.332223 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 369/737] 10.222.0.73 () {60 vars in 1141 bytes} [Thu May 19 11:56:03 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:03.334447 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6cd32-39e2-414d-9104-075cc032ace0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:03.407207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1537942-4c59-4988-ab19-a1bdcb55f8b4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:03.462269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a9093-4de0-4d63-bc3b-5916094b1ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:03.462989 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a9093-4de0-4d63-bc3b-5916094b1ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:03.463271 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a9093-4de0-4d63-bc3b-5916094b1ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:03.463548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a9093-4de0-4d63-bc3b-5916094b1ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:03.464375 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a9093-4de0-4d63-bc3b-5916094b1ed0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:03.464686 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a9093-4de0-4d63-bc3b-5916094b1ed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:03.466332 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a9093-4de0-4d63-bc3b-5916094b1ed0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:03.481375 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 369/738] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:56:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:03.482419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a9093-4de0-4d63-bc3b-5916094b1ed0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:03.492235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6cd32-39e2-414d-9104-075cc032ace0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:03.517731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:03.543872 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f3da7-75fc-4132-a5c8-86e0b3ceb0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:03.544594 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f3da7-75fc-4132-a5c8-86e0b3ceb0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:03.545149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f3da7-75fc-4132-a5c8-86e0b3ceb0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:03.545422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f3da7-75fc-4132-a5c8-86e0b3ceb0d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:03.546172 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f3da7-75fc-4132-a5c8-86e0b3ceb0d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:03.546488 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f3da7-75fc-4132-a5c8-86e0b3ceb0d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:03.549270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f3da7-75fc-4132-a5c8-86e0b3ceb0d5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:03.564893 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 370/739] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:03.565748 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f3da7-75fc-4132-a5c8-86e0b3ceb0d5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:03.597347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:03.622027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a9093-4de0-4d63-bc3b-5916094b1ed0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:03.666351 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f1bed-8219-4c75-9257-120ca396f66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:03.667418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f1bed-8219-4c75-9257-120ca396f66b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:03.667909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f1bed-8219-4c75-9257-120ca396f66b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:03.668415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f1bed-8219-4c75-9257-120ca396f66b None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:03.669482 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f1bed-8219-4c75-9257-120ca396f66b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:03.670268 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f1bed-8219-4c75-9257-120ca396f66b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:03.672041 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f1bed-8219-4c75-9257-120ca396f66b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:03.690025 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f3da7-75fc-4132-a5c8-86e0b3ceb0d5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:03.695903 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 370/740] 10.222.0.73 () {56 vars in 1133 bytes} [Thu May 19 11:56:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:03.696789 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f1bed-8219-4c75-9257-120ca396f66b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:03.732396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f58e35-ced6-4616-9865-b090bbefa0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:03.733193 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f58e35-ced6-4616-9865-b090bbefa0ae None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:03.733488 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f58e35-ced6-4616-9865-b090bbefa0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:03.733768 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f58e35-ced6-4616-9865-b090bbefa0ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:03.745376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f58e35-ced6-4616-9865-b090bbefa0ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:03.746832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f58e35-ced6-4616-9865-b090bbefa0ae None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:03.766054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b2f58e35-ced6-4616-9865-b090bbefa0ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:03.766054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:03.766054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:03.766054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:03.766054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:03.766054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:03.766054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:03.766054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:03.766054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:03.766054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:03.766054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:03.766054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:03.766054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:03.766054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:03.766054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:03.767061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:03.767061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:03.767061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:03.767061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:03.767061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:03.767061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:03.767061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:03.767061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:03.767061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:03.767061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:03.767061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:03.767061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:03.767061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:03.767061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:03.767061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:03.767061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:03.767061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:03.768685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:03.768685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:03.768685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:03.768685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:03.768685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 371/741] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:03.768685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f58e35-ced6-4616-9865-b090bbefa0ae None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:03.799247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:03.817104 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f1bed-8219-4c75-9257-120ca396f66b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:03.853655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:03.856817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd8fa1-f749-41b2-bd12-cc0dfc7d7ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:03.858005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd8fa1-f749-41b2-bd12-cc0dfc7d7ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:03.858441 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd8fa1-f749-41b2-bd12-cc0dfc7d7ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:03.858736 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd8fa1-f749-41b2-bd12-cc0dfc7d7ed8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:03.867134 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd8fa1-f749-41b2-bd12-cc0dfc7d7ed8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:03.868610 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd8fa1-f749-41b2-bd12-cc0dfc7d7ed8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:03.876375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f58e35-ced6-4616-9865-b090bbefa0ae None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:03.883614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-07fd8fa1-f749-41b2-bd12-cc0dfc7d7ed8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:56:03.883614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:03.883614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:03.883614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:03.883614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:03.883614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:03.883614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:03.883614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:03.883614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:03.883614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:03.883614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:03.883614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:03.883614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:56:03.883614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:56:03.883614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:56:03.883614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:03.884580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:03.885503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:03.885503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:03.885503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:56:03.885503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:56:03.885503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:56:03.885503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:56:03.885503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:56:03.885503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:56:03.885503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:56:03.885503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:03.885503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 371/742] 10.222.0.73 () {56 vars in 1117 bytes} [Thu May 19 11:56:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:03.887011 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea585cb-7640-42be-87d7-64bcf9745154 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:03.887011 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea585cb-7640-42be-87d7-64bcf9745154 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:03.887183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea585cb-7640-42be-87d7-64bcf9745154 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:03.893023 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 372/743] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:03.893825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea585cb-7640-42be-87d7-64bcf9745154 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:03.918733 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632de0d-ce56-4783-a32c-05243e2bc936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:03.919576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632de0d-ce56-4783-a32c-05243e2bc936 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:03.919805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632de0d-ce56-4783-a32c-05243e2bc936 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:03.920361 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632de0d-ce56-4783-a32c-05243e2bc936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:03.932331 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632de0d-ce56-4783-a32c-05243e2bc936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:03.933785 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632de0d-ce56-4783-a32c-05243e2bc936 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:03.951540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-1632de0d-ce56-4783-a32c-05243e2bc936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:03.951540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:03.951540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:03.951540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:03.951540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:03.951540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:03.951540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:03.951540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:03.951540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:03.951540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:03.951540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:03.951540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:03.951540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:03.951540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:03.951540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:03.952487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:03.952487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:03.952487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:03.952487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:03.952487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:03.952487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:03.952487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:03.952487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:03.952487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:03.952487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:03.952487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:03.952487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:03.952487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:03.952487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:03.952487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:03.952487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:03.952487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:03.953396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:03.953396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:03.953396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:03.953396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:03.953396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 372/744] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:03.954655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632de0d-ce56-4783-a32c-05243e2bc936 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:04.008356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea585cb-7640-42be-87d7-64bcf9745154 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:04.046773 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc60305-c499-42dd-8eda-ca2338fd1a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:04.047464 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc60305-c499-42dd-8eda-ca2338fd1a0b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:04.047730 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc60305-c499-42dd-8eda-ca2338fd1a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:04.048039 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc60305-c499-42dd-8eda-ca2338fd1a0b None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:04.048761 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc60305-c499-42dd-8eda-ca2338fd1a0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:04.049067 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc60305-c499-42dd-8eda-ca2338fd1a0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:04.050419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc60305-c499-42dd-8eda-ca2338fd1a0b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:04.066302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 373/745] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:04.066485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632de0d-ce56-4783-a32c-05243e2bc936 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:04.066901 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b02590-17a4-47e9-9d4b-ea08877ee177 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:04.066901 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b02590-17a4-47e9-9d4b-ea08877ee177 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:04.066901 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b02590-17a4-47e9-9d4b-ea08877ee177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:04.072704 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:04.084042 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e1b02590-17a4-47e9-9d4b-ea08877ee177 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:04.085221 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e1b02590-17a4-47e9-9d4b-ea08877ee177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:04.098502 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:04.103970 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90697a9b-1827-4406-81bf-a5bd0c149352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:04.104582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90697a9b-1827-4406-81bf-a5bd0c149352 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:04.104874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90697a9b-1827-4406-81bf-a5bd0c149352 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:04.105160 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90697a9b-1827-4406-81bf-a5bd0c149352 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:04.106004 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90697a9b-1827-4406-81bf-a5bd0c149352 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:04.106322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90697a9b-1827-4406-81bf-a5bd0c149352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:04.107761 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90697a9b-1827-4406-81bf-a5bd0c149352 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:04.125894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 373/746] 10.222.0.73 () {56 vars in 1149 bytes} [Thu May 19 11:56:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:04.126959 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90697a9b-1827-4406-81bf-a5bd0c149352 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:04.168084 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 374/747] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 11:56:04.168974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b02590-17a4-47e9-9d4b-ea08877ee177 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:04.235979 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90697a9b-1827-4406-81bf-a5bd0c149352 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:04.271407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b02590-17a4-47e9-9d4b-ea08877ee177 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:04.273223 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f80aa-2f2e-43e4-849c-a7aa4a6e206a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:04.273891 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f80aa-2f2e-43e4-849c-a7aa4a6e206a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:04.274169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f80aa-2f2e-43e4-849c-a7aa4a6e206a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:04.274443 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f80aa-2f2e-43e4-849c-a7aa4a6e206a None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:04.275167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f80aa-2f2e-43e4-849c-a7aa4a6e206a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:04.275471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f80aa-2f2e-43e4-849c-a7aa4a6e206a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:04.276854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f80aa-2f2e-43e4-849c-a7aa4a6e206a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:04.287785 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 374/748] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:04.288610 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f80aa-2f2e-43e4-849c-a7aa4a6e206a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:04.313551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441e1b4-f6e8-49d4-8e32-f262fdffc160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:04.314721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441e1b4-f6e8-49d4-8e32-f262fdffc160 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:04.315271 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441e1b4-f6e8-49d4-8e32-f262fdffc160 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:04.315752 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441e1b4-f6e8-49d4-8e32-f262fdffc160 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:04.318102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:04.324899 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441e1b4-f6e8-49d4-8e32-f262fdffc160 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:04.326336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441e1b4-f6e8-49d4-8e32-f262fdffc160 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:04.341216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-4441e1b4-f6e8-49d4-8e32-f262fdffc160 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:56:04.341216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:04.341216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:04.341216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:04.341216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:04.341216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:04.341216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:04.341216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:04.341216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:04.341216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:04.341216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:04.341216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:04.341216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:56:04.341216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:56:04.341216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:56:04.341216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:04.342162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:04.343082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:04.343082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:04.343082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:56:04.343082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:56:04.343082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:56:04.343082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:56:04.343082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:56:04.343082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:56:04.343082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:56:04.343082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:04.343082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 375/749] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:56:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:04.343082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441e1b4-f6e8-49d4-8e32-f262fdffc160 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:04.349492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:04.414563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f80aa-2f2e-43e4-849c-a7aa4a6e206a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:04.450702 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038df79-84e2-4abf-9642-798c1d14ea15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:04.451458 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038df79-84e2-4abf-9642-798c1d14ea15 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:04.451818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038df79-84e2-4abf-9642-798c1d14ea15 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:04.452210 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038df79-84e2-4abf-9642-798c1d14ea15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:04.454923 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441e1b4-f6e8-49d4-8e32-f262fdffc160 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:04.491975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d48787-c2d8-4c73-8350-8acb54336f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:04.492642 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d48787-c2d8-4c73-8350-8acb54336f1c None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:04.492923 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d48787-c2d8-4c73-8350-8acb54336f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:04.493196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d48787-c2d8-4c73-8350-8acb54336f1c None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:04.493916 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d48787-c2d8-4c73-8350-8acb54336f1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:04.495276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d48787-c2d8-4c73-8350-8acb54336f1c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:04.513195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 376/750] 10.222.0.73 () {60 vars in 1141 bytes} [Thu May 19 11:56:04 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:04.513940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d48787-c2d8-4c73-8350-8acb54336f1c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:04.563491 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038df79-84e2-4abf-9642-798c1d14ea15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:04.565889 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038df79-84e2-4abf-9642-798c1d14ea15 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:04.582212 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:04.639717 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:04.642857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d48787-c2d8-4c73-8350-8acb54336f1c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:04.682513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03523d-7fae-4ca7-8bfb-c7ea8f547a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:04.683203 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03523d-7fae-4ca7-8bfb-c7ea8f547a80 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:04.683487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03523d-7fae-4ca7-8bfb-c7ea8f547a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:04.683759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03523d-7fae-4ca7-8bfb-c7ea8f547a80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:04.691781 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03523d-7fae-4ca7-8bfb-c7ea8f547a80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:04.693283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03523d-7fae-4ca7-8bfb-c7ea8f547a80 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:04.711655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-aa03523d-7fae-4ca7-8bfb-c7ea8f547a80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:04.711655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:04.711655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:04.711655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:04.711655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:04.711655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:04.711655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:04.711655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:04.711655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:04.711655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:04.711655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:04.711655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:04.711655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:56:04.711655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:56:04.711655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:56:04.712636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:56:04.712636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:04.712636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:04.712636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:04.712636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:04.712636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:04.712636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:04.712636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:04.712636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:04.712636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:04.712636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:04.712636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:04.712636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:04.712636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:04.712636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:04.712636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:04.712636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:04.713500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:56:04.713500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:56:04.713500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:56:04.713500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:56:04.713500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:56:04.713500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:56:04.713500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:04.713500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:04.713500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 377/751] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:04.717432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03523d-7fae-4ca7-8bfb-c7ea8f547a80 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:04.722577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 375/752] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:56:04 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 11:56:04.723284 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038df79-84e2-4abf-9642-798c1d14ea15 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:04.851764 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03523d-7fae-4ca7-8bfb-c7ea8f547a80 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:04.856029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038df79-84e2-4abf-9642-798c1d14ea15 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:04.865993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:04.894095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716e8d0-8269-4a69-8977-47b14a1b4db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:04.894678 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716e8d0-8269-4a69-8977-47b14a1b4db1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:04.894965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716e8d0-8269-4a69-8977-47b14a1b4db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:04.895246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716e8d0-8269-4a69-8977-47b14a1b4db1 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:04.896250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716e8d0-8269-4a69-8977-47b14a1b4db1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:04.896563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716e8d0-8269-4a69-8977-47b14a1b4db1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:04.898470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716e8d0-8269-4a69-8977-47b14a1b4db1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:04.899482 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6faa3-cad3-45ea-9d87-2a922bfc8e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:04.900587 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6faa3-cad3-45ea-9d87-2a922bfc8e40 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:04.901470 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6faa3-cad3-45ea-9d87-2a922bfc8e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:04.901921 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6faa3-cad3-45ea-9d87-2a922bfc8e40 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:04.902913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6faa3-cad3-45ea-9d87-2a922bfc8e40 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:04.903374 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6faa3-cad3-45ea-9d87-2a922bfc8e40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:04.904976 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6faa3-cad3-45ea-9d87-2a922bfc8e40 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:04.915806 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 376/753] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:56:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:04.915806 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716e8d0-8269-4a69-8977-47b14a1b4db1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:04.929266 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:04.937721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 378/754] 10.222.0.73 () {56 vars in 1135 bytes} [Thu May 19 11:56:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:04.939310 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6faa3-cad3-45ea-9d87-2a922bfc8e40 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:05.030477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716e8d0-8269-4a69-8977-47b14a1b4db1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:05.047568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6faa3-cad3-45ea-9d87-2a922bfc8e40 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:05.068033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e9589-845f-403c-a4bd-209ce9e873ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:05.068985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e9589-845f-403c-a4bd-209ce9e873ec None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:05.069568 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e9589-845f-403c-a4bd-209ce9e873ec None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:05.069696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e9589-845f-403c-a4bd-209ce9e873ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:05.081855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e9589-845f-403c-a4bd-209ce9e873ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:05.083710 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e9589-845f-403c-a4bd-209ce9e873ec None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:05.088953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114563b0-c3d0-4457-a724-7e1c04353c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:05.090078 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114563b0-c3d0-4457-a724-7e1c04353c86 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:05.090941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114563b0-c3d0-4457-a724-7e1c04353c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:05.091405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114563b0-c3d0-4457-a724-7e1c04353c86 None admin] PATH_INFO: `/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/bd0c1f0710f3447d94e67048a508781e/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:05.094362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114563b0-c3d0-4457-a724-7e1c04353c86 None admin] RBAC: Authorizing `identity:create_grant(project_id=d90551d9446e4f2cbd14312d2af9f7c9, user_id=bd0c1f0710f3447d94e67048a508781e, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:05.096002 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114563b0-c3d0-4457-a724-7e1c04353c86 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:05.101985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-7a2e9589-845f-403c-a4bd-209ce9e873ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:05.101985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:05.101985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:05.101985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:05.101985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:05.101985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:05.101985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:05.101985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:05.101985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:05.101985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:05.101985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:05.101985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:05.101985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:05.101985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:05.101985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:05.102888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:05.102888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:05.102888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:05.102888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:05.102888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:05.102888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:05.102888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:05.102888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:05.102888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:05.102888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:05.102888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:05.102888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:05.102888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:05.102888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:05.102888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:05.102888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:05.102888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:05.103834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:05.103834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:05.103834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:05.103834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:05.103834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 377/755] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:05.104587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e9589-845f-403c-a4bd-209ce9e873ec None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:05.114718 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 379/756] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:56:04 2022] PUT /identity/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/bd0c1f0710f3447d94e67048a508781e/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:56:05.115850 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114563b0-c3d0-4457-a724-7e1c04353c86 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:05.152337 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:05.240418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114563b0-c3d0-4457-a724-7e1c04353c86 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:05.281732 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:05.283490 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7efa9-36bd-49ee-8d04-f87ce1bdbe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:05.284521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7efa9-36bd-49ee-8d04-f87ce1bdbe9a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:05.285194 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7efa9-36bd-49ee-8d04-f87ce1bdbe9a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:05.286289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7efa9-36bd-49ee-8d04-f87ce1bdbe9a None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:05.287327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7efa9-36bd-49ee-8d04-f87ce1bdbe9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:05.287828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7efa9-36bd-49ee-8d04-f87ce1bdbe9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:05.289591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7efa9-36bd-49ee-8d04-f87ce1bdbe9a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:05.304651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 380/757] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:05.316600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7efa9-36bd-49ee-8d04-f87ce1bdbe9a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:05.381990 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e9589-845f-403c-a4bd-209ce9e873ec None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:05.427834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62a1b6-a33f-48ea-a7a4-5cb11b6f2660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:05.428587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62a1b6-a33f-48ea-a7a4-5cb11b6f2660 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:05.428972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62a1b6-a33f-48ea-a7a4-5cb11b6f2660 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:05.429371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62a1b6-a33f-48ea-a7a4-5cb11b6f2660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:05.459129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:05.473590 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7efa9-36bd-49ee-8d04-f87ce1bdbe9a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:05.507062 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62a1b6-a33f-48ea-a7a4-5cb11b6f2660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:05.508973 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded4a98-0cb2-4d36-ba7a-964990347139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:05.509284 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62a1b6-a33f-48ea-a7a4-5cb11b6f2660 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:05.509778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded4a98-0cb2-4d36-ba7a-964990347139 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:05.510067 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded4a98-0cb2-4d36-ba7a-964990347139 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:05.510348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded4a98-0cb2-4d36-ba7a-964990347139 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:05.519488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded4a98-0cb2-4d36-ba7a-964990347139 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:05.520884 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded4a98-0cb2-4d36-ba7a-964990347139 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:05.538741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-eded4a98-0cb2-4d36-ba7a-964990347139 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:05.538741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:05.538741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:05.538741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:05.538741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:05.538741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:05.538741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:05.538741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:05.538741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:05.538741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:05.538741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:05.538741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:05.538741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:56:05.538741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:56:05.538741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:56:05.539734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:56:05.539734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:05.539734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:05.539734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:05.539734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:05.539734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:05.539734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:05.539734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:05.539734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:05.539734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:05.539734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:05.539734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:05.539734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:05.539734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:05.539734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:05.539734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:05.539734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:05.540668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:56:05.540668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:56:05.540668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:56:05.540668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:56:05.540668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:56:05.540668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:56:05.540668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:05.540668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:05.541796 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 381/758] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:05.550044 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded4a98-0cb2-4d36-ba7a-964990347139 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:05.629146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:05.701971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 378/759] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:56:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:56:05.709728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62a1b6-a33f-48ea-a7a4-5cb11b6f2660 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:05.737891 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded4a98-0cb2-4d36-ba7a-964990347139 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:05.775709 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917fefb-f46c-4897-9229-b7a4f1d665a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:05.776729 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917fefb-f46c-4897-9229-b7a4f1d665a7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:05.777265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917fefb-f46c-4897-9229-b7a4f1d665a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:05.777569 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917fefb-f46c-4897-9229-b7a4f1d665a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:05.778528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917fefb-f46c-4897-9229-b7a4f1d665a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:05.778846 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917fefb-f46c-4897-9229-b7a4f1d665a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:05.780958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917fefb-f46c-4897-9229-b7a4f1d665a7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:05.799451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 382/760] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:56:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:05.800859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b813834-d1b8-4354-92f6-af8d6d6738cc None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:05.801307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b813834-d1b8-4354-92f6-af8d6d6738cc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:05.801595 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b813834-d1b8-4354-92f6-af8d6d6738cc None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:05.803757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 383/761] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:05.804506 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b813834-d1b8-4354-92f6-af8d6d6738cc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:05.817911 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:05.826290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62a1b6-a33f-48ea-a7a4-5cb11b6f2660 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:05.862854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f3d82-a47e-4e07-bcd4-711f8eef5264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:05.863771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f3d82-a47e-4e07-bcd4-711f8eef5264 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:05.864150 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f3d82-a47e-4e07-bcd4-711f8eef5264 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:05.864709 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f3d82-a47e-4e07-bcd4-711f8eef5264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:05.875706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f3d82-a47e-4e07-bcd4-711f8eef5264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:05.877304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f3d82-a47e-4e07-bcd4-711f8eef5264 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:05.895234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-056f3d82-a47e-4e07-bcd4-711f8eef5264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:05.895234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:05.895234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:05.895234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:05.895234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:05.895234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:05.895234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:05.895234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:05.895234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:05.895234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:05.895234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:05.895234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:05.895234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:05.895234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:05.895234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:05.896200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:05.896200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:05.896200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:05.896200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:05.896200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:05.896200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:05.896200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:05.896200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:05.896200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:05.896200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:05.896200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:05.896200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:05.896200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:05.896200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:05.896200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:05.896200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:05.896200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:05.897091 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:05.897091 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:05.897091 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:05.897091 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:05.901388 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 379/762] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:05.902820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fee47b-f985-4c35-b9bf-26782fc64c73 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:05.903187 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fee47b-f985-4c35-b9bf-26782fc64c73 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:05.903541 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fee47b-f985-4c35-b9bf-26782fc64c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:05.925663 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a5fee47b-f985-4c35-b9bf-26782fc64c73 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:05.927058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a5fee47b-f985-4c35-b9bf-26782fc64c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:05.937645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:05.938188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b813834-d1b8-4354-92f6-af8d6d6738cc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:05.986396 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd27215-5110-49c6-ad2a-db8a31352504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:05.986980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd27215-5110-49c6-ad2a-db8a31352504 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:05.987269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd27215-5110-49c6-ad2a-db8a31352504 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:05.987552 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd27215-5110-49c6-ad2a-db8a31352504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:05.988441 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd27215-5110-49c6-ad2a-db8a31352504 None admin] RBAC: Adding query filter params (role.id=d21329f1cd364fba8b79529896e00f81, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=b6c5da324ab2405a84036db91a1366a0) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:05.988764 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd27215-5110-49c6-ad2a-db8a31352504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:05.990196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd27215-5110-49c6-ad2a-db8a31352504 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:05.996141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 384/763] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:56:05 2022] GET /identity/v3/role_assignments?user.id=b6c5da324ab2405a84036db91a1366a0&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=d21329f1cd364fba8b79529896e00f81 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:05.997027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd27215-5110-49c6-ad2a-db8a31352504 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:06.004762 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 380/764] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:06.035719 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fee47b-f985-4c35-b9bf-26782fc64c73 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:06.158878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:06.220753 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd27215-5110-49c6-ad2a-db8a31352504 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:06.252006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fee47b-f985-4c35-b9bf-26782fc64c73 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:06.285926 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a63a1f-4d3d-47bb-9f07-57ca9b85aa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:06.286609 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a63a1f-4d3d-47bb-9f07-57ca9b85aa61 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:06.286897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a63a1f-4d3d-47bb-9f07-57ca9b85aa61 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:06.287179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a63a1f-4d3d-47bb-9f07-57ca9b85aa61 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:06.287933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a63a1f-4d3d-47bb-9f07-57ca9b85aa61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:06.288256 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a63a1f-4d3d-47bb-9f07-57ca9b85aa61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:06.289635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a63a1f-4d3d-47bb-9f07-57ca9b85aa61 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:06.321659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 385/765] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:06.323574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a63a1f-4d3d-47bb-9f07-57ca9b85aa61 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:06.325800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f81885-08f1-4d8a-a09b-14061ece1898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:06.326624 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f81885-08f1-4d8a-a09b-14061ece1898 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:06.326906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f81885-08f1-4d8a-a09b-14061ece1898 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:06.327181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f81885-08f1-4d8a-a09b-14061ece1898 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:06.327847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f81885-08f1-4d8a-a09b-14061ece1898 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:06.329770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f81885-08f1-4d8a-a09b-14061ece1898 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:06.370144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-45f81885-08f1-4d8a-a09b-14061ece1898 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:56:06.370144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:06.370144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:06.370144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:06.370144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:06.370144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:06.370144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:06.370144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:06.370144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:56:06.370144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:06.370144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:06.370144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:06.370144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:06.370144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:06.370144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:06.370144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:06.372006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:06.372006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:06.372006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:06.372006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:06.372006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:06.372006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:06.372006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:06.372006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:06.372006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:06.372006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:06.372006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:06.372006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:06.372006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:06.372006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:06.372006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:06.372006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:06.373180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:06.373180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:06.373180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:06.373180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:06.373180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:06.373180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:06.373180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:06.373180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:06.373180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:06.373180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:06.373180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:06.373180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:06.373180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:06.373180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:56:06.373180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:06.378070 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 381/766] 10.222.0.73 () {56 vars in 1129 bytes} [Thu May 19 11:56:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:06.385463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f81885-08f1-4d8a-a09b-14061ece1898 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:06.400296 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:06.535270 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a63a1f-4d3d-47bb-9f07-57ca9b85aa61 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:06.568816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:06.575094 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b3ec4-e8bb-4f01-848f-1a71315c2067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:06.576019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b3ec4-e8bb-4f01-848f-1a71315c2067 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:06.576383 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b3ec4-e8bb-4f01-848f-1a71315c2067 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:06.576741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b3ec4-e8bb-4f01-848f-1a71315c2067 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:06.585947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b3ec4-e8bb-4f01-848f-1a71315c2067 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:06.587711 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b3ec4-e8bb-4f01-848f-1a71315c2067 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:06.603758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-3a2b3ec4-e8bb-4f01-848f-1a71315c2067 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:06.603758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:06.603758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:06.603758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:06.603758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:06.603758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:06.603758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:06.603758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:06.603758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:06.603758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:06.603758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:06.603758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:06.603758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:56:06.603758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:56:06.603758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:56:06.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:56:06.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:06.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:06.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:06.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:06.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:06.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:06.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:06.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:06.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:06.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:06.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:06.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:06.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:06.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:06.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:06.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:06.605580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:56:06.605580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:56:06.605580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:56:06.605580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:56:06.605580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:56:06.605580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:56:06.605580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:06.605580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:06.605580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 386/767] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:06.609479 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f81885-08f1-4d8a-a09b-14061ece1898 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:06.612141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b3ec4-e8bb-4f01-848f-1a71315c2067 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:06.693279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4642f7-c6db-4bc9-a263-abb4961d1f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:06.693946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4642f7-c6db-4bc9-a263-abb4961d1f2f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:06.694237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4642f7-c6db-4bc9-a263-abb4961d1f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:06.694520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4642f7-c6db-4bc9-a263-abb4961d1f2f None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:06.695241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4642f7-c6db-4bc9-a263-abb4961d1f2f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:06.695554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4642f7-c6db-4bc9-a263-abb4961d1f2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:06.696962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4642f7-c6db-4bc9-a263-abb4961d1f2f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:06.710583 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 382/768] 10.222.0.73 () {56 vars in 1124 bytes} [Thu May 19 11:56:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:06.713415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4642f7-c6db-4bc9-a263-abb4961d1f2f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:06.793000 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b3ec4-e8bb-4f01-848f-1a71315c2067 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:06.837676 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c5232-ac84-4eab-ab28-6efc879fb087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:06.838763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c5232-ac84-4eab-ab28-6efc879fb087 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:06.839257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c5232-ac84-4eab-ab28-6efc879fb087 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:06.839740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c5232-ac84-4eab-ab28-6efc879fb087 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:06.840807 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c5232-ac84-4eab-ab28-6efc879fb087 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:06.841751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c5232-ac84-4eab-ab28-6efc879fb087 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:06.844486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c5232-ac84-4eab-ab28-6efc879fb087 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:06.858108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:06.878197 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 387/769] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:56:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:06.888921 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c5232-ac84-4eab-ab28-6efc879fb087 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:06.901770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4642f7-c6db-4bc9-a263-abb4961d1f2f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:06.946646 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6f136-2088-4309-be00-4d35984af871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:06.947614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6f136-2088-4309-be00-4d35984af871 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:06.948069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6f136-2088-4309-be00-4d35984af871 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:06.948488 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6f136-2088-4309-be00-4d35984af871 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:06.949338 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6f136-2088-4309-be00-4d35984af871 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:06.950998 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6f136-2088-4309-be00-4d35984af871 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:06.952547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6f136-2088-4309-be00-4d35984af871 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:06.962596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 383/770] 10.222.0.73 () {56 vars in 1124 bytes} [Thu May 19 11:56:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:06.968695 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6f136-2088-4309-be00-4d35984af871 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:07.011759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:07.085697 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c5232-ac84-4eab-ab28-6efc879fb087 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:07.090055 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6f136-2088-4309-be00-4d35984af871 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:07.121655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147b713-870e-45f6-8f5c-8bb49dd51657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:07.122763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147b713-870e-45f6-8f5c-8bb49dd51657 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:07.123247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147b713-870e-45f6-8f5c-8bb49dd51657 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:07.123741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f147b713-870e-45f6-8f5c-8bb49dd51657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:07.124813 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147b713-870e-45f6-8f5c-8bb49dd51657 None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=371dae58e95d403b97e311c6616adab5) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:07.125327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147b713-870e-45f6-8f5c-8bb49dd51657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:07.127243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471445ed-e688-45cf-bfce-d4b3d7b74383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:07.127727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f147b713-870e-45f6-8f5c-8bb49dd51657 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:07.127945 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471445ed-e688-45cf-bfce-d4b3d7b74383 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:07.128218 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471445ed-e688-45cf-bfce-d4b3d7b74383 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:07.128498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471445ed-e688-45cf-bfce-d4b3d7b74383 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:07.129294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471445ed-e688-45cf-bfce-d4b3d7b74383 None admin] RBAC: Adding query filter params (interface=public, service_id=7865a9e6ff134cf8941a2201690a1bfe, region_id=RegionOne) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:07.129610 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471445ed-e688-45cf-bfce-d4b3d7b74383 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:07.131141 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471445ed-e688-45cf-bfce-d4b3d7b74383 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:07.133079 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:07.135709 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 388/771] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:56:06 2022] GET /identity/v3/role_assignments?user.id=371dae58e95d403b97e311c6616adab5&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:07.144056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 384/772] 10.222.0.73 () {56 vars in 1251 bytes} [Thu May 19 11:56:06 2022] GET /identity/v3/endpoints?service_id=7865a9e6ff134cf8941a2201690a1bfe&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:07.145139 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147b713-870e-45f6-8f5c-8bb49dd51657 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:07.145790 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c32b5f-65d1-40f5-b715-e4ce94d320b0 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:07.146532 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c32b5f-65d1-40f5-b715-e4ce94d320b0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:07.146532 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c32b5f-65d1-40f5-b715-e4ce94d320b0 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:07.150231 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 385/773] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:07.153871 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73753467-43c3-4abe-8166-04a14c8c249c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:07.154167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73753467-43c3-4abe-8166-04a14c8c249c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:07.154456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73753467-43c3-4abe-8166-04a14c8c249c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:07.180858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-73753467-43c3-4abe-8166-04a14c8c249c None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:07.182099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-73753467-43c3-4abe-8166-04a14c8c249c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:07.292046 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 386/774] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:07.310063 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73753467-43c3-4abe-8166-04a14c8c249c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:07.351256 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f147b713-870e-45f6-8f5c-8bb49dd51657 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:07.384321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:07.411823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e4f7e-2b94-449a-bf41-511d54c7b6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:07.412622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4f7e-2b94-449a-bf41-511d54c7b6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:07.412991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4f7e-2b94-449a-bf41-511d54c7b6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:07.413344 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4f7e-2b94-449a-bf41-511d54c7b6c7 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:07.414116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e4f7e-2b94-449a-bf41-511d54c7b6c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:07.416398 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e4f7e-2b94-449a-bf41-511d54c7b6c7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:07.436091 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 389/775] 10.222.0.73 () {56 vars in 1087 bytes} [Thu May 19 11:56:07 2022] GET /identity/v3/services => generated 772 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:07.477821 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73753467-43c3-4abe-8166-04a14c8c249c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:07.531033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:07.543477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5eafe7-62ee-4156-a9ae-e70cfb237f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:07.544326 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5eafe7-62ee-4156-a9ae-e70cfb237f83 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:07.548305 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5eafe7-62ee-4156-a9ae-e70cfb237f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:07.548592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5eafe7-62ee-4156-a9ae-e70cfb237f83 None admin] PATH_INFO: `/v3/services/network` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:07.549276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5eafe7-62ee-4156-a9ae-e70cfb237f83 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:07.550667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5eafe7-62ee-4156-a9ae-e70cfb237f83 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:07.562932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-fd5eafe7-62ee-4156-a9ae-e70cfb237f83 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:56:07.562932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:07.562932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:07.562932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:07.562932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:07.562932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:07.562932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:07.562932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:07.562932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:56:07.562932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:07.562932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:07.562932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:07.562932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:07.562932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:07.562932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:07.562932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:07.562932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:07.563965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:07.563965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:07.563965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:07.563965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:07.563965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:07.563965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:07.563965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:07.563965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:07.563965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:07.563965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:07.563965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:07.563965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:07.563965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:07.563965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:07.563965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:07.563965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:07.564780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:07.564780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:07.564780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:07.564780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:07.564780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:07.564780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:07.564780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:07.564780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:07.564780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:07.564780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:07.564780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:07.564780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:07.564780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:56:07.564780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:07.569064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 387/776] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:07 2022] GET /identity/v3/services/network => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:07.570464 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e4f7e-2b94-449a-bf41-511d54c7b6c7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:07.688135 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfad76-170c-4f6d-a874-c1e7a739452e None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:07.688434 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfad76-170c-4f6d-a874-c1e7a739452e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:07.688641 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfad76-170c-4f6d-a874-c1e7a739452e None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:07.690399 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 388/777] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:07.695618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07cdf5-307c-4279-97eb-ebea08bfc6b7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:07.695907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07cdf5-307c-4279-97eb-ebea08bfc6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:07.696224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07cdf5-307c-4279-97eb-ebea08bfc6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:07.714398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ff07cdf5-307c-4279-97eb-ebea08bfc6b7 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:07.715712 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ff07cdf5-307c-4279-97eb-ebea08bfc6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:07.727009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e4f7e-2b94-449a-bf41-511d54c7b6c7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:07.792327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9432de8-e87b-4951-b6ee-92d5383f6bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:07.793020 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9432de8-e87b-4951-b6ee-92d5383f6bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:07.793310 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9432de8-e87b-4951-b6ee-92d5383f6bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:07.793591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9432de8-e87b-4951-b6ee-92d5383f6bc4 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:07.794320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9432de8-e87b-4951-b6ee-92d5383f6bc4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:07.794633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9432de8-e87b-4951-b6ee-92d5383f6bc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:07.796320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9432de8-e87b-4951-b6ee-92d5383f6bc4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:07.807287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 390/778] 10.222.0.73 () {56 vars in 1112 bytes} [Thu May 19 11:56:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:07.814009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9432de8-e87b-4951-b6ee-92d5383f6bc4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:07.845943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 389/779] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:07.871457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07cdf5-307c-4279-97eb-ebea08bfc6b7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:07.876136 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:07.936889 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9432de8-e87b-4951-b6ee-92d5383f6bc4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:07.974117 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8da8c0-7012-4253-bd40-1dfb5c6ad023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:07.975357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8da8c0-7012-4253-bd40-1dfb5c6ad023 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:07.975723 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8da8c0-7012-4253-bd40-1dfb5c6ad023 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:07.976106 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8da8c0-7012-4253-bd40-1dfb5c6ad023 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:07.976933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8da8c0-7012-4253-bd40-1dfb5c6ad023 None admin] RBAC: Adding query filter params (type=network) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:07.977346 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8da8c0-7012-4253-bd40-1dfb5c6ad023 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:07.978820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8da8c0-7012-4253-bd40-1dfb5c6ad023 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:07.979069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07cdf5-307c-4279-97eb-ebea08bfc6b7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:07.984805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 391/780] 10.222.0.73 () {56 vars in 1112 bytes} [Thu May 19 11:56:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:07.990497 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8da8c0-7012-4253-bd40-1dfb5c6ad023 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:08.009197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:08.026456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac40572-55cd-4833-af63-82100880c8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:08.027553 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac40572-55cd-4833-af63-82100880c8aa None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:08.028051 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac40572-55cd-4833-af63-82100880c8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:08.028795 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac40572-55cd-4833-af63-82100880c8aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:08.043154 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac40572-55cd-4833-af63-82100880c8aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:08.054183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-eac40572-55cd-4833-af63-82100880c8aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:08.054183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:08.054183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:08.054183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:08.054183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:08.054183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:08.054183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:08.054183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:08.054183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:08.054183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:08.054183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:08.054183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:08.054183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:08.054183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:08.054183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:08.054183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:08.055105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:08.055105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:08.055105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:08.055105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:08.055105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:08.055105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:08.055105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:08.055105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:08.055105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:08.055105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:08.055105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:08.055105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:08.055105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:08.055105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:08.055105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:08.055105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:08.055963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:08.055963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:08.055963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:08.055963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:08.055963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:08.055963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:08.055963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:08.055963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:08.055963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:08.055963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:08.055963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:08.055963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:08.058291 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 390/781] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:56:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:08.064369 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac40572-55cd-4833-af63-82100880c8aa None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:08.107538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8da8c0-7012-4253-bd40-1dfb5c6ad023 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:08.118998 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:08.148453 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21623b-70fd-42ab-a0dc-9e351f5f31be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:08.149467 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21623b-70fd-42ab-a0dc-9e351f5f31be None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:08.150047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21623b-70fd-42ab-a0dc-9e351f5f31be None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:08.150534 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21623b-70fd-42ab-a0dc-9e351f5f31be None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:08.151563 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21623b-70fd-42ab-a0dc-9e351f5f31be None admin] RBAC: Adding query filter params (interface=public, service_id=5f8dc377700a411e94ce8ac6016d7608, region_id=RegionOne) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:08.152142 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21623b-70fd-42ab-a0dc-9e351f5f31be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:08.153933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21623b-70fd-42ab-a0dc-9e351f5f31be None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:08.162810 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 392/782] 10.222.0.73 () {56 vars in 1251 bytes} [Thu May 19 11:56:07 2022] GET /identity/v3/endpoints?service_id=5f8dc377700a411e94ce8ac6016d7608&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:08.168960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21623b-70fd-42ab-a0dc-9e351f5f31be None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:08.185382 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac40572-55cd-4833-af63-82100880c8aa None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:08.247188 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6f8ce-e420-4fce-9967-ae51c1fb7bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:08.247789 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6f8ce-e420-4fce-9967-ae51c1fb7bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:08.248104 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6f8ce-e420-4fce-9967-ae51c1fb7bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:08.248384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6f8ce-e420-4fce-9967-ae51c1fb7bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:08.249139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6f8ce-e420-4fce-9967-ae51c1fb7bc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:08.249449 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6f8ce-e420-4fce-9967-ae51c1fb7bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:08.254258 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6f8ce-e420-4fce-9967-ae51c1fb7bc7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:08.277265 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 391/783] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:56:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:08.278314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6f8ce-e420-4fce-9967-ae51c1fb7bc7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:08.351171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21623b-70fd-42ab-a0dc-9e351f5f31be None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:08.391048 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:08.417161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d73f0-0ea9-439b-abfd-d75c08038c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:08.417872 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d73f0-0ea9-439b-abfd-d75c08038c5a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:08.418122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d73f0-0ea9-439b-abfd-d75c08038c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:08.418404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d73f0-0ea9-439b-abfd-d75c08038c5a None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:08.419731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d73f0-0ea9-439b-abfd-d75c08038c5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:08.425302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d73f0-0ea9-439b-abfd-d75c08038c5a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:08.436432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 393/784] 10.222.0.73 () {56 vars in 1087 bytes} [Thu May 19 11:56:08 2022] GET /identity/v3/services => generated 772 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:08.466979 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6f8ce-e420-4fce-9967-ae51c1fb7bc7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:08.491753 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19506f87-2a03-4e2f-bc07-5010b362a2b6 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:08.492111 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19506f87-2a03-4e2f-bc07-5010b362a2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:08.492351 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19506f87-2a03-4e2f-bc07-5010b362a2b6 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:08.493774 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 394/785] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:08.506310 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb57b9-5f18-4010-a134-b18641d00b6f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:08.506506 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb57b9-5f18-4010-a134-b18641d00b6f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:08.506784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb57b9-5f18-4010-a134-b18641d00b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:08.527930 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831599c2-6690-4433-bbaa-8f3fc0cc9a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:08.528821 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831599c2-6690-4433-bbaa-8f3fc0cc9a96 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:08.529105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831599c2-6690-4433-bbaa-8f3fc0cc9a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:08.529380 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831599c2-6690-4433-bbaa-8f3fc0cc9a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:08.530977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-66fb57b9-5f18-4010-a134-b18641d00b6f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:08.532285 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-66fb57b9-5f18-4010-a134-b18641d00b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:08.636379 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:08.699403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831599c2-6690-4433-bbaa-8f3fc0cc9a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:08.700925 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831599c2-6690-4433-bbaa-8f3fc0cc9a96 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:08.728776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-831599c2-6690-4433-bbaa-8f3fc0cc9a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:08.728776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:08.728776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:08.728776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:08.728776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:08.728776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:08.728776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:08.728776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:08.728776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:08.728776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:08.728776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:08.728776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:08.728776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:08.728776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:08.728776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:08.729740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:08.729740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:08.729740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:08.729740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:08.729740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:08.729740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:08.729740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:08.729740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:08.729740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:08.729740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:08.729740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:08.729740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:08.729740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:08.729740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:08.729740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:08.729740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:08.729740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:08.731412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:08.731412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:08.731412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:08.731412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:08.731412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 392/786] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:08.733363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 395/787] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:08.738478 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831599c2-6690-4433-bbaa-8f3fc0cc9a96 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:08.759803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb57b9-5f18-4010-a134-b18641d00b6f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:08.862538 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:08.870615 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831599c2-6690-4433-bbaa-8f3fc0cc9a96 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:08.873790 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb57b9-5f18-4010-a134-b18641d00b6f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:08.930124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b74b39-d343-44d6-893b-ce015ce447c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:08.930921 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b74b39-d343-44d6-893b-ce015ce447c8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:08.931203 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b74b39-d343-44d6-893b-ce015ce447c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:08.931480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b74b39-d343-44d6-893b-ce015ce447c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:08.932559 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37b67a-2a22-4979-b277-a45e2fd509c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:08.933210 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37b67a-2a22-4979-b277-a45e2fd509c1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:08.933483 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37b67a-2a22-4979-b277-a45e2fd509c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:08.933750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37b67a-2a22-4979-b277-a45e2fd509c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:08.934469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37b67a-2a22-4979-b277-a45e2fd509c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:08.934827 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37b67a-2a22-4979-b277-a45e2fd509c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:08.936464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37b67a-2a22-4979-b277-a45e2fd509c1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:08.952301 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 393/788] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:08.952871 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b74b39-d343-44d6-893b-ce015ce447c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:08.957798 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37b67a-2a22-4979-b277-a45e2fd509c1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:08.964347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-98b74b39-d343-44d6-893b-ce015ce447c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:56:08.964347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:08.964347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:08.964347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:08.964347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:08.964347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:08.964347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:08.964347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:08.964347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:08.964347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:08.964347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:08.964347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:08.964347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:08.964347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:08.964347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:08.964347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:08.965287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:08.965287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:08.965287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:08.965287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:08.965287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:08.965287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:08.965287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:08.965287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:08.965287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:08.965287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:08.965287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:08.965287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:08.965287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:08.965287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:08.965287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:08.965287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:08.966123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:08.966123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:08.966123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:08.966123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:08.966123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:08.966123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:08.966123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:08.966123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:08.966123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:08.966123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:08.966123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:56:08.966123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:08.966761 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 396/789] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:56:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:08.977241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b74b39-d343-44d6-893b-ce015ce447c8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:09.025796 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:09.122970 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b74b39-d343-44d6-893b-ce015ce447c8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:09.126562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37b67a-2a22-4979-b277-a45e2fd509c1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:09.159577 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f0cd6-62e2-4c30-ba5e-bea14ee66b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:09.160631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f0cd6-62e2-4c30-ba5e-bea14ee66b15 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:09.161126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f0cd6-62e2-4c30-ba5e-bea14ee66b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:09.161628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f0cd6-62e2-4c30-ba5e-bea14ee66b15 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:09.162722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f0cd6-62e2-4c30-ba5e-bea14ee66b15 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:09.163241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f0cd6-62e2-4c30-ba5e-bea14ee66b15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:09.164841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f0cd6-62e2-4c30-ba5e-bea14ee66b15 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:09.174451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 397/790] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:56:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:09.180257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f0cd6-62e2-4c30-ba5e-bea14ee66b15 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:09.194239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1f2aa-a2f0-4764-9492-9cf287a7794b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:09.195052 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1f2aa-a2f0-4764-9492-9cf287a7794b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:09.195413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1f2aa-a2f0-4764-9492-9cf287a7794b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:09.195622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1f2aa-a2f0-4764-9492-9cf287a7794b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:09.212131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1f2aa-a2f0-4764-9492-9cf287a7794b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:09.213441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1f2aa-a2f0-4764-9492-9cf287a7794b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:09.248485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-86f1f2aa-a2f0-4764-9492-9cf287a7794b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:56:09.248485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:09.248485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:09.248485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:09.248485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:09.248485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:09.248485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:09.248485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:09.248485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:09.248485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:09.248485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:09.248485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:09.248485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:56:09.248485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:56:09.248485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:56:09.248485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:09.249505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:09.250497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:09.250497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:09.250497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:56:09.250497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:56:09.250497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:56:09.250497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:56:09.250497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:56:09.250497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:56:09.250497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:56:09.250497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:09.250497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 394/791] 10.222.0.73 () {56 vars in 1093 bytes} [Thu May 19 11:56:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:09.265777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1f2aa-a2f0-4764-9492-9cf287a7794b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:09.288528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:09.299967 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f0cd6-62e2-4c30-ba5e-bea14ee66b15 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:09.309313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:09.340564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1112a73-067c-49ca-afbb-e92c350b3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:09.341927 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1112a73-067c-49ca-afbb-e92c350b3ced None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:09.345785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1112a73-067c-49ca-afbb-e92c350b3ced None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:09.346516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1112a73-067c-49ca-afbb-e92c350b3ced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:09.370075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1112a73-067c-49ca-afbb-e92c350b3ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:09.374076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1112a73-067c-49ca-afbb-e92c350b3ced None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:09.410405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b1112a73-067c-49ca-afbb-e92c350b3ced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:09.410405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:09.410405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:09.410405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:09.410405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:09.410405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:09.410405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:09.410405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:09.410405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:09.410405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:09.410405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:09.410405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:09.410405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:09.410405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:09.410405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:09.411362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:09.411362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:09.411362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:09.411362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:09.411362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:09.411362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:09.411362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:09.411362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:09.411362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:09.411362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:09.411362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:09.411362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:09.411362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:09.411362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:09.411362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:09.411362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:09.411362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:09.412273 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:09.412273 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:09.412273 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:09.412273 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:09.425069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 398/792] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:09.426197 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1112a73-067c-49ca-afbb-e92c350b3ced None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:09.496581 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1f2aa-a2f0-4764-9492-9cf287a7794b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:09.575516 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e2151-0d41-42cc-ba26-4d9cd672e6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:09.576229 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e2151-0d41-42cc-ba26-4d9cd672e6ce None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:09.576516 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e2151-0d41-42cc-ba26-4d9cd672e6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:09.576795 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e2151-0d41-42cc-ba26-4d9cd672e6ce None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:09.577650 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e2151-0d41-42cc-ba26-4d9cd672e6ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:09.577965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e2151-0d41-42cc-ba26-4d9cd672e6ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:09.580009 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e2151-0d41-42cc-ba26-4d9cd672e6ce None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:09.613192 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 395/793] 10.222.0.73 () {56 vars in 1133 bytes} [Thu May 19 11:56:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:09.621975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e2151-0d41-42cc-ba26-4d9cd672e6ce None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:09.635253 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1112a73-067c-49ca-afbb-e92c350b3ced None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:09.709623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2acf9-398e-4a46-9cc7-f504d6451fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:09.710307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2acf9-398e-4a46-9cc7-f504d6451fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:09.710599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2acf9-398e-4a46-9cc7-f504d6451fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:09.710881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2acf9-398e-4a46-9cc7-f504d6451fb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:09.711619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2acf9-398e-4a46-9cc7-f504d6451fb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:09.711960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2acf9-398e-4a46-9cc7-f504d6451fb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:09.713331 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2acf9-398e-4a46-9cc7-f504d6451fb5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:09.736297 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:09.744875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 399/794] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:09.747289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2acf9-398e-4a46-9cc7-f504d6451fb5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:09.778383 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:09.830306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e2151-0d41-42cc-ba26-4d9cd672e6ce None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:09.888138 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ddb96-f56a-4945-93dc-449ca12a2380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:09.888809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ddb96-f56a-4945-93dc-449ca12a2380 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:09.889613 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ddb96-f56a-4945-93dc-449ca12a2380 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:09.889893 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ddb96-f56a-4945-93dc-449ca12a2380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:09.918795 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2acf9-398e-4a46-9cc7-f504d6451fb5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:09.970410 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e0f44-d09f-44ed-b562-b543cebe5c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:09.971288 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e0f44-d09f-44ed-b562-b543cebe5c13 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:09.971580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e0f44-d09f-44ed-b562-b543cebe5c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:09.971863 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e0f44-d09f-44ed-b562-b543cebe5c13 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:09.975644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ddb96-f56a-4945-93dc-449ca12a2380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:09.977139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ddb96-f56a-4945-93dc-449ca12a2380 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:09.981418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e0f44-d09f-44ed-b562-b543cebe5c13 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:09.982952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e0f44-d09f-44ed-b562-b543cebe5c13 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:10.004258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-788e0f44-d09f-44ed-b562-b543cebe5c13 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:56:10.004258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:10.004258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:10.004258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:10.004258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:10.004258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:10.004258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:10.004258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:10.004258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:10.004258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:10.004258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:10.004258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:10.004258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:56:10.004258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:56:10.004258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:56:10.004258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:10.005219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:10.006130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:10.006130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:10.006130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:56:10.006130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:56:10.006130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:56:10.006130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:56:10.006130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:56:10.006130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:56:10.006130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:56:10.006130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:10.006649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 400/795] 10.222.0.73 () {56 vars in 1117 bytes} [Thu May 19 11:56:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:10.011953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cf1d5-2872-4f20-82cf-ad7c5a8f4459 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:10.011953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cf1d5-2872-4f20-82cf-ad7c5a8f4459 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:10.011953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cf1d5-2872-4f20-82cf-ad7c5a8f4459 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:10.014501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 401/796] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:10.015617 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cf1d5-2872-4f20-82cf-ad7c5a8f4459 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:10.081717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:10.088284 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:10.104101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 396/797] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:56:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:56:10.105702 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd4654-5c51-400d-9b71-773c27888af2 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:10.106064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd4654-5c51-400d-9b71-773c27888af2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:10.106452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd4654-5c51-400d-9b71-773c27888af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:10.129333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-60bd4654-5c51-400d-9b71-773c27888af2 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:10.131116 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-60bd4654-5c51-400d-9b71-773c27888af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:10.134406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cf1d5-2872-4f20-82cf-ad7c5a8f4459 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:10.169757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae3704-5e90-4409-af76-b4cdb772edb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:10.170686 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae3704-5e90-4409-af76-b4cdb772edb9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:10.170973 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae3704-5e90-4409-af76-b4cdb772edb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:10.171254 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae3704-5e90-4409-af76-b4cdb772edb9 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:10.172144 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae3704-5e90-4409-af76-b4cdb772edb9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:10.172977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae3704-5e90-4409-af76-b4cdb772edb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:10.174413 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae3704-5e90-4409-af76-b4cdb772edb9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:10.199200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 402/798] 10.222.0.73 () {56 vars in 1149 bytes} [Thu May 19 11:56:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:10.200234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae3704-5e90-4409-af76-b4cdb772edb9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:10.225318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 397/799] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:10.225318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd4654-5c51-400d-9b71-773c27888af2 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:10.318331 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae3704-5e90-4409-af76-b4cdb772edb9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:10.342962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:10.362667 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3a1f1-fea2-416f-9796-192a686c0a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:10.363568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3a1f1-fea2-416f-9796-192a686c0a0b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:10.363943 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3a1f1-fea2-416f-9796-192a686c0a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:10.364325 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3a1f1-fea2-416f-9796-192a686c0a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:10.364888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd4654-5c51-400d-9b71-773c27888af2 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:10.368096 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:10.379957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3a1f1-fea2-416f-9796-192a686c0a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:10.379957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3a1f1-fea2-416f-9796-192a686c0a0b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:10.401123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-edf3a1f1-fea2-416f-9796-192a686c0a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:10.401123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:10.401123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:10.401123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:10.401123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:10.401123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:10.401123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:10.401123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:10.401123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:10.401123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:10.401123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:10.401123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:10.401123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:10.401123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:10.401123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:10.402226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:10.402226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:10.402226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:10.402226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:10.402226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:10.402226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:10.402226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:10.402226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:10.402226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:10.402226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:10.402226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:10.402226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:10.402226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:10.402226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:10.402226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:10.402226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:10.402226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:10.403188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:10.403188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:10.403188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:10.403188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:10.403188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 403/800] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:10.403188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3a1f1-fea2-416f-9796-192a686c0a0b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:10.415468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891d4d1-d592-4974-be1a-4442212132e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:10.416560 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891d4d1-d592-4974-be1a-4442212132e0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:10.417027 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891d4d1-d592-4974-be1a-4442212132e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:10.417490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891d4d1-d592-4974-be1a-4442212132e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:10.429027 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891d4d1-d592-4974-be1a-4442212132e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:10.430466 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891d4d1-d592-4974-be1a-4442212132e0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:10.448820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f891d4d1-d592-4974-be1a-4442212132e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:10.448820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:10.448820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:10.448820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:10.448820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:10.448820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:10.448820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:10.448820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:10.448820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:10.448820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:10.448820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:10.448820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:10.448820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:10.448820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:10.448820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:10.449724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:10.449724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:10.449724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:10.449724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:10.449724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:10.449724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:10.449724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:10.449724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:10.449724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:10.449724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:10.449724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:10.449724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:10.449724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:10.449724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:10.449724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:10.449724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:10.449724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:10.450582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:10.450582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:10.450582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:10.450582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:10.450582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 398/801] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:10.451608 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a2b3a-0a88-43b7-8f3d-d1e9afa97f91 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:10.451608 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a2b3a-0a88-43b7-8f3d-d1e9afa97f91 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:10.451850 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a2b3a-0a88-43b7-8f3d-d1e9afa97f91 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:10.457162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 399/802] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:10.457162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a2b3a-0a88-43b7-8f3d-d1e9afa97f91 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:10.516999 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3a1f1-fea2-416f-9796-192a686c0a0b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:10.557927 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a33200-9c18-4bc3-b6c6-ba9721223fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:10.559546 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a33200-9c18-4bc3-b6c6-ba9721223fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:10.560020 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a33200-9c18-4bc3-b6c6-ba9721223fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:10.560686 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a33200-9c18-4bc3-b6c6-ba9721223fa3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:10.565915 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a2b3a-0a88-43b7-8f3d-d1e9afa97f91 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:10.578026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a33200-9c18-4bc3-b6c6-ba9721223fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:10.587932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-e0a33200-9c18-4bc3-b6c6-ba9721223fa3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:10.587932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:10.587932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:10.587932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:10.587932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:10.587932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:10.587932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:10.587932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:10.587932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:10.587932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:10.587932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:10.587932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:10.587932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:10.587932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:10.587932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:10.587932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:10.588932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:10.588932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:10.588932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:10.588932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:10.588932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:10.588932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:10.588932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:10.588932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:10.588932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:10.588932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:10.588932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:10.588932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:10.588932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:10.588932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:10.588932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:10.588932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:10.589792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:10.589792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:10.589792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:10.589792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:10.589792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:10.589792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:10.589792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:10.589792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:10.589792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:10.589792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:10.589792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:10.589792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:10.589792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 404/803] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:56:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:10.590487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a33200-9c18-4bc3-b6c6-ba9721223fa3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:10.608490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede01354-f899-4b79-8f64-23847512b0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:10.609087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede01354-f899-4b79-8f64-23847512b0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:10.609371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede01354-f899-4b79-8f64-23847512b0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:10.609672 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede01354-f899-4b79-8f64-23847512b0a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:10.610429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede01354-f899-4b79-8f64-23847512b0a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:10.610734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede01354-f899-4b79-8f64-23847512b0a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:10.612118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede01354-f899-4b79-8f64-23847512b0a1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:10.623448 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:10.628268 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 400/804] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:10.628268 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ff3a0-a8d1-4c25-8d3c-5b7095e36f92 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:10.628268 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ff3a0-a8d1-4c25-8d3c-5b7095e36f92 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:10.628268 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ff3a0-a8d1-4c25-8d3c-5b7095e36f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:10.643542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5a3ff3a0-a8d1-4c25-8d3c-5b7095e36f92 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:10.644869 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5a3ff3a0-a8d1-4c25-8d3c-5b7095e36f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:10.657666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:10.701133 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a33200-9c18-4bc3-b6c6-ba9721223fa3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:10.716932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 401/805] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:10.718032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ff3a0-a8d1-4c25-8d3c-5b7095e36f92 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:10.756811 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a8447-93cf-41cc-baa5-3d303cdab38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:10.757490 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a8447-93cf-41cc-baa5-3d303cdab38f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:10.757778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a8447-93cf-41cc-baa5-3d303cdab38f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:10.758057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a8447-93cf-41cc-baa5-3d303cdab38f None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:10.758781 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a8447-93cf-41cc-baa5-3d303cdab38f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:10.759511 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a8447-93cf-41cc-baa5-3d303cdab38f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:10.761266 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a8447-93cf-41cc-baa5-3d303cdab38f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:10.781439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 405/806] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:10.781439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a8447-93cf-41cc-baa5-3d303cdab38f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:10.820620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ff3a0-a8d1-4c25-8d3c-5b7095e36f92 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:10.855745 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecd676-393f-4830-96c6-624ad5eaa4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:10.856494 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecd676-393f-4830-96c6-624ad5eaa4ee None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:10.856776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecd676-393f-4830-96c6-624ad5eaa4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:10.857053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecd676-393f-4830-96c6-624ad5eaa4ee None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:10.857831 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecd676-393f-4830-96c6-624ad5eaa4ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:10.858133 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecd676-393f-4830-96c6-624ad5eaa4ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:10.859600 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecd676-393f-4830-96c6-624ad5eaa4ee None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:10.868837 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 402/807] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:56:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:10.869738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecd676-393f-4830-96c6-624ad5eaa4ee None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:10.884587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:10.885343 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:10.897609 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a8447-93cf-41cc-baa5-3d303cdab38f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:10.934065 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a57b24-fd75-4534-b7bb-f9897c39909c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:10.934860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a57b24-fd75-4534-b7bb-f9897c39909c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:10.935151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a57b24-fd75-4534-b7bb-f9897c39909c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:10.935442 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a57b24-fd75-4534-b7bb-f9897c39909c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:10.942886 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a57b24-fd75-4534-b7bb-f9897c39909c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:10.944382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a57b24-fd75-4534-b7bb-f9897c39909c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:10.958693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-10a57b24-fd75-4534-b7bb-f9897c39909c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:10.958693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:10.958693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:10.958693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:10.958693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:10.958693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:10.958693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:10.958693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:10.958693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:10.958693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:10.958693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:10.958693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:10.958693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:56:10.958693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:56:10.958693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:56:10.959756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:56:10.959756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:10.959756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:10.959756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:10.959756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:10.959756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:10.959756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:10.959756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:10.959756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:10.959756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:10.959756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:10.959756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:10.959756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:10.959756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:10.959756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:10.959756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:10.959756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:10.960720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:56:10.960720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:56:10.960720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:56:10.960720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:56:10.960720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:56:10.960720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:56:10.960720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:10.960720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:10.964657 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 406/808] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:10.965179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a57b24-fd75-4534-b7bb-f9897c39909c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:10.980384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecd676-393f-4830-96c6-624ad5eaa4ee None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:11.014657 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007a1b4-3ced-4ce1-b2eb-dd4221161011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:11.015468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007a1b4-3ced-4ce1-b2eb-dd4221161011 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:11.015750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007a1b4-3ced-4ce1-b2eb-dd4221161011 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:11.016677 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007a1b4-3ced-4ce1-b2eb-dd4221161011 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:11.017338 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007a1b4-3ced-4ce1-b2eb-dd4221161011 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:11.018756 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007a1b4-3ced-4ce1-b2eb-dd4221161011 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:11.031881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-4007a1b4-3ced-4ce1-b2eb-dd4221161011 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:56:11.031881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:11.031881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:11.031881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:11.031881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:11.031881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:11.031881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:11.031881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:11.031881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:56:11.031881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:11.031881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:11.031881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:11.031881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:11.031881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:11.031881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:11.031881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:11.033012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:11.033012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:11.033012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:11.033012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:11.033012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:11.033012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:11.033012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:11.033012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:11.033012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:11.033012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:11.033012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:11.033012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:11.033012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:11.033012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:11.033012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:11.033012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:11.033954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:11.033954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:11.033954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:11.033954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:11.033954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:11.033954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:11.033954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:11.033954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:11.033954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:11.033954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:11.033954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:11.033954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:11.033954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:11.033954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 11:56:11.033954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:11.033954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 403/809] 10.222.0.73 () {56 vars in 1129 bytes} [Thu May 19 11:56:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:11.034783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007a1b4-3ced-4ce1-b2eb-dd4221161011 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:11.075104 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a57b24-fd75-4534-b7bb-f9897c39909c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:11.105053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:11.108353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18a38b-fb66-4628-ac5c-6c572909a642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:11.109196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18a38b-fb66-4628-ac5c-6c572909a642 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:11.109479 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18a38b-fb66-4628-ac5c-6c572909a642 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:11.109831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18a38b-fb66-4628-ac5c-6c572909a642 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:11.116480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18a38b-fb66-4628-ac5c-6c572909a642 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:11.117908 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18a38b-fb66-4628-ac5c-6c572909a642 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:11.132817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7c18a38b-fb66-4628-ac5c-6c572909a642 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:11.132817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:11.132817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:11.132817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:11.132817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:11.132817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:11.132817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:11.132817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:11.132817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:11.132817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:11.132817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:11.132817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:11.132817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:56:11.132817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:56:11.132817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:56:11.133695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:56:11.133695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:11.133695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:11.133695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:11.133695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:11.133695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:11.133695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:11.133695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:11.133695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:11.133695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:11.133695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:11.133695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:11.133695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:11.133695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:11.133695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:11.133695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:11.133695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:11.134589 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:56:11.134589 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:56:11.134589 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:56:11.134589 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:56:11.134589 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:56:11.134589 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:56:11.134589 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:11.134589 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:11.134589 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 407/810] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:11.135681 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007a1b4-3ced-4ce1-b2eb-dd4221161011 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:11.135771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18a38b-fb66-4628-ac5c-6c572909a642 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:11.147045 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:11.172483 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da91777-9cc2-464a-9516-19587171eab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:11.173266 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da91777-9cc2-464a-9516-19587171eab3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:11.173546 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da91777-9cc2-464a-9516-19587171eab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:11.173817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da91777-9cc2-464a-9516-19587171eab3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:11.184178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da91777-9cc2-464a-9516-19587171eab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:11.185601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da91777-9cc2-464a-9516-19587171eab3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:11.202416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-9da91777-9cc2-464a-9516-19587171eab3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:11.202416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:11.202416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:11.202416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:11.202416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:11.202416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:11.202416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:11.202416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:11.202416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:11.202416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:11.202416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:11.202416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:11.202416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:11.202416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:11.202416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:11.203517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:11.203517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:11.203517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:11.203517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:11.203517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:11.203517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:11.203517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:11.203517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:11.203517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:11.203517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:11.203517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:11.203517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:11.203517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:11.203517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:11.203517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:11.203517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:11.203517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:11.205324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:11.205324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:11.205324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:11.205324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:11.205324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 404/811] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:11.205324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da91777-9cc2-464a-9516-19587171eab3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:11.236387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18a38b-fb66-4628-ac5c-6c572909a642 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:11.270967 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c8d85-49f0-43c9-bd2d-6e0290388dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:11.271628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c8d85-49f0-43c9-bd2d-6e0290388dec None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:11.271923 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c8d85-49f0-43c9-bd2d-6e0290388dec None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:11.272226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c8d85-49f0-43c9-bd2d-6e0290388dec None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:11.273013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c8d85-49f0-43c9-bd2d-6e0290388dec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:11.273327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c8d85-49f0-43c9-bd2d-6e0290388dec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:11.274749 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c8d85-49f0-43c9-bd2d-6e0290388dec None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:11.286037 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 408/812] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:56:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:11.287248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a29ea-3c45-4e8a-b8ad-2eb728f1a6ca None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:11.287540 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a29ea-3c45-4e8a-b8ad-2eb728f1a6ca None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:11.287823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a29ea-3c45-4e8a-b8ad-2eb728f1a6ca None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:11.289081 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 409/813] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:11.289770 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a29ea-3c45-4e8a-b8ad-2eb728f1a6ca None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:11.309229 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da91777-9cc2-464a-9516-19587171eab3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:11.331745 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:11.342665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e82926-e3b7-467a-979e-0f0b1ea3541c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:11.343323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e82926-e3b7-467a-979e-0f0b1ea3541c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:11.343610 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e82926-e3b7-467a-979e-0f0b1ea3541c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:11.343883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e82926-e3b7-467a-979e-0f0b1ea3541c None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:11.344700 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e82926-e3b7-467a-979e-0f0b1ea3541c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:11.345006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e82926-e3b7-467a-979e-0f0b1ea3541c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:11.346353 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e82926-e3b7-467a-979e-0f0b1ea3541c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:11.350780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 405/814] 10.222.0.73 () {56 vars in 1124 bytes} [Thu May 19 11:56:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:11.351533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e82926-e3b7-467a-979e-0f0b1ea3541c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:11.360504 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:11.394514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a29ea-3c45-4e8a-b8ad-2eb728f1a6ca None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:11.428660 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdd5ae-8490-4109-baca-fdc75ad77eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:11.429320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdd5ae-8490-4109-baca-fdc75ad77eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:11.429611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdd5ae-8490-4109-baca-fdc75ad77eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:11.429897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdd5ae-8490-4109-baca-fdc75ad77eb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:11.430687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdd5ae-8490-4109-baca-fdc75ad77eb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:11.431007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdd5ae-8490-4109-baca-fdc75ad77eb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:11.432558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdd5ae-8490-4109-baca-fdc75ad77eb2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:11.445490 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 410/815] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:56:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:11.446341 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdd5ae-8490-4109-baca-fdc75ad77eb2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:11.451349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e82926-e3b7-467a-979e-0f0b1ea3541c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:11.484132 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c19e9f-acd1-4f2e-882c-cf0192582177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:11.485319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c19e9f-acd1-4f2e-882c-cf0192582177 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:11.485604 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c19e9f-acd1-4f2e-882c-cf0192582177 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:11.485879 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c19e9f-acd1-4f2e-882c-cf0192582177 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:11.486593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c19e9f-acd1-4f2e-882c-cf0192582177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:11.486901 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c19e9f-acd1-4f2e-882c-cf0192582177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:11.488279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c19e9f-acd1-4f2e-882c-cf0192582177 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:11.499940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 406/816] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:11.501666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f664ef-ee06-42a3-ae8b-c7e4004484a5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:11.501949 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f664ef-ee06-42a3-ae8b-c7e4004484a5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:11.502224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f664ef-ee06-42a3-ae8b-c7e4004484a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:11.518308 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-97f664ef-ee06-42a3-ae8b-c7e4004484a5 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:11.519476 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-97f664ef-ee06-42a3-ae8b-c7e4004484a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:11.551360 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdd5ae-8490-4109-baca-fdc75ad77eb2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:11.562552 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:11.580107 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:11.587489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5eebc-6b74-4485-943f-5c637735081a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:11.588064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 407/817] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:11.588510 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5eebc-6b74-4485-943f-5c637735081a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:11.588510 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5eebc-6b74-4485-943f-5c637735081a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:11.588813 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5eebc-6b74-4485-943f-5c637735081a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:11.588938 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f664ef-ee06-42a3-ae8b-c7e4004484a5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:11.589551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5eebc-6b74-4485-943f-5c637735081a None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=bd0c1f0710f3447d94e67048a508781e) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:11.589870 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5eebc-6b74-4485-943f-5c637735081a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:11.591288 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5eebc-6b74-4485-943f-5c637735081a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:11.605605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 411/818] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:56:11 2022] GET /identity/v3/role_assignments?user.id=bd0c1f0710f3447d94e67048a508781e&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:11.605605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5eebc-6b74-4485-943f-5c637735081a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:11.713723 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f664ef-ee06-42a3-ae8b-c7e4004484a5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:11.739621 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5eebc-6b74-4485-943f-5c637735081a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:11.755942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdc0b6-7d8f-4f13-a6f2-dfb78aa6392a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:11.756645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdc0b6-7d8f-4f13-a6f2-dfb78aa6392a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:11.756926 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdc0b6-7d8f-4f13-a6f2-dfb78aa6392a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:11.757200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdc0b6-7d8f-4f13-a6f2-dfb78aa6392a None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:11.757920 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdc0b6-7d8f-4f13-a6f2-dfb78aa6392a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:11.758218 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdc0b6-7d8f-4f13-a6f2-dfb78aa6392a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:11.759613 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdc0b6-7d8f-4f13-a6f2-dfb78aa6392a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:11.765011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 408/819] 10.222.0.73 () {56 vars in 1124 bytes} [Thu May 19 11:56:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:11.765871 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdc0b6-7d8f-4f13-a6f2-dfb78aa6392a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:11.787608 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97266051-1b67-4a7a-8623-b39b545de82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:11.788831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97266051-1b67-4a7a-8623-b39b545de82e None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:11.789957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97266051-1b67-4a7a-8623-b39b545de82e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:11.789957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97266051-1b67-4a7a-8623-b39b545de82e None admin] PATH_INFO: `/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/b6c5da324ab2405a84036db91a1366a0/roles/d21329f1cd364fba8b79529896e00f81` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:11.806752 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97266051-1b67-4a7a-8623-b39b545de82e None admin] RBAC: Authorizing `identity:create_grant(project_id=d90551d9446e4f2cbd14312d2af9f7c9, user_id=b6c5da324ab2405a84036db91a1366a0, role_id=d21329f1cd364fba8b79529896e00f81)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:11.808301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97266051-1b67-4a7a-8623-b39b545de82e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:11.816160 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:11.821863 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 412/820] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:56:11 2022] PUT /identity/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/b6c5da324ab2405a84036db91a1366a0/roles/d21329f1cd364fba8b79529896e00f81 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:56:11.822912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97266051-1b67-4a7a-8623-b39b545de82e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:11.897832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdc0b6-7d8f-4f13-a6f2-dfb78aa6392a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:11.898450 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:11.943736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6b1b4-ee6d-4082-b448-65f2820c2dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:11.944871 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6b1b4-ee6d-4082-b448-65f2820c2dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:11.945323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6b1b4-ee6d-4082-b448-65f2820c2dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:11.945751 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6b1b4-ee6d-4082-b448-65f2820c2dc7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:11.946456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97266051-1b67-4a7a-8623-b39b545de82e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:11.954688 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6b1b4-ee6d-4082-b448-65f2820c2dc7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:11.956870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6b1b4-ee6d-4082-b448-65f2820c2dc7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:11.973907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-52e6b1b4-ee6d-4082-b448-65f2820c2dc7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:56:11.973907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:11.973907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:11.973907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:11.973907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:11.973907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:11.973907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:11.973907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:11.973907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:11.973907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:11.973907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:11.973907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:11.973907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:56:11.973907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:56:11.973907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:56:11.973907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:11.975092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:11.976105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:11.976105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:11.976105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:56:11.976105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:56:11.976105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:56:11.976105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:56:11.976105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:56:11.976105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:56:11.976105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:56:11.976105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:11.978676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 409/821] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:56:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:11.979737 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6b1b4-ee6d-4082-b448-65f2820c2dc7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:11.994336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e91dac-acb7-45a1-a6fc-31e5af6ebce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:11.995276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e91dac-acb7-45a1-a6fc-31e5af6ebce3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:11.995672 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e91dac-acb7-45a1-a6fc-31e5af6ebce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:11.996059 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e91dac-acb7-45a1-a6fc-31e5af6ebce3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:11.996811 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e91dac-acb7-45a1-a6fc-31e5af6ebce3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:11.998401 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e91dac-acb7-45a1-a6fc-31e5af6ebce3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:12.012532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-43e91dac-acb7-45a1-a6fc-31e5af6ebce3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:56:12.012532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:12.012532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:12.012532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:12.012532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:12.012532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:12.012532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:12.012532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:12.012532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:56:12.012532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:12.012532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:12.012532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:12.012532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:12.012532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:12.012532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:12.012532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:12.012532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:12.013562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:12.013562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:12.013562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:12.013562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:12.013562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:12.013562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:12.013562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:12.013562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:12.013562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:12.013562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:12.013562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:12.013562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:12.013562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:12.013562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:12.013562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:12.013562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:12.014387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:12.014387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:12.014387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:12.014387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:12.014387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:12.014387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:12.014387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:12.014387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:12.014387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:12.014387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:12.014387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:12.014387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:12.014387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 11:56:12.014387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:12.014387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 413/822] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:11 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:12.015168 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e91dac-acb7-45a1-a6fc-31e5af6ebce3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:12.110329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6b1b4-ee6d-4082-b448-65f2820c2dc7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:12.112070 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:12.150749 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e91dac-acb7-45a1-a6fc-31e5af6ebce3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:12.155622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e9290-51a6-40f4-acfc-764f6462369e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:12.156371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e9290-51a6-40f4-acfc-764f6462369e None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:12.157214 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e9290-51a6-40f4-acfc-764f6462369e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:12.157499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e9290-51a6-40f4-acfc-764f6462369e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:12.158305 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e9290-51a6-40f4-acfc-764f6462369e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:12.160352 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e9290-51a6-40f4-acfc-764f6462369e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:12.161471 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:12.190903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 410/823] 10.222.0.73 () {60 vars in 1144 bytes} [Thu May 19 11:56:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:12.192742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e9290-51a6-40f4-acfc-764f6462369e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:12.220864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a264d0-0383-4941-95cc-d000ba478cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:12.221677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a264d0-0383-4941-95cc-d000ba478cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:12.222040 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a264d0-0383-4941-95cc-d000ba478cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:12.222398 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a264d0-0383-4941-95cc-d000ba478cd3 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:12.223357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a264d0-0383-4941-95cc-d000ba478cd3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:12.225514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a264d0-0383-4941-95cc-d000ba478cd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:12.228932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a264d0-0383-4941-95cc-d000ba478cd3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:12.259614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 414/824] 10.222.0.73 () {56 vars in 1135 bytes} [Thu May 19 11:56:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:12.268496 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a264d0-0383-4941-95cc-d000ba478cd3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:12.411011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e9290-51a6-40f4-acfc-764f6462369e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:12.448241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a264d0-0383-4941-95cc-d000ba478cd3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:12.463906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b963144-6d89-41c3-aec2-1e40644c5511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:12.464900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b963144-6d89-41c3-aec2-1e40644c5511 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:12.465385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b963144-6d89-41c3-aec2-1e40644c5511 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:12.465725 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b963144-6d89-41c3-aec2-1e40644c5511 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:12.466523 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b963144-6d89-41c3-aec2-1e40644c5511 None admin] RBAC: Adding query filter params (name=network) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:12.466907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b963144-6d89-41c3-aec2-1e40644c5511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:12.468437 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b963144-6d89-41c3-aec2-1e40644c5511 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:12.474303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 411/825] 10.222.0.73 () {56 vars in 1112 bytes} [Thu May 19 11:56:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:12.479728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b963144-6d89-41c3-aec2-1e40644c5511 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:12.491605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf26421-c8b4-48f7-8b5a-3152569767b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:12.492808 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf26421-c8b4-48f7-8b5a-3152569767b6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:12.493310 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf26421-c8b4-48f7-8b5a-3152569767b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:12.493770 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf26421-c8b4-48f7-8b5a-3152569767b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:12.505194 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf26421-c8b4-48f7-8b5a-3152569767b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:12.506970 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf26421-c8b4-48f7-8b5a-3152569767b6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:12.510240 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:12.527005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7cf26421-c8b4-48f7-8b5a-3152569767b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:12.527005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:12.527005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:12.527005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:12.527005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:12.527005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:12.527005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:12.527005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:12.527005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:12.527005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:12.527005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:12.527005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:12.527005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:12.527005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:12.527005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:12.527975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:12.527975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:12.527975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:12.527975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:12.527975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:12.527975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:12.527975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:12.527975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:12.527975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:12.527975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:12.527975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:12.527975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:12.527975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:12.527975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:12.527975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:12.527975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:12.527975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:12.529025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:12.529025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:12.529025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:12.529025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:12.530920 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 415/826] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:12.536673 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf26421-c8b4-48f7-8b5a-3152569767b6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:12.559235 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:12.621609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b963144-6d89-41c3-aec2-1e40644c5511 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:12.660033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2774bdd-83ae-4403-8615-8c388227572b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:12.660945 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2774bdd-83ae-4403-8615-8c388227572b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:12.661399 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2774bdd-83ae-4403-8615-8c388227572b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:12.661817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2774bdd-83ae-4403-8615-8c388227572b None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:12.662664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2774bdd-83ae-4403-8615-8c388227572b None admin] RBAC: Adding query filter params (type=network) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:12.663111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2774bdd-83ae-4403-8615-8c388227572b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:12.664640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2774bdd-83ae-4403-8615-8c388227572b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:12.671004 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 412/827] 10.222.0.73 () {56 vars in 1112 bytes} [Thu May 19 11:56:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:12.676510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2774bdd-83ae-4403-8615-8c388227572b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:12.701853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf26421-c8b4-48f7-8b5a-3152569767b6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:12.775028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:12.793529 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2774bdd-83ae-4403-8615-8c388227572b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:12.804622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661b240-3386-4c3b-8751-df42a93a2023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:12.805308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661b240-3386-4c3b-8751-df42a93a2023 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:12.805599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661b240-3386-4c3b-8751-df42a93a2023 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:12.805883 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661b240-3386-4c3b-8751-df42a93a2023 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:12.806625 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661b240-3386-4c3b-8751-df42a93a2023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:12.806936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661b240-3386-4c3b-8751-df42a93a2023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:12.808333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661b240-3386-4c3b-8751-df42a93a2023 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:12.833593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4f031-4527-4125-a731-6e55385db524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:12.834474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4f031-4527-4125-a731-6e55385db524 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:12.834898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4f031-4527-4125-a731-6e55385db524 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:12.835314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4f031-4527-4125-a731-6e55385db524 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:12.836456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4f031-4527-4125-a731-6e55385db524 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:12.837962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4f031-4527-4125-a731-6e55385db524 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:12.838399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 416/828] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:12.843693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661b240-3386-4c3b-8751-df42a93a2023 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:12.860485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 413/829] 10.222.0.73 () {60 vars in 1144 bytes} [Thu May 19 11:56:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:56:12.986314 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:13.026502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661b240-3386-4c3b-8751-df42a93a2023 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:13.085067 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55775601-bd5b-47bb-ac45-62bc1bfab8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:13.085871 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55775601-bd5b-47bb-ac45-62bc1bfab8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:13.086155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55775601-bd5b-47bb-ac45-62bc1bfab8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:13.086434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55775601-bd5b-47bb-ac45-62bc1bfab8e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:13.093772 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55775601-bd5b-47bb-ac45-62bc1bfab8e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:13.095795 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55775601-bd5b-47bb-ac45-62bc1bfab8e8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:13.110246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-55775601-bd5b-47bb-ac45-62bc1bfab8e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:13.110246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:13.110246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:13.110246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:13.110246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:13.110246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:13.110246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:13.110246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:13.110246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:13.110246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:13.110246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:13.110246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:13.110246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:56:13.110246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:56:13.110246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:56:13.111462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:56:13.111462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:13.111462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:13.111462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:13.111462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:13.111462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:13.111462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:13.111462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:13.111462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:13.111462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:13.111462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:13.111462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:13.111462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:13.111462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:13.111462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:13.111462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:13.111462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:13.112717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:56:13.112717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:56:13.112717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:56:13.112717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:56:13.112717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:56:13.112717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:56:13.112717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:13.112717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:13.112717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 417/830] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:13.117525 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4f031-4527-4125-a731-6e55385db524 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:13.233762 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4f031-4527-4125-a731-6e55385db524 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:13.268883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d75cd3-01d4-4b7f-922f-bb36fa1c5438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:13.269560 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75cd3-01d4-4b7f-922f-bb36fa1c5438 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:13.269849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75cd3-01d4-4b7f-922f-bb36fa1c5438 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:13.270127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75cd3-01d4-4b7f-922f-bb36fa1c5438 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:13.270921 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d75cd3-01d4-4b7f-922f-bb36fa1c5438 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:13.271234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d75cd3-01d4-4b7f-922f-bb36fa1c5438 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:13.272684 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d75cd3-01d4-4b7f-922f-bb36fa1c5438 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:13.285901 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 414/831] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:56:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:13.291681 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55775601-bd5b-47bb-ac45-62bc1bfab8e8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:13.436355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55775601-bd5b-47bb-ac45-62bc1bfab8e8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:13.467649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:13.477612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84851c04-0e4d-4dae-a0fe-782a10e311b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:13.478510 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84851c04-0e4d-4dae-a0fe-782a10e311b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:13.478791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84851c04-0e4d-4dae-a0fe-782a10e311b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:13.479125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84851c04-0e4d-4dae-a0fe-782a10e311b3 None admin] PATH_INFO: `/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/371dae58e95d403b97e311c6616adab5/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:13.481136 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84851c04-0e4d-4dae-a0fe-782a10e311b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d90551d9446e4f2cbd14312d2af9f7c9, user_id=371dae58e95d403b97e311c6616adab5, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:13.482619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84851c04-0e4d-4dae-a0fe-782a10e311b3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:13.496323 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 418/832] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:56:13 2022] PUT /identity/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/371dae58e95d403b97e311c6616adab5/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:56:14.081057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe72e52-6340-47a6-bd20-c7212663a692 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:14.081605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe72e52-6340-47a6-bd20-c7212663a692 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:14.081605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe72e52-6340-47a6-bd20-c7212663a692 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:14.083250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 415/833] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:14.088384 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cc76d-c0e2-4e40-b77d-40d3692818b4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:14.088786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cc76d-c0e2-4e40-b77d-40d3692818b4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:14.088963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cc76d-c0e2-4e40-b77d-40d3692818b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:14.106292 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3d1cc76d-c0e2-4e40-b77d-40d3692818b4 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:14.107665 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3d1cc76d-c0e2-4e40-b77d-40d3692818b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:14.181869 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 419/834] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:14.203572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe72e52-6340-47a6-bd20-c7212663a692 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:14.206861 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:14.318666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe72e52-6340-47a6-bd20-c7212663a692 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:14.355480 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243997fc-8322-446f-94ad-54e1b698b48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:14.356249 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243997fc-8322-446f-94ad-54e1b698b48e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:14.356539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243997fc-8322-446f-94ad-54e1b698b48e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:14.356820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243997fc-8322-446f-94ad-54e1b698b48e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:14.357484 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243997fc-8322-446f-94ad-54e1b698b48e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:14.358857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243997fc-8322-446f-94ad-54e1b698b48e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:14.374649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-243997fc-8322-446f-94ad-54e1b698b48e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:56:14.374649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:14.374649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:14.374649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:14.374649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:14.374649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:14.374649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:14.374649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:14.374649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:56:14.374649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:14.374649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:14.374649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:14.374649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:14.374649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:14.374649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:14.374649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:14.375655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:14.375655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:14.375655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:14.375655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:14.375655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:14.375655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:14.375655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:14.375655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:14.375655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:14.375655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:14.375655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:14.375655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:14.375655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:14.375655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:14.375655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:14.375655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:14.376512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:14.376512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:14.376512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:14.376512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:14.376512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:14.376512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:14.376512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:14.376512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:14.376512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:14.376512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:14.376512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:14.376512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:14.376512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:14.376512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:56:14.376512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:14.376512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 416/835] 10.222.0.73 () {56 vars in 1132 bytes} [Thu May 19 11:56:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:14.382972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cc76d-c0e2-4e40-b77d-40d3692818b4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:14.387004 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a21426-a985-466f-8483-4f2f179bae32 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:14.387289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a21426-a985-466f-8483-4f2f179bae32 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:14.387564 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a21426-a985-466f-8483-4f2f179bae32 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:14.391996 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 417/836] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:14.395431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37415d0-b1a0-4baf-a48f-06c521c9ec68 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:14.396074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37415d0-b1a0-4baf-a48f-06c521c9ec68 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:14.396358 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37415d0-b1a0-4baf-a48f-06c521c9ec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:14.417735 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a37415d0-b1a0-4baf-a48f-06c521c9ec68 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:14.419062 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a37415d0-b1a0-4baf-a48f-06c521c9ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:14.482856 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:14.492719 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 418/837] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:14.510735 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cc76d-c0e2-4e40-b77d-40d3692818b4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:14.521165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37415d0-b1a0-4baf-a48f-06c521c9ec68 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:14.536955 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:14.555652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09c6af-6fc4-4a91-9da1-971121f4e8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:14.556508 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09c6af-6fc4-4a91-9da1-971121f4e8df None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:14.557009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09c6af-6fc4-4a91-9da1-971121f4e8df None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:14.557356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09c6af-6fc4-4a91-9da1-971121f4e8df None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:14.558448 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09c6af-6fc4-4a91-9da1-971121f4e8df None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:14.558847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09c6af-6fc4-4a91-9da1-971121f4e8df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:14.560633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09c6af-6fc4-4a91-9da1-971121f4e8df None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:14.571204 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 420/838] 10.222.0.73 () {56 vars in 1126 bytes} [Thu May 19 11:56:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:14.572766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09c6af-6fc4-4a91-9da1-971121f4e8df None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:14.650103 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37415d0-b1a0-4baf-a48f-06c521c9ec68 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:14.697740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5f0ce-783b-4481-97a5-1dfc47986964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:14.698952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5f0ce-783b-4481-97a5-1dfc47986964 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:14.699432 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5f0ce-783b-4481-97a5-1dfc47986964 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:14.699967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5f0ce-783b-4481-97a5-1dfc47986964 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:14.700887 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09c6af-6fc4-4a91-9da1-971121f4e8df None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:14.712546 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5f0ce-783b-4481-97a5-1dfc47986964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:14.721085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-6cc5f0ce-783b-4481-97a5-1dfc47986964 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:56:14.721085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:14.721085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:14.721085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:14.721085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:14.721085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:14.721085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:14.721085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:14.721085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:14.721085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:14.721085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:14.721085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:14.721085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:14.721085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:14.721085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:14.721085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:14.722033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:14.722033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:14.722033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:14.722033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:14.722033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:14.722033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:14.722033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:14.722033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:14.722033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:14.722033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:14.722033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:14.722033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:14.722033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:14.722033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:14.722033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:14.722033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:14.722863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:14.722863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:14.722863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:14.722863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:14.722863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:14.722863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:14.722863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:14.722863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:14.722863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:14.722863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:14.722863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:56:14.722863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:14.725660 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 419/839] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:56:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:14.734110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5f0ce-783b-4481-97a5-1dfc47986964 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:14.744216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60220e5-cc73-45cf-b1c5-5611fd384379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:14.745278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60220e5-cc73-45cf-b1c5-5611fd384379 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:14.745759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60220e5-cc73-45cf-b1c5-5611fd384379 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:14.746240 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60220e5-cc73-45cf-b1c5-5611fd384379 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:14.747320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60220e5-cc73-45cf-b1c5-5611fd384379 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:14.747823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60220e5-cc73-45cf-b1c5-5611fd384379 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:14.749516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60220e5-cc73-45cf-b1c5-5611fd384379 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:14.759982 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 421/840] 10.222.0.73 () {56 vars in 1126 bytes} [Thu May 19 11:56:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:14.800528 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:14.851239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5f0ce-783b-4481-97a5-1dfc47986964 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:14.874332 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf9646-bfcd-4e64-8770-b34aedbd80b4 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:14.874975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf9646-bfcd-4e64-8770-b34aedbd80b4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:14.876338 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf9646-bfcd-4e64-8770-b34aedbd80b4 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:14.878274 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 422/841] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:14.884174 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4262812-e9f6-4d42-b896-9c2574cd44f8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:14.884785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4262812-e9f6-4d42-b896-9c2574cd44f8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:14.885272 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4262812-e9f6-4d42-b896-9c2574cd44f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:14.889263 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f172e86-fc90-4078-92ae-916d9123ffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:14.889943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f172e86-fc90-4078-92ae-916d9123ffcc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:14.890226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f172e86-fc90-4078-92ae-916d9123ffcc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:14.890500 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f172e86-fc90-4078-92ae-916d9123ffcc None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:14.891848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f172e86-fc90-4078-92ae-916d9123ffcc None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:14.892186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f172e86-fc90-4078-92ae-916d9123ffcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:14.894835 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f172e86-fc90-4078-92ae-916d9123ffcc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:14.905727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e4262812-e9f6-4d42-b896-9c2574cd44f8 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:14.907346 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e4262812-e9f6-4d42-b896-9c2574cd44f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:14.909526 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 420/842] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:56:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:14.911949 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f172e86-fc90-4078-92ae-916d9123ffcc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:14.956990 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:14.990262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 423/843] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:15.013357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4262812-e9f6-4d42-b896-9c2574cd44f8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:15.052492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f172e86-fc90-4078-92ae-916d9123ffcc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:15.075988 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:15.097926 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca4377-4435-4766-8981-5735707f0a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:15.099527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca4377-4435-4766-8981-5735707f0a7b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:15.100015 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca4377-4435-4766-8981-5735707f0a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:15.100600 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca4377-4435-4766-8981-5735707f0a7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:15.114842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca4377-4435-4766-8981-5735707f0a7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:15.117204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca4377-4435-4766-8981-5735707f0a7b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:15.122432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4262812-e9f6-4d42-b896-9c2574cd44f8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:15.140445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-cdca4377-4435-4766-8981-5735707f0a7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:15.140445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:15.140445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:15.140445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:15.140445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:15.140445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:15.140445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:15.140445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:15.140445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:15.140445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:15.140445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:15.140445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:15.140445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:15.140445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:15.140445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:15.141576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:15.141576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:15.141576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:15.141576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:15.141576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:15.141576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:15.141576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:15.141576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:15.141576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:15.141576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:15.141576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:15.141576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:15.141576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:15.141576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:15.141576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:15.141576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:15.141576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:15.142667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:15.142667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:15.142667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:15.142667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:15.144971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 421/844] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:15.150806 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca4377-4435-4766-8981-5735707f0a7b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:15.163158 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb2701-6aa6-4853-a5e7-3cd8ea181bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:15.163860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb2701-6aa6-4853-a5e7-3cd8ea181bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:15.164316 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb2701-6aa6-4853-a5e7-3cd8ea181bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:15.164690 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb2701-6aa6-4853-a5e7-3cd8ea181bc1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:15.165443 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb2701-6aa6-4853-a5e7-3cd8ea181bc1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:15.167006 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb2701-6aa6-4853-a5e7-3cd8ea181bc1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:15.180960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-2efb2701-6aa6-4853-a5e7-3cd8ea181bc1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:56:15.180960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:15.180960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:15.180960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:15.180960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:15.180960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:15.180960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:15.180960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:15.180960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:56:15.180960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:15.180960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:15.180960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:15.180960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:15.180960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:15.180960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:15.180960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:15.180960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:15.182172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:15.182172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:15.182172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:15.182172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:15.182172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:15.182172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:15.182172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:15.182172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:15.182172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:15.182172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:15.182172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:15.182172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:15.182172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:15.182172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:15.182172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:15.182172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:15.183167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:15.183167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:15.183167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:15.183167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:15.183167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:15.183167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:15.183167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:15.183167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:15.183167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:15.183167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:15.183167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:15.183167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:15.183167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:56:15.183167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:15.190618 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 424/845] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:56:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:15.191564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb2701-6aa6-4853-a5e7-3cd8ea181bc1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:15.247829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:15.268389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca4377-4435-4766-8981-5735707f0a7b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:15.305988 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d721b-364f-42d9-b460-ccbba07bf259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:15.306856 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d721b-364f-42d9-b460-ccbba07bf259 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:15.307232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d721b-364f-42d9-b460-ccbba07bf259 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:15.307649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d721b-364f-42d9-b460-ccbba07bf259 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:15.308593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d721b-364f-42d9-b460-ccbba07bf259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:15.309001 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d721b-364f-42d9-b460-ccbba07bf259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:15.310469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d721b-364f-42d9-b460-ccbba07bf259 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:15.323378 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb2701-6aa6-4853-a5e7-3cd8ea181bc1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:15.328251 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 422/846] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:15.329893 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d721b-364f-42d9-b460-ccbba07bf259 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:15.364284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d4940-292f-425d-af0b-d58d435b0298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:15.364961 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d4940-292f-425d-af0b-d58d435b0298 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:15.365246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d4940-292f-425d-af0b-d58d435b0298 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:15.365687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d4940-292f-425d-af0b-d58d435b0298 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:15.366394 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d4940-292f-425d-af0b-d58d435b0298 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:15.366704 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d4940-292f-425d-af0b-d58d435b0298 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:15.368162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d4940-292f-425d-af0b-d58d435b0298 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:15.378264 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 425/847] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:56:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:15.379240 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d4940-292f-425d-af0b-d58d435b0298 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:15.384291 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:15.456869 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d721b-364f-42d9-b460-ccbba07bf259 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:15.486041 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d4940-292f-425d-af0b-d58d435b0298 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:15.493436 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:15.501098 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037a7f2-4a09-48c5-99c1-79fa2de21e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:15.502184 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037a7f2-4a09-48c5-99c1-79fa2de21e08 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:15.502563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037a7f2-4a09-48c5-99c1-79fa2de21e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:15.502936 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037a7f2-4a09-48c5-99c1-79fa2de21e08 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:15.512090 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037a7f2-4a09-48c5-99c1-79fa2de21e08 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:15.514378 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037a7f2-4a09-48c5-99c1-79fa2de21e08 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:15.524321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233eedb-c23b-41fa-ac5b-ba32adbcd548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:15.525218 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233eedb-c23b-41fa-ac5b-ba32adbcd548 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:15.525669 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233eedb-c23b-41fa-ac5b-ba32adbcd548 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:15.526085 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233eedb-c23b-41fa-ac5b-ba32adbcd548 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:15.526932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233eedb-c23b-41fa-ac5b-ba32adbcd548 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:15.527381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233eedb-c23b-41fa-ac5b-ba32adbcd548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:15.528958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233eedb-c23b-41fa-ac5b-ba32adbcd548 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:15.539952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e037a7f2-4a09-48c5-99c1-79fa2de21e08 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:56:15.539952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:15.539952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:15.539952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:15.539952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:15.539952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:15.539952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:15.539952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:15.539952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:15.539952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:15.539952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:15.539952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:15.539952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:56:15.539952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:56:15.539952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:56:15.539952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:15.540935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:15.541849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:15.541849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:15.541849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:56:15.541849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:56:15.541849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:56:15.541849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:56:15.541849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:56:15.541849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:56:15.541849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:56:15.541849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:15.541849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 423/848] 10.222.0.73 () {56 vars in 1117 bytes} [Thu May 19 11:56:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:15.542435 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037a7f2-4a09-48c5-99c1-79fa2de21e08 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:15.543010 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 426/849] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:56:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:15.650676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:15.661863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037a7f2-4a09-48c5-99c1-79fa2de21e08 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:15.700079 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6ee7e-30e8-46c3-8640-7df2bbb1766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:15.700758 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6ee7e-30e8-46c3-8640-7df2bbb1766a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:15.701039 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6ee7e-30e8-46c3-8640-7df2bbb1766a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:15.701314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6ee7e-30e8-46c3-8640-7df2bbb1766a None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:15.702161 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6ee7e-30e8-46c3-8640-7df2bbb1766a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:15.702472 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6ee7e-30e8-46c3-8640-7df2bbb1766a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:15.704704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6ee7e-30e8-46c3-8640-7df2bbb1766a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:15.730419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 424/850] 10.222.0.73 () {56 vars in 1149 bytes} [Thu May 19 11:56:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:15.731802 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233eedb-c23b-41fa-ac5b-ba32adbcd548 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:15.770019 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1c6d8-146f-4ef7-99d1-4fcf3ddaa4f9 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:15.770321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1c6d8-146f-4ef7-99d1-4fcf3ddaa4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:15.770581 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1c6d8-146f-4ef7-99d1-4fcf3ddaa4f9 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:15.772230 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 425/851] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:15.777119 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c145b-1494-4bb6-b629-cb06677cd696 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:15.777407 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c145b-1494-4bb6-b629-cb06677cd696 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:15.777693 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c145b-1494-4bb6-b629-cb06677cd696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:15.795980 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8a0c145b-1494-4bb6-b629-cb06677cd696 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:15.797684 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8a0c145b-1494-4bb6-b629-cb06677cd696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:15.855996 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233eedb-c23b-41fa-ac5b-ba32adbcd548 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:15.876053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 426/852] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:15.894564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1de40f-ca2c-4e59-b3c8-1fb7cf3eb361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:15.895244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1de40f-ca2c-4e59-b3c8-1fb7cf3eb361 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:15.895532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1de40f-ca2c-4e59-b3c8-1fb7cf3eb361 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:15.895860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1de40f-ca2c-4e59-b3c8-1fb7cf3eb361 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:15.898911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c145b-1494-4bb6-b629-cb06677cd696 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:15.944421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:15.976281 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1de40f-ca2c-4e59-b3c8-1fb7cf3eb361 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:15.977890 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1de40f-ca2c-4e59-b3c8-1fb7cf3eb361 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:16.005809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:16.031163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c145b-1494-4bb6-b629-cb06677cd696 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:16.076512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e00e5-efa3-4875-93f3-1d809fda19c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:16.077318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e00e5-efa3-4875-93f3-1d809fda19c5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:16.077862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e00e5-efa3-4875-93f3-1d809fda19c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:16.078143 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e00e5-efa3-4875-93f3-1d809fda19c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:16.089931 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 427/853] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:56:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:56:16.091934 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e00e5-efa3-4875-93f3-1d809fda19c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:16.095673 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1de40f-ca2c-4e59-b3c8-1fb7cf3eb361 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:16.100444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e88e00e5-efa3-4875-93f3-1d809fda19c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:16.100444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:16.100444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:16.100444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:16.100444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:16.100444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:16.100444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:16.100444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:16.100444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:16.100444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:16.100444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:16.100444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:16.100444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:16.100444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:16.100444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:16.100444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:16.101658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:16.101658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:16.101658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:16.101658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:16.101658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:16.101658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:16.101658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:16.101658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:16.101658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:16.101658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:16.101658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:16.101658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:16.101658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:16.101658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:16.101658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:16.101658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:16.102475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:16.102475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:16.102475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:16.102475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:16.102475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:16.102475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:16.102475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:16.102475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:16.102475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:16.102475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:16.102475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:16.102475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:16.105095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 427/854] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:56:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:16.111383 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e00e5-efa3-4875-93f3-1d809fda19c5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:16.171486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:16.206191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1de40f-ca2c-4e59-b3c8-1fb7cf3eb361 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:16.219560 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e00e5-efa3-4875-93f3-1d809fda19c5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:16.241940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea42ba-146b-4814-b7b3-f821980f74ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:16.242796 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea42ba-146b-4814-b7b3-f821980f74ff None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:16.243084 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea42ba-146b-4814-b7b3-f821980f74ff None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:16.243365 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea42ba-146b-4814-b7b3-f821980f74ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:16.254633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea42ba-146b-4814-b7b3-f821980f74ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:16.256279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea42ba-146b-4814-b7b3-f821980f74ff None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:16.256590 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91af12a-198c-4af7-be52-93d779e0d2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:16.257481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91af12a-198c-4af7-be52-93d779e0d2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:16.257961 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91af12a-198c-4af7-be52-93d779e0d2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:16.258443 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91af12a-198c-4af7-be52-93d779e0d2a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:16.259378 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91af12a-198c-4af7-be52-93d779e0d2a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:16.259893 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91af12a-198c-4af7-be52-93d779e0d2a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:16.261454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91af12a-198c-4af7-be52-93d779e0d2a1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:16.267950 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:16.273679 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 428/855] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:56:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:16.278241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-94ea42ba-146b-4814-b7b3-f821980f74ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:16.278241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:16.278241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:16.278241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:16.278241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:16.278241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:16.278241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:16.278241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:16.278241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:16.278241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:16.278241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:16.278241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:16.278241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:16.278241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:16.278241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:16.279125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:16.279125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:16.279125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:16.279125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:16.279125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:16.279125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:16.279125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:16.279125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:16.279125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:16.279125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:16.279125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:16.279125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:16.279125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:16.279125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:16.279125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:16.279125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:16.279125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:16.280037 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:16.280037 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:16.280037 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:16.280037 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:16.280037 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 428/856] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:16.280037 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea42ba-146b-4814-b7b3-f821980f74ff None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:16.282201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91af12a-198c-4af7-be52-93d779e0d2a1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:16.387230 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91af12a-198c-4af7-be52-93d779e0d2a1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:16.396246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea42ba-146b-4814-b7b3-f821980f74ff None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:16.420623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:16.424921 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587967b0-b543-4e52-ba88-0f4c0bc299fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:16.425987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587967b0-b543-4e52-ba88-0f4c0bc299fa None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:16.426501 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587967b0-b543-4e52-ba88-0f4c0bc299fa None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:16.426975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587967b0-b543-4e52-ba88-0f4c0bc299fa None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:16.427891 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587967b0-b543-4e52-ba88-0f4c0bc299fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:16.428513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587967b0-b543-4e52-ba88-0f4c0bc299fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:16.430182 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587967b0-b543-4e52-ba88-0f4c0bc299fa None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:16.433935 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cdc1d-2258-4ab6-a23b-f0f34fd8acb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:16.434745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cdc1d-2258-4ab6-a23b-f0f34fd8acb9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:16.435031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cdc1d-2258-4ab6-a23b-f0f34fd8acb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:16.435310 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cdc1d-2258-4ab6-a23b-f0f34fd8acb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:16.444717 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 429/857] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:16.446656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cdc1d-2258-4ab6-a23b-f0f34fd8acb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:16.448942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cdc1d-2258-4ab6-a23b-f0f34fd8acb9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:16.450105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587967b0-b543-4e52-ba88-0f4c0bc299fa None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:16.466962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d53cdc1d-2258-4ab6-a23b-f0f34fd8acb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:16.466962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:16.466962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:16.466962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:16.466962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:16.466962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:16.466962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:16.466962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:16.466962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:16.466962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:16.466962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:16.466962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:16.466962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:16.466962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:16.466962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:16.467905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:16.467905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:16.467905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:16.467905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:16.467905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:16.467905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:16.467905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:16.467905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:16.467905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:16.467905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:16.467905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:16.467905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:16.467905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:16.467905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:16.467905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:16.467905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:16.467905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:16.469435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:16.469435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:16.469435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:16.469435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:16.469435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 429/858] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:16.476915 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cdc1d-2258-4ab6-a23b-f0f34fd8acb9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:16.518313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:16.564739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587967b0-b543-4e52-ba88-0f4c0bc299fa None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:16.601258 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d5e54-693f-4734-98b6-ad769a30da04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:16.602315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d5e54-693f-4734-98b6-ad769a30da04 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:16.602598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d5e54-693f-4734-98b6-ad769a30da04 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:16.602869 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d5e54-693f-4734-98b6-ad769a30da04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:16.608000 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cdc1d-2258-4ab6-a23b-f0f34fd8acb9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:16.612246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d5e54-693f-4734-98b6-ad769a30da04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:16.617978 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d5e54-693f-4734-98b6-ad769a30da04 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:16.638127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-533d5e54-693f-4734-98b6-ad769a30da04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:16.638127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:16.638127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:16.638127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:16.638127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:16.638127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:16.638127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:16.638127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:16.638127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:16.638127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:16.638127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:16.638127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:16.638127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:56:16.638127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:56:16.638127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:56:16.639114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:56:16.639114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:16.639114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:16.639114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:16.639114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:16.639114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:16.639114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:16.639114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:16.639114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:16.639114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:16.639114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:16.639114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:16.639114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:16.639114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:16.639114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:16.639114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:16.639114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:16.640053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:56:16.640053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:56:16.640053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:56:16.640053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:56:16.640053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:56:16.640053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:56:16.640053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:16.640053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:16.644726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 430/859] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:16.651447 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d5e54-693f-4734-98b6-ad769a30da04 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:16.658417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013d597-4fc7-48b6-87ad-de8ee62ea86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:16.659197 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013d597-4fc7-48b6-87ad-de8ee62ea86c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:16.659549 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013d597-4fc7-48b6-87ad-de8ee62ea86c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:16.659893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013d597-4fc7-48b6-87ad-de8ee62ea86c None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:16.660731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013d597-4fc7-48b6-87ad-de8ee62ea86c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:16.661108 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013d597-4fc7-48b6-87ad-de8ee62ea86c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:16.662537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013d597-4fc7-48b6-87ad-de8ee62ea86c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:16.675958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 430/860] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:16.680896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013d597-4fc7-48b6-87ad-de8ee62ea86c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:16.717541 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:16.768073 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d5e54-693f-4734-98b6-ad769a30da04 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:16.789645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013d597-4fc7-48b6-87ad-de8ee62ea86c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:16.790738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:16.807828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d14a7-5947-427e-9510-3681e7a21408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:16.808520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d14a7-5947-427e-9510-3681e7a21408 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:16.808804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d14a7-5947-427e-9510-3681e7a21408 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:16.809081 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d14a7-5947-427e-9510-3681e7a21408 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:16.809978 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d14a7-5947-427e-9510-3681e7a21408 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:16.810290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d14a7-5947-427e-9510-3681e7a21408 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:16.811817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d14a7-5947-427e-9510-3681e7a21408 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:16.829804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 431/861] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:56:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:16.831575 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d14a7-5947-427e-9510-3681e7a21408 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:16.836970 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c977da-2855-42d7-944f-0d0f2914c98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:16.838043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c977da-2855-42d7-944f-0d0f2914c98d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:16.838527 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c977da-2855-42d7-944f-0d0f2914c98d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:16.839011 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c977da-2855-42d7-944f-0d0f2914c98d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:16.847442 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c977da-2855-42d7-944f-0d0f2914c98d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:16.849438 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c977da-2855-42d7-944f-0d0f2914c98d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:16.864606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-37c977da-2855-42d7-944f-0d0f2914c98d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 11:56:16.864606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:16.864606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:16.864606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:16.864606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:16.864606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:16.864606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:16.864606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:16.864606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:16.864606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:16.864606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:16.864606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:16.864606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:56:16.864606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:56:16.864606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:56:16.864606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:16.865564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:16.866469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:16.866469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:16.866469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:56:16.866469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:56:16.866469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:56:16.866469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:56:16.866469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:56:16.866469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:56:16.866469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 11:56:16.866469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:16.868811 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 431/862] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:56:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:16.874649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c977da-2855-42d7-944f-0d0f2914c98d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:16.952347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d14a7-5947-427e-9510-3681e7a21408 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:16.974284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:16.981667 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c977da-2855-42d7-944f-0d0f2914c98d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:16.991792 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dc593-890e-4b75-9656-2a35b656f403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:16.992618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dc593-890e-4b75-9656-2a35b656f403 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:16.992900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dc593-890e-4b75-9656-2a35b656f403 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:16.993179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dc593-890e-4b75-9656-2a35b656f403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:16.994005 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27dc593-890e-4b75-9656-2a35b656f403 None admin] RBAC: Adding query filter params (role.id=d21329f1cd364fba8b79529896e00f81, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=b6c5da324ab2405a84036db91a1366a0) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:16.994313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27dc593-890e-4b75-9656-2a35b656f403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:16.995837 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27dc593-890e-4b75-9656-2a35b656f403 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:17.011949 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 432/863] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:56:16 2022] GET /identity/v3/role_assignments?user.id=b6c5da324ab2405a84036db91a1366a0&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=d21329f1cd364fba8b79529896e00f81 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:17.028500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff14e5-12d9-4b6f-baf3-d47693c70ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:17.029284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff14e5-12d9-4b6f-baf3-d47693c70ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:17.029636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff14e5-12d9-4b6f-baf3-d47693c70ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:17.030018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff14e5-12d9-4b6f-baf3-d47693c70ce5 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:17.030921 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff14e5-12d9-4b6f-baf3-d47693c70ce5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:17.031238 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff14e5-12d9-4b6f-baf3-d47693c70ce5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:17.033360 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff14e5-12d9-4b6f-baf3-d47693c70ce5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:17.055030 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 432/864] 10.222.0.73 () {56 vars in 1135 bytes} [Thu May 19 11:56:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:17.060586 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dc593-890e-4b75-9656-2a35b656f403 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:17.074980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13dd81-4f05-40c3-9f83-65cfaf0cf418 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:17.075319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13dd81-4f05-40c3-9f83-65cfaf0cf418 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:17.075720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13dd81-4f05-40c3-9f83-65cfaf0cf418 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:17.077492 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 433/865] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:17.086551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d900c3-ba9b-49a7-b6da-0a865e051c5b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:17.086867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d900c3-ba9b-49a7-b6da-0a865e051c5b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:17.087426 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d900c3-ba9b-49a7-b6da-0a865e051c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:17.110552 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-34d900c3-ba9b-49a7-b6da-0a865e051c5b None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:17.111778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-34d900c3-ba9b-49a7-b6da-0a865e051c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:17.132622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:17.196365 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 434/866] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:17.205336 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dc593-890e-4b75-9656-2a35b656f403 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:17.213245 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d900c3-ba9b-49a7-b6da-0a865e051c5b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:17.257739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37f9df-1800-4308-8a31-7384e6664d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:17.259193 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37f9df-1800-4308-8a31-7384e6664d1d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:17.259482 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37f9df-1800-4308-8a31-7384e6664d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:17.259758 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37f9df-1800-4308-8a31-7384e6664d1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:17.316065 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:17.337880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d900c3-ba9b-49a7-b6da-0a865e051c5b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:17.340806 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37f9df-1800-4308-8a31-7384e6664d1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:17.342334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37f9df-1800-4308-8a31-7384e6664d1d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:17.391542 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b26fba-c5ac-460a-afde-166ccb126e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:17.392252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b26fba-c5ac-460a-afde-166ccb126e9b None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:17.392537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b26fba-c5ac-460a-afde-166ccb126e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:17.392820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b26fba-c5ac-460a-afde-166ccb126e9b None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:17.393568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b26fba-c5ac-460a-afde-166ccb126e9b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:17.394940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b26fba-c5ac-460a-afde-166ccb126e9b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:17.402956 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:17.411570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 435/867] 10.222.0.73 () {60 vars in 1141 bytes} [Thu May 19 11:56:17 2022] POST /identity/v3/services => generated 269 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:17.473924 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 433/868] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:56:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:56:17.479411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b26fba-c5ac-460a-afde-166ccb126e9b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:17.598451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b26fba-c5ac-460a-afde-166ccb126e9b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:17.634901 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d19eab-19c9-42c3-b4e0-513c2a7198d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:17.635706 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d19eab-19c9-42c3-b4e0-513c2a7198d1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:17.636025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d19eab-19c9-42c3-b4e0-513c2a7198d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:17.636311 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d19eab-19c9-42c3-b4e0-513c2a7198d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:17.647014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:17.651068 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d19eab-19c9-42c3-b4e0-513c2a7198d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:17.652550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d19eab-19c9-42c3-b4e0-513c2a7198d1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:17.673826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-e4d19eab-19c9-42c3-b4e0-513c2a7198d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:17.673826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:17.673826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:17.673826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:17.673826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:17.673826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:17.673826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:17.673826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:17.673826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:17.673826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:17.673826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:17.673826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:17.673826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:17.673826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:17.673826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:17.674766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:17.674766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:17.674766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:17.674766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:17.674766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:17.674766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:17.674766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:17.674766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:17.674766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:17.674766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:17.674766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:17.674766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:17.674766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:17.674766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:17.674766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:17.674766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:17.674766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:17.676229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:17.676229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:17.676229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:17.676229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:17.676229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 436/869] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:17.680949 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37f9df-1800-4308-8a31-7384e6664d1d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:17.785916 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37f9df-1800-4308-8a31-7384e6664d1d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:17.824617 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bfbf7-d12b-46e2-9313-99fc9db178b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:17.825284 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bfbf7-d12b-46e2-9313-99fc9db178b1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:17.825567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bfbf7-d12b-46e2-9313-99fc9db178b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:17.825843 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bfbf7-d12b-46e2-9313-99fc9db178b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:17.826572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bfbf7-d12b-46e2-9313-99fc9db178b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:17.826983 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bfbf7-d12b-46e2-9313-99fc9db178b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:17.828834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bfbf7-d12b-46e2-9313-99fc9db178b1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:17.840757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 434/870] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:17.849061 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d19eab-19c9-42c3-b4e0-513c2a7198d1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:17.916128 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee84662-c100-46f2-9eae-fd3173653b13 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:17.916799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee84662-c100-46f2-9eae-fd3173653b13 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:17.917148 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee84662-c100-46f2-9eae-fd3173653b13 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:17.920183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 435/871] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:17.924303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a40818-b51c-4d99-b018-26af61fc4348 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:17.924677 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a40818-b51c-4d99-b018-26af61fc4348 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:17.925038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a40818-b51c-4d99-b018-26af61fc4348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:17.931029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:17.947318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-54a40818-b51c-4d99-b018-26af61fc4348 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:17.949506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-54a40818-b51c-4d99-b018-26af61fc4348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:17.957633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d19eab-19c9-42c3-b4e0-513c2a7198d1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:17.995526 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e16e4-fa21-42f4-bd36-304cbdfb9d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:17.996462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e16e4-fa21-42f4-bd36-304cbdfb9d17 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:17.996840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e16e4-fa21-42f4-bd36-304cbdfb9d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:17.997196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e16e4-fa21-42f4-bd36-304cbdfb9d17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:18.005071 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e16e4-fa21-42f4-bd36-304cbdfb9d17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:18.006639 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e16e4-fa21-42f4-bd36-304cbdfb9d17 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:18.023805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-943e16e4-fa21-42f4-bd36-304cbdfb9d17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:18.023805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:18.023805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:18.023805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:18.023805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:18.023805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:18.023805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:18.023805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:18.023805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:18.023805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:18.023805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:18.023805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:18.023805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:56:18.023805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:56:18.023805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:56:18.024743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:56:18.024743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:18.024743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:18.024743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:18.024743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:18.024743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:18.024743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:18.024743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:18.024743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:18.024743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:18.024743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:18.024743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:18.024743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:18.024743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:18.024743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:18.024743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:18.024743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:18.025638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:56:18.025638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:56:18.025638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:56:18.025638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:56:18.025638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:56:18.025638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:56:18.025638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:18.025638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:18.029960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 437/872] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:18.031319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e16e4-fa21-42f4-bd36-304cbdfb9d17 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:18.038696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 436/873] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:17 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:18.061833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a40818-b51c-4d99-b018-26af61fc4348 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:18.088313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:18.144573 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e16e4-fa21-42f4-bd36-304cbdfb9d17 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:18.181968 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165f211-4e54-4a6e-a3b3-be68bad54255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:18.182714 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165f211-4e54-4a6e-a3b3-be68bad54255 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:18.182943 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165f211-4e54-4a6e-a3b3-be68bad54255 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:18.183187 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165f211-4e54-4a6e-a3b3-be68bad54255 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:18.183988 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165f211-4e54-4a6e-a3b3-be68bad54255 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:18.184301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165f211-4e54-4a6e-a3b3-be68bad54255 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:18.185721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165f211-4e54-4a6e-a3b3-be68bad54255 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:18.186202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a40818-b51c-4d99-b018-26af61fc4348 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:18.202880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 438/874] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:56:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:18.205332 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165f211-4e54-4a6e-a3b3-be68bad54255 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:18.233046 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ad6af-a686-400a-b9a6-741a48c59bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:18.234172 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ad6af-a686-400a-b9a6-741a48c59bb6 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:18.234993 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ad6af-a686-400a-b9a6-741a48c59bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:18.235273 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ad6af-a686-400a-b9a6-741a48c59bb6 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:18.236197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ad6af-a686-400a-b9a6-741a48c59bb6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:18.237894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ad6af-a686-400a-b9a6-741a48c59bb6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:18.240864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:18.263992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 437/875] 10.222.0.73 () {60 vars in 1141 bytes} [Thu May 19 11:56:18 2022] POST /identity/v3/services => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:56:18.341334 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165f211-4e54-4a6e-a3b3-be68bad54255 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:18.354884 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:18.391130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec71fa-81c0-4292-93b0-292c4754ed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:18.392228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec71fa-81c0-4292-93b0-292c4754ed55 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:18.392721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec71fa-81c0-4292-93b0-292c4754ed55 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:18.393202 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec71fa-81c0-4292-93b0-292c4754ed55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:18.394248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec71fa-81c0-4292-93b0-292c4754ed55 None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=371dae58e95d403b97e311c6616adab5) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:18.394830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec71fa-81c0-4292-93b0-292c4754ed55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:18.396562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec71fa-81c0-4292-93b0-292c4754ed55 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:18.404466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 439/876] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:56:18 2022] GET /identity/v3/role_assignments?user.id=371dae58e95d403b97e311c6616adab5&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:19.456196 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e10ca-df6e-43fa-b87c-f5200f01ea18 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:19.456827 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e10ca-df6e-43fa-b87c-f5200f01ea18 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:19.456827 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e10ca-df6e-43fa-b87c-f5200f01ea18 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:19.458397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 438/877] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:19.464251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7f167-9591-4497-8c9a-8aed8837aca5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:19.464701 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7f167-9591-4497-8c9a-8aed8837aca5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:19.464884 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7f167-9591-4497-8c9a-8aed8837aca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:19.481559 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-bbf7f167-9591-4497-8c9a-8aed8837aca5 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:19.482718 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bbf7f167-9591-4497-8c9a-8aed8837aca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:19.556154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 440/878] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:19.580029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e10ca-df6e-43fa-b87c-f5200f01ea18 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:19.694098 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e10ca-df6e-43fa-b87c-f5200f01ea18 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:19.730164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7bb01-0288-4508-addb-12265df4901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:19.731343 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7bb01-0288-4508-addb-12265df4901c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:19.731857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7bb01-0288-4508-addb-12265df4901c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:19.732377 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7bb01-0288-4508-addb-12265df4901c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:19.744826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7bb01-0288-4508-addb-12265df4901c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:19.745285 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264b99d-eb0d-42d7-93a6-8b347863e80f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:19.745843 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264b99d-eb0d-42d7-93a6-8b347863e80f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:19.746340 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264b99d-eb0d-42d7-93a6-8b347863e80f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:19.748188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 441/879] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:19.755642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-5fe7bb01-0288-4508-addb-12265df4901c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:56:19.755642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:19.755642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:19.755642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:19.755642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:19.755642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:19.755642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:19.755642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:19.755642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:19.755642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:19.755642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:19.755642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:19.755642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:19.755642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:19.755642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:19.755642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:19.756914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:19.756914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:19.756914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:19.756914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:19.756914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:19.756914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:19.756914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:19.756914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:19.756914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:19.756914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:19.756914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:19.756914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:19.756914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:19.756914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:19.756914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:19.756914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:19.757805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:19.757805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:19.757805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:19.757805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:19.757805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:19.757805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:19.757805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:19.757805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:19.757805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:19.757805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:19.757805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:56:19.757805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:19.757805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 439/880] 10.222.0.73 () {56 vars in 1120 bytes} [Thu May 19 11:56:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:19.760260 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a60c12-0408-4dc8-9a54-d9203959198a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:19.760554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a60c12-0408-4dc8-9a54-d9203959198a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:19.760836 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a60c12-0408-4dc8-9a54-d9203959198a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:19.762974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7bb01-0288-4508-addb-12265df4901c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:19.780517 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-75a60c12-0408-4dc8-9a54-d9203959198a None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:19.782109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-75a60c12-0408-4dc8-9a54-d9203959198a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:19.833558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:19.851130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 442/881] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:19.875686 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a60c12-0408-4dc8-9a54-d9203959198a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:19.900988 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7bb01-0288-4508-addb-12265df4901c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:19.907183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:19.943340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981e2a0-15f9-4ffc-930e-fcae97ffc87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:19.944532 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981e2a0-15f9-4ffc-930e-fcae97ffc87c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:19.945161 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981e2a0-15f9-4ffc-930e-fcae97ffc87c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:19.945669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981e2a0-15f9-4ffc-930e-fcae97ffc87c None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:19.946660 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981e2a0-15f9-4ffc-930e-fcae97ffc87c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:19.947269 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981e2a0-15f9-4ffc-930e-fcae97ffc87c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:19.948973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981e2a0-15f9-4ffc-930e-fcae97ffc87c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:19.962826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 440/882] 10.222.0.73 () {56 vars in 1115 bytes} [Thu May 19 11:56:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:19.963976 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981e2a0-15f9-4ffc-930e-fcae97ffc87c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:19.995434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a60c12-0408-4dc8-9a54-d9203959198a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:20.037733 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226dcae-94e3-49ec-b3ff-d9b61f04b035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:20.038930 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226dcae-94e3-49ec-b3ff-d9b61f04b035 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:20.039446 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226dcae-94e3-49ec-b3ff-d9b61f04b035 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:20.039955 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226dcae-94e3-49ec-b3ff-d9b61f04b035 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:20.040821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226dcae-94e3-49ec-b3ff-d9b61f04b035 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:20.042377 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226dcae-94e3-49ec-b3ff-d9b61f04b035 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:20.056016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d226dcae-94e3-49ec-b3ff-d9b61f04b035 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:56:20.056016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:20.056016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:20.056016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:20.056016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:20.056016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:20.056016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:20.056016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:20.056016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:56:20.056016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:20.056016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:20.056016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:20.056016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:20.056016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:20.056016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:20.056016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:20.057015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:20.057015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:20.057015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:20.057015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:20.057015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:20.057015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:20.057015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:20.057015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:20.057015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:20.057015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:20.057015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:20.057015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:20.057015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:20.057015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:20.057015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:20.057015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:20.057852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:20.057852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:20.057852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:20.057852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:20.057852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:20.057852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:20.057852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:20.057852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:20.057852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:20.057852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:20.057852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:20.057852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:20.057852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:20.057852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:56:20.057852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:20.065807 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 443/883] 10.222.0.73 () {56 vars in 1132 bytes} [Thu May 19 11:56:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:20.066872 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226dcae-94e3-49ec-b3ff-d9b61f04b035 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:20.082186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981e2a0-15f9-4ffc-930e-fcae97ffc87c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:20.106104 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:20.131284 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f931e2b-0fae-44db-b61e-393761245c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:20.132127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f931e2b-0fae-44db-b61e-393761245c37 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:20.132496 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f931e2b-0fae-44db-b61e-393761245c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:20.132781 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f931e2b-0fae-44db-b61e-393761245c37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:20.148656 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f931e2b-0fae-44db-b61e-393761245c37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:20.150122 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f931e2b-0fae-44db-b61e-393761245c37 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:20.173612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:20.180940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-2f931e2b-0fae-44db-b61e-393761245c37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:20.180940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:20.180940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:20.180940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:20.180940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:20.180940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:20.180940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:20.180940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:20.180940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:20.180940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:20.180940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:20.180940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:20.180940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:20.180940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:20.180940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:20.181848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:20.181848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:20.181848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:20.181848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:20.181848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:20.181848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:20.181848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:20.181848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:20.181848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:20.181848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:20.181848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:20.181848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:20.181848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:20.181848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:20.181848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:20.181848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:20.181848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:20.182713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:20.182713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:20.182713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:20.182713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:20.185138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226dcae-94e3-49ec-b3ff-d9b61f04b035 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:20.186926 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 441/884] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:20.188164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f931e2b-0fae-44db-b61e-393761245c37 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:20.222516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27c26e-430b-4949-9516-c7555bafc419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:20.223543 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27c26e-430b-4949-9516-c7555bafc419 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:20.224084 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27c26e-430b-4949-9516-c7555bafc419 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:20.224571 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27c26e-430b-4949-9516-c7555bafc419 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:20.225545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27c26e-430b-4949-9516-c7555bafc419 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:20.226056 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27c26e-430b-4949-9516-c7555bafc419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:20.227613 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27c26e-430b-4949-9516-c7555bafc419 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:20.238326 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 444/885] 10.222.0.73 () {56 vars in 1126 bytes} [Thu May 19 11:56:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:20.239502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27c26e-430b-4949-9516-c7555bafc419 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:20.318501 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f931e2b-0fae-44db-b61e-393761245c37 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:20.357665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d78d9f-5eea-4cf1-aa72-f31f73aaf5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:20.358741 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d78d9f-5eea-4cf1-aa72-f31f73aaf5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:20.359035 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d78d9f-5eea-4cf1-aa72-f31f73aaf5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:20.359345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d78d9f-5eea-4cf1-aa72-f31f73aaf5e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:20.360386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d78d9f-5eea-4cf1-aa72-f31f73aaf5e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:20.360700 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d78d9f-5eea-4cf1-aa72-f31f73aaf5e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:20.362078 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d78d9f-5eea-4cf1-aa72-f31f73aaf5e2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:20.362558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27c26e-430b-4949-9516-c7555bafc419 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:20.381693 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 442/886] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:20.383188 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d78d9f-5eea-4cf1-aa72-f31f73aaf5e2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:20.414029 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95346863-f831-4d0b-8aa1-de43c7cbedaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:20.415278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95346863-f831-4d0b-8aa1-de43c7cbedaf None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:20.415768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95346863-f831-4d0b-8aa1-de43c7cbedaf None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:20.416303 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95346863-f831-4d0b-8aa1-de43c7cbedaf None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:20.417238 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95346863-f831-4d0b-8aa1-de43c7cbedaf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:20.417813 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95346863-f831-4d0b-8aa1-de43c7cbedaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:20.418438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:20.421319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95346863-f831-4d0b-8aa1-de43c7cbedaf None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:20.433685 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 445/887] 10.222.0.73 () {56 vars in 1126 bytes} [Thu May 19 11:56:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:20.435111 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95346863-f831-4d0b-8aa1-de43c7cbedaf None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:20.463060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:20.494560 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d78d9f-5eea-4cf1-aa72-f31f73aaf5e2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:20.532893 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317654ce-7347-4222-82e2-5ceecd8164c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:20.533735 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317654ce-7347-4222-82e2-5ceecd8164c6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:20.534023 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317654ce-7347-4222-82e2-5ceecd8164c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:20.534299 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317654ce-7347-4222-82e2-5ceecd8164c6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:20.542655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317654ce-7347-4222-82e2-5ceecd8164c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:20.544140 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317654ce-7347-4222-82e2-5ceecd8164c6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:20.555314 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95346863-f831-4d0b-8aa1-de43c7cbedaf None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:20.560233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-317654ce-7347-4222-82e2-5ceecd8164c6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:56:20.560233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:20.560233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:20.560233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:20.560233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:20.560233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:20.560233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:20.560233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:20.560233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:20.560233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:20.560233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:20.560233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:20.560233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:56:20.560233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:56:20.560233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:56:20.560233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:20.561169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:20.562092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:20.562092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:20.562092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:56:20.562092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:56:20.562092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:56:20.562092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:56:20.562092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:56:20.562092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:56:20.562092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:56:20.562092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:20.566192 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 443/888] 10.222.0.73 () {56 vars in 1117 bytes} [Thu May 19 11:56:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:20.567064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317654ce-7347-4222-82e2-5ceecd8164c6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:20.598285 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886fee7-8a46-48ff-bda7-7cf676caf336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:20.598949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886fee7-8a46-48ff-bda7-7cf676caf336 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:20.599234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886fee7-8a46-48ff-bda7-7cf676caf336 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:20.599513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886fee7-8a46-48ff-bda7-7cf676caf336 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:20.600339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886fee7-8a46-48ff-bda7-7cf676caf336 None admin] RBAC: Adding query filter params (interface=public, service_id=6bea375f957b495cb0a924eafc997c6b, region_id=RegionOne) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:20.600651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886fee7-8a46-48ff-bda7-7cf676caf336 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:20.602015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886fee7-8a46-48ff-bda7-7cf676caf336 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:20.607721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 446/889] 10.222.0.73 () {56 vars in 1251 bytes} [Thu May 19 11:56:20 2022] GET /identity/v3/endpoints?service_id=6bea375f957b495cb0a924eafc997c6b&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:20.608977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab59954-0777-4017-a7c9-383791c22e3d None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:20.609265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab59954-0777-4017-a7c9-383791c22e3d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:20.609574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab59954-0777-4017-a7c9-383791c22e3d None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:20.610945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 447/890] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:20.615047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab59954-0777-4017-a7c9-383791c22e3d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:20.665070 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:20.680147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317654ce-7347-4222-82e2-5ceecd8164c6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:20.708848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:20.726841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab59954-0777-4017-a7c9-383791c22e3d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:20.729512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9444e6-0d89-4518-80e2-5a4d1770bc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:20.730198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9444e6-0d89-4518-80e2-5a4d1770bc59 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:20.730484 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9444e6-0d89-4518-80e2-5a4d1770bc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:20.730765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9444e6-0d89-4518-80e2-5a4d1770bc59 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:20.731619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9444e6-0d89-4518-80e2-5a4d1770bc59 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:20.731959 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9444e6-0d89-4518-80e2-5a4d1770bc59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:20.733408 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9444e6-0d89-4518-80e2-5a4d1770bc59 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:20.752137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 444/891] 10.222.0.73 () {56 vars in 1149 bytes} [Thu May 19 11:56:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:20.753602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1cf2b-d605-4f11-9097-67805559a60e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:20.754035 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1cf2b-d605-4f11-9097-67805559a60e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:20.754464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1cf2b-d605-4f11-9097-67805559a60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:20.763207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600cc65-a27d-4885-b534-902077c75b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:20.763870 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600cc65-a27d-4885-b534-902077c75b1e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:20.764182 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600cc65-a27d-4885-b534-902077c75b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:20.764459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600cc65-a27d-4885-b534-902077c75b1e None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:20.765138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600cc65-a27d-4885-b534-902077c75b1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:20.767051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600cc65-a27d-4885-b534-902077c75b1e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:20.770638 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-15a1cf2b-d605-4f11-9097-67805559a60e None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:20.771812 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-15a1cf2b-d605-4f11-9097-67805559a60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:20.772815 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 448/892] 10.222.0.73 () {56 vars in 1087 bytes} [Thu May 19 11:56:20 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 11:56:20.773991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475840b-3dcb-44dd-aa0c-4f91faeafe89 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:20.774279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475840b-3dcb-44dd-aa0c-4f91faeafe89 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:20.774560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475840b-3dcb-44dd-aa0c-4f91faeafe89 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:20.775792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 449/893] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:20.776546 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475840b-3dcb-44dd-aa0c-4f91faeafe89 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:20.855099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 445/894] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:20.856641 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2c259-4440-4ae2-9f19-03c20ca9dfbf None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:20.857030 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2c259-4440-4ae2-9f19-03c20ca9dfbf None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:20.857388 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2c259-4440-4ae2-9f19-03c20ca9dfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:20.879211 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b2e2c259-4440-4ae2-9f19-03c20ca9dfbf None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:20.880503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b2e2c259-4440-4ae2-9f19-03c20ca9dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:20.908172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475840b-3dcb-44dd-aa0c-4f91faeafe89 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:20.945751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e51da-4b13-49e4-9a9a-3463e2b03493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:20.946510 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e51da-4b13-49e4-9a9a-3463e2b03493 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:20.946872 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e51da-4b13-49e4-9a9a-3463e2b03493 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:20.947159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e51da-4b13-49e4-9a9a-3463e2b03493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:20.965110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 446/895] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:20.966147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2c259-4440-4ae2-9f19-03c20ca9dfbf None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:20.969732 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:20.976190 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:21.029307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e51da-4b13-49e4-9a9a-3463e2b03493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:21.030680 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e51da-4b13-49e4-9a9a-3463e2b03493 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:21.076048 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2c259-4440-4ae2-9f19-03c20ca9dfbf None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:21.116246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21640b3b-df1a-433a-941c-140ac03c1c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:21.117051 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21640b3b-df1a-433a-941c-140ac03c1c70 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:21.117332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21640b3b-df1a-433a-941c-140ac03c1c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:21.117609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21640b3b-df1a-433a-941c-140ac03c1c70 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:21.118267 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21640b3b-df1a-433a-941c-140ac03c1c70 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:21.119643 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21640b3b-df1a-433a-941c-140ac03c1c70 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:21.132601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-21640b3b-df1a-433a-941c-140ac03c1c70 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:56:21.132601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:21.132601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:21.132601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:21.132601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:21.132601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:21.132601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:21.132601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:21.132601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:56:21.132601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:21.132601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:21.132601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:21.132601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:21.132601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:21.132601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:21.132601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:21.132601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:21.133587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:21.133587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:21.133587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:21.133587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:21.133587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:21.133587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:21.133587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:21.133587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:21.133587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:21.133587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:21.133587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:21.133587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:21.133587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:21.133587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:21.133587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:21.133587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:21.139433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:21.139433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:21.139433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:21.139433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:21.139433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:21.139433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:21.139433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:21.139433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:21.139433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:21.139433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:21.139433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:21.139433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:21.139433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:56:21.139433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:21.139433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 447/896] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:56:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:21.140244 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21640b3b-df1a-433a-941c-140ac03c1c70 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:21.140323 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 450/897] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:56:20 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:56:21.140979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e51da-4b13-49e4-9a9a-3463e2b03493 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:21.192343 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:21.211993 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:21.245842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21640b3b-df1a-433a-941c-140ac03c1c70 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:21.248725 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e51da-4b13-49e4-9a9a-3463e2b03493 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:21.280895 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670e7f9-1a17-48ea-b1e5-781b1d18053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:21.281648 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670e7f9-1a17-48ea-b1e5-781b1d18053a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:21.281932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670e7f9-1a17-48ea-b1e5-781b1d18053a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:21.282211 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670e7f9-1a17-48ea-b1e5-781b1d18053a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:21.282859 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670e7f9-1a17-48ea-b1e5-781b1d18053a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:21.284232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670e7f9-1a17-48ea-b1e5-781b1d18053a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:21.285903 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c880e-ef64-4c40-a940-7d60ebbcddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:21.286959 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c880e-ef64-4c40-a940-7d60ebbcddb1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:21.287385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c880e-ef64-4c40-a940-7d60ebbcddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:21.287829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c880e-ef64-4c40-a940-7d60ebbcddb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:21.296499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-4670e7f9-1a17-48ea-b1e5-781b1d18053a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:56:21.296499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:21.296499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:21.296499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:21.296499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:21.296499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:21.296499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:21.296499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:21.296499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:56:21.296499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:21.296499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:21.296499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:21.296499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:21.296499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:21.296499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:21.296499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:21.296499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:21.298168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:21.298168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:21.298168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:21.298168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:21.298168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:21.298168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:21.298168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:21.298168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:21.298168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:21.298168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:21.298168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:21.298168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:21.298168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:21.298168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:21.298168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:21.298168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:21.300539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:21.300539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:21.300539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:21.300539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:21.300539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:21.300539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:21.300539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:21.300539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:21.300539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:21.300539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:21.300539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:21.300539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:21.300539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:56:21.300539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:21.300539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 448/898] 10.222.0.73 () {56 vars in 1126 bytes} [Thu May 19 11:56:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:21.301529 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670e7f9-1a17-48ea-b1e5-781b1d18053a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:21.304065 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c880e-ef64-4c40-a940-7d60ebbcddb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:21.305516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c880e-ef64-4c40-a940-7d60ebbcddb1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:21.323893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d50c880e-ef64-4c40-a940-7d60ebbcddb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:21.323893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:21.323893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:21.323893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:21.323893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:21.323893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:21.323893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:21.323893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:21.323893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:21.323893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:21.323893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:21.323893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:21.323893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:21.323893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:21.323893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:21.324845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:21.324845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:21.324845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:21.324845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:21.324845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:21.324845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:21.324845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:21.324845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:21.324845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:21.324845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:21.324845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:21.324845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:21.324845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:21.324845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:21.324845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:21.324845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:21.324845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:21.330922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:21.330922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:21.330922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:21.330922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:21.330922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 451/899] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:21.330922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c880e-ef64-4c40-a940-7d60ebbcddb1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:21.416618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670e7f9-1a17-48ea-b1e5-781b1d18053a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:21.436905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c880e-ef64-4c40-a940-7d60ebbcddb1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:21.439059 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:21.455429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7c5b4-8198-411a-83b3-825dfcddf51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:21.456232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7c5b4-8198-411a-83b3-825dfcddf51d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:21.456522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7c5b4-8198-411a-83b3-825dfcddf51d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:21.456804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7c5b4-8198-411a-83b3-825dfcddf51d None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:21.457516 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7c5b4-8198-411a-83b3-825dfcddf51d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:21.457829 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7c5b4-8198-411a-83b3-825dfcddf51d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:21.459309 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7c5b4-8198-411a-83b3-825dfcddf51d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:21.460452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:21.470755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 449/900] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:56:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:21.471627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7c5b4-8198-411a-83b3-825dfcddf51d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:21.476280 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c2464-5242-4155-9a8e-437ba3a7643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:21.476952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c2464-5242-4155-9a8e-437ba3a7643a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:21.477241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c2464-5242-4155-9a8e-437ba3a7643a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:21.477523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c2464-5242-4155-9a8e-437ba3a7643a None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:21.478248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c2464-5242-4155-9a8e-437ba3a7643a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:21.478559 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c2464-5242-4155-9a8e-437ba3a7643a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:21.480064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c2464-5242-4155-9a8e-437ba3a7643a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:21.485478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 452/901] 10.222.0.73 () {56 vars in 1122 bytes} [Thu May 19 11:56:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:21.486265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c2464-5242-4155-9a8e-437ba3a7643a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:21.582235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7c5b4-8198-411a-83b3-825dfcddf51d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:21.589853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c2464-5242-4155-9a8e-437ba3a7643a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:21.620123 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e359d1e-bd3b-479d-b963-6d3a1c938eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:21.620784 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e359d1e-bd3b-479d-b963-6d3a1c938eaf None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:21.621070 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e359d1e-bd3b-479d-b963-6d3a1c938eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:21.621352 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e359d1e-bd3b-479d-b963-6d3a1c938eaf None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:21.622128 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e359d1e-bd3b-479d-b963-6d3a1c938eaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:21.622443 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e359d1e-bd3b-479d-b963-6d3a1c938eaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:21.623804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e359d1e-bd3b-479d-b963-6d3a1c938eaf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:21.628584 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3a872-b688-4297-903a-9eacb1b4bd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:21.629256 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a872-b688-4297-903a-9eacb1b4bd16 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:21.629546 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a872-b688-4297-903a-9eacb1b4bd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:21.629828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a872-b688-4297-903a-9eacb1b4bd16 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:21.630540 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3a872-b688-4297-903a-9eacb1b4bd16 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:21.631134 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3a872-b688-4297-903a-9eacb1b4bd16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:21.632351 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3a872-b688-4297-903a-9eacb1b4bd16 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:21.635901 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 450/902] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:21.636582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e359d1e-bd3b-479d-b963-6d3a1c938eaf None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:21.646393 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 453/903] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:56:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:21.646393 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3a872-b688-4297-903a-9eacb1b4bd16 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:21.680124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:21.701687 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:21.747204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e359d1e-bd3b-479d-b963-6d3a1c938eaf None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:21.753507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3a872-b688-4297-903a-9eacb1b4bd16 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:21.783101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9630f-8ea0-4fc2-adbb-432aa8957b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:21.783760 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9630f-8ea0-4fc2-adbb-432aa8957b62 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:21.784081 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9630f-8ea0-4fc2-adbb-432aa8957b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:21.784362 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9630f-8ea0-4fc2-adbb-432aa8957b62 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:21.785065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9630f-8ea0-4fc2-adbb-432aa8957b62 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:21.785407 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9630f-8ea0-4fc2-adbb-432aa8957b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:21.786739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9630f-8ea0-4fc2-adbb-432aa8957b62 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:21.788394 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4617941-f796-428b-abb1-81b62ed18cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:21.789328 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4617941-f796-428b-abb1-81b62ed18cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:21.789699 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4617941-f796-428b-abb1-81b62ed18cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:21.789956 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4617941-f796-428b-abb1-81b62ed18cc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:21.791634 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 451/904] 10.222.0.73 () {56 vars in 1122 bytes} [Thu May 19 11:56:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:21.797819 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9630f-8ea0-4fc2-adbb-432aa8957b62 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:21.798103 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4617941-f796-428b-abb1-81b62ed18cc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:21.799527 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4617941-f796-428b-abb1-81b62ed18cc7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:21.814651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b4617941-f796-428b-abb1-81b62ed18cc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:21.814651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:21.814651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:21.814651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:21.814651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:21.814651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:21.814651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:21.814651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:21.814651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:21.814651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:21.814651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:21.814651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:21.814651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:56:21.814651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:56:21.814651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:56:21.815648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:56:21.815648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:21.815648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:21.815648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:21.815648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:21.815648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:21.815648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:21.815648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:21.815648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:21.815648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:21.815648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:21.815648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:21.815648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:21.815648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:21.815648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:21.815648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:21.815648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:21.816570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:56:21.816570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:56:21.816570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:56:21.816570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:56:21.816570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:56:21.816570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:56:21.816570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:21.816570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:21.816570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 454/905] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:21.821560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4617941-f796-428b-abb1-81b62ed18cc7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:21.933123 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9630f-8ea0-4fc2-adbb-432aa8957b62 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:21.936409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:21.949147 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4617941-f796-428b-abb1-81b62ed18cc7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:21.963560 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:21.986422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd0af5-c70a-4a67-b863-eb5d68ab7c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:21.987695 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd0af5-c70a-4a67-b863-eb5d68ab7c5a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:21.988085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd0af5-c70a-4a67-b863-eb5d68ab7c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:21.988363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd0af5-c70a-4a67-b863-eb5d68ab7c5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:21.989277 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd0af5-c70a-4a67-b863-eb5d68ab7c5a None admin] RBAC: Adding query filter params (interface=public, service_id=b0ec8d1d67e0454ba277a9d4eeed6adc, region_id=RegionOne) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:21.989590 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd0af5-c70a-4a67-b863-eb5d68ab7c5a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:21.991190 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd0af5-c70a-4a67-b863-eb5d68ab7c5a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:21.997726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 452/906] 10.222.0.73 () {56 vars in 1251 bytes} [Thu May 19 11:56:21 2022] GET /identity/v3/endpoints?service_id=b0ec8d1d67e0454ba277a9d4eeed6adc&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:21.998652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5c6aa-c4c6-4ed6-a803-216ac7617b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:22.002342 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5c6aa-c4c6-4ed6-a803-216ac7617b99 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:22.002342 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5c6aa-c4c6-4ed6-a803-216ac7617b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:22.002342 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5c6aa-c4c6-4ed6-a803-216ac7617b99 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:22.002342 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5c6aa-c4c6-4ed6-a803-216ac7617b99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:22.002342 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5c6aa-c4c6-4ed6-a803-216ac7617b99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:22.003213 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5c6aa-c4c6-4ed6-a803-216ac7617b99 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:22.003715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd0af5-c70a-4a67-b863-eb5d68ab7c5a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:22.018202 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 455/907] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:56:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:22.024250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5c6aa-c4c6-4ed6-a803-216ac7617b99 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:22.128250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd0af5-c70a-4a67-b863-eb5d68ab7c5a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:22.150493 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5c6aa-c4c6-4ed6-a803-216ac7617b99 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:22.163162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80207655-acdf-47ef-a668-037289562de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:22.163828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80207655-acdf-47ef-a668-037289562de2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:22.164147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80207655-acdf-47ef-a668-037289562de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:22.164421 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80207655-acdf-47ef-a668-037289562de2 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:22.165100 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80207655-acdf-47ef-a668-037289562de2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:22.166688 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80207655-acdf-47ef-a668-037289562de2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:22.174026 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 453/908] 10.222.0.73 () {56 vars in 1087 bytes} [Thu May 19 11:56:22 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 11:56:22.192356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407431b-a972-476a-bc88-4468f6a31353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:22.193017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407431b-a972-476a-bc88-4468f6a31353 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:22.193306 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407431b-a972-476a-bc88-4468f6a31353 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:22.193586 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407431b-a972-476a-bc88-4468f6a31353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:22.194461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407431b-a972-476a-bc88-4468f6a31353 None admin] RBAC: Adding query filter params (role.id=bcd07251993842dba52e681f3b559dd8, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=b6c5da324ab2405a84036db91a1366a0) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:22.194776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407431b-a972-476a-bc88-4468f6a31353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:22.196275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407431b-a972-476a-bc88-4468f6a31353 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:22.203367 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 456/909] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:56:22 2022] GET /identity/v3/role_assignments?user.id=b6c5da324ab2405a84036db91a1366a0&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=bcd07251993842dba52e681f3b559dd8 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:23.057006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7d0e0-c4dc-49ff-8f65-6c8b28ca719e None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:23.057527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7d0e0-c4dc-49ff-8f65-6c8b28ca719e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:23.057527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7d0e0-c4dc-49ff-8f65-6c8b28ca719e None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:23.059341 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 454/910] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:23.065623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f6168-3ad3-408a-a7ca-c1467093f5a9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:23.066532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f6168-3ad3-408a-a7ca-c1467093f5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:23.067069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f6168-3ad3-408a-a7ca-c1467093f5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:23.085312 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fe0f6168-3ad3-408a-a7ca-c1467093f5a9 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:23.086801 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fe0f6168-3ad3-408a-a7ca-c1467093f5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:23.097093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:23.164036 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 457/911] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:23.182766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7d0e0-c4dc-49ff-8f65-6c8b28ca719e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:23.234636 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:23.290658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7d0e0-c4dc-49ff-8f65-6c8b28ca719e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:23.326312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d0f07-c730-4d55-af1c-4dab71c8f6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:23.327125 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d0f07-c730-4d55-af1c-4dab71c8f6ec None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:23.327407 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d0f07-c730-4d55-af1c-4dab71c8f6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:23.327682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d0f07-c730-4d55-af1c-4dab71c8f6ec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:23.328381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d0f07-c730-4d55-af1c-4dab71c8f6ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:23.329808 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d0f07-c730-4d55-af1c-4dab71c8f6ec None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:23.342503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-133d0f07-c730-4d55-af1c-4dab71c8f6ec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:56:23.342503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:23.342503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:23.342503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:23.342503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:23.342503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:23.342503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:23.342503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:23.342503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:56:23.342503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:23.342503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:23.342503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:23.342503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:23.342503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:23.342503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:23.342503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:23.343520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:23.343520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:23.343520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:23.343520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:23.343520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:23.343520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:23.343520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:23.343520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:23.343520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:23.343520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:23.343520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:23.343520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:23.343520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:23.343520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:23.343520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:23.343520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:23.344907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:23.344907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:23.344907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:23.344907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:23.344907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:23.344907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:23.344907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:23.344907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:23.344907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:23.344907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:23.344907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:23.344907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:23.344907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:23.344907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 11:56:23.344907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:23.344907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 455/912] 10.222.0.73 () {56 vars in 1132 bytes} [Thu May 19 11:56:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:23.352455 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f6168-3ad3-408a-a7ca-c1467093f5a9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:23.469227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f6168-3ad3-408a-a7ca-c1467093f5a9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:23.505440 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b596a7-fe51-4ce6-8430-5cbd60c96a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:23.506117 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b596a7-fe51-4ce6-8430-5cbd60c96a1e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:23.506398 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b596a7-fe51-4ce6-8430-5cbd60c96a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:23.506671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b596a7-fe51-4ce6-8430-5cbd60c96a1e None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:23.507380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b596a7-fe51-4ce6-8430-5cbd60c96a1e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:23.507683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b596a7-fe51-4ce6-8430-5cbd60c96a1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:23.509069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b596a7-fe51-4ce6-8430-5cbd60c96a1e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:23.514274 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 458/913] 10.222.0.73 () {56 vars in 1126 bytes} [Thu May 19 11:56:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:23.520973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d0f07-c730-4d55-af1c-4dab71c8f6ec None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:23.626196 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d0f07-c730-4d55-af1c-4dab71c8f6ec None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:23.640080 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:23.660856 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8d53c-e82a-4f32-9e84-64850192b435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:23.661529 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8d53c-e82a-4f32-9e84-64850192b435 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:23.661815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8d53c-e82a-4f32-9e84-64850192b435 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:23.662091 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8d53c-e82a-4f32-9e84-64850192b435 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:23.662793 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8d53c-e82a-4f32-9e84-64850192b435 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:23.663107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8d53c-e82a-4f32-9e84-64850192b435 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:23.664509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8d53c-e82a-4f32-9e84-64850192b435 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:23.670371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 456/914] 10.222.0.73 () {56 vars in 1126 bytes} [Thu May 19 11:56:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:23.676996 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b596a7-fe51-4ce6-8430-5cbd60c96a1e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:23.693096 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:23.791786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b596a7-fe51-4ce6-8430-5cbd60c96a1e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:23.830368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062091f-40dc-425d-aeaf-c0ecf013379d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:23.831408 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062091f-40dc-425d-aeaf-c0ecf013379d None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:23.831899 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062091f-40dc-425d-aeaf-c0ecf013379d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:23.832442 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062091f-40dc-425d-aeaf-c0ecf013379d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:23.833404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062091f-40dc-425d-aeaf-c0ecf013379d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:23.834972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062091f-40dc-425d-aeaf-c0ecf013379d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:23.864221 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 459/915] 10.222.0.73 () {60 vars in 1144 bytes} [Thu May 19 11:56:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:24.091224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963b707-fdce-4f39-a9b4-c84e0496700a None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:24.091776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963b707-fdce-4f39-a9b4-c84e0496700a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:24.091776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963b707-fdce-4f39-a9b4-c84e0496700a None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:24.093534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 457/916] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:24.099606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd980d9-a71f-4b6b-9bba-837d8a95c0f8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:24.100070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd980d9-a71f-4b6b-9bba-837d8a95c0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:24.100278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd980d9-a71f-4b6b-9bba-837d8a95c0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:24.118311 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ecd980d9-a71f-4b6b-9bba-837d8a95c0f8 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:24.119503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ecd980d9-a71f-4b6b-9bba-837d8a95c0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:24.181904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:24.198496 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 460/917] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:24.221864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963b707-fdce-4f39-a9b4-c84e0496700a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:24.327220 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963b707-fdce-4f39-a9b4-c84e0496700a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:24.367754 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0db4d-037d-4535-ab96-518d3b19e6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:24.368766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0db4d-037d-4535-ab96-518d3b19e6dd None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:24.369216 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0db4d-037d-4535-ab96-518d3b19e6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:24.369663 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0db4d-037d-4535-ab96-518d3b19e6dd None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:24.370633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0db4d-037d-4535-ab96-518d3b19e6dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:24.372269 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0db4d-037d-4535-ab96-518d3b19e6dd None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:24.404468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 458/918] 10.222.0.73 () {60 vars in 1141 bytes} [Thu May 19 11:56:24 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:24.520823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e452d58-659a-435e-aee8-8bf1f4f74160 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:24.521535 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e452d58-659a-435e-aee8-8bf1f4f74160 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:24.522030 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e452d58-659a-435e-aee8-8bf1f4f74160 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:24.523928 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 461/919] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:24.529417 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1288bd-b016-4482-8480-8ac62a1f077c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:24.529713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1288bd-b016-4482-8480-8ac62a1f077c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:24.529998 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1288bd-b016-4482-8480-8ac62a1f077c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:24.551771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0e1288bd-b016-4482-8480-8ac62a1f077c None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:24.553425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0e1288bd-b016-4482-8480-8ac62a1f077c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:24.573495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032d8f2-87a4-478f-8106-61e95df36ded None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:24.573819 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032d8f2-87a4-478f-8106-61e95df36ded None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:24.574056 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032d8f2-87a4-478f-8106-61e95df36ded None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:24.575702 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 462/920] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:24.581882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6664a-bb6b-476e-97c4-13f523040af3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:24.582173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6664a-bb6b-476e-97c4-13f523040af3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:24.582442 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6664a-bb6b-476e-97c4-13f523040af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:24.596256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:24.601807 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-91a6664a-bb6b-476e-97c4-13f523040af3 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:24.603007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-91a6664a-bb6b-476e-97c4-13f523040af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:24.656947 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 459/921] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:24.681197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1288bd-b016-4482-8480-8ac62a1f077c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:24.685121 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 463/922] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:24.708191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6664a-bb6b-476e-97c4-13f523040af3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:24.806331 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1288bd-b016-4482-8480-8ac62a1f077c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:24.842316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3c41b-67a5-4605-b2e9-1e6543f78a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:24.843129 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3c41b-67a5-4605-b2e9-1e6543f78a09 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:24.843410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3c41b-67a5-4605-b2e9-1e6543f78a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:24.843710 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3c41b-67a5-4605-b2e9-1e6543f78a09 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:24.854472 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3c41b-67a5-4605-b2e9-1e6543f78a09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:24.860459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6664a-bb6b-476e-97c4-13f523040af3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:24.863699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-93d3c41b-67a5-4605-b2e9-1e6543f78a09 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:56:24.863699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:24.863699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:24.863699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:24.863699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:24.863699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:24.863699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:24.863699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:24.863699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:24.863699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:24.863699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:24.863699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:24.863699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:24.863699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:24.863699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:24.863699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:24.864844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:24.864844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:24.864844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:24.864844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:24.864844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:24.864844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:24.864844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:24.864844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:24.864844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:24.864844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:24.864844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:24.864844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:24.864844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:24.864844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:24.864844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:24.864844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:24.865810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:24.865810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:24.865810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:24.865810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:24.865810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:24.865810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:24.865810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:24.865810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:24.865810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:24.865810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:24.865810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:56:24.865810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:24.869330 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 460/923] 10.222.0.73 () {56 vars in 1120 bytes} [Thu May 19 11:56:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:24.870261 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3c41b-67a5-4605-b2e9-1e6543f78a09 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:24.890122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:24.897947 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:24.913674 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f334cc-c5d3-4a25-976e-35db46cdf0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:24.914453 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f334cc-c5d3-4a25-976e-35db46cdf0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:24.914732 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f334cc-c5d3-4a25-976e-35db46cdf0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:24.915004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f334cc-c5d3-4a25-976e-35db46cdf0a3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:24.915758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f334cc-c5d3-4a25-976e-35db46cdf0a3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:24.917207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f334cc-c5d3-4a25-976e-35db46cdf0a3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:24.930027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-58f334cc-c5d3-4a25-976e-35db46cdf0a3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:56:24.930027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:24.930027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:24.930027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:24.930027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:24.930027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:24.930027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:24.930027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:24.930027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:56:24.930027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:24.930027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:24.930027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:24.930027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:24.930027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:24.930027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:24.930027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:24.930027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:24.931304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:24.931304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:24.931304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:24.931304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:24.931304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:24.931304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:24.931304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:24.931304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:24.931304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:24.931304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:24.931304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:24.931304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:24.931304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:24.931304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:24.931304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:24.931304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:24.932252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:24.932252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:24.932252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:24.932252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:24.932252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:24.932252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:24.932252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:24.932252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:24.932252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:24.932252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:24.932252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:24.932252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:24.932252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 11:56:24.932252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:24.936190 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 464/924] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:56:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:24.937036 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f334cc-c5d3-4a25-976e-35db46cdf0a3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:24.998563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3c41b-67a5-4605-b2e9-1e6543f78a09 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:25.041473 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f334cc-c5d3-4a25-976e-35db46cdf0a3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:25.047510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88122b5a-1c62-4447-9432-8de60c28affc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:25.048403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88122b5a-1c62-4447-9432-8de60c28affc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:25.048869 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88122b5a-1c62-4447-9432-8de60c28affc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:25.049319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88122b5a-1c62-4447-9432-8de60c28affc None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:25.050220 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88122b5a-1c62-4447-9432-8de60c28affc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:25.051212 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88122b5a-1c62-4447-9432-8de60c28affc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:25.053207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88122b5a-1c62-4447-9432-8de60c28affc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:25.065959 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 461/925] 10.222.0.73 () {56 vars in 1115 bytes} [Thu May 19 11:56:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:25.071850 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88122b5a-1c62-4447-9432-8de60c28affc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:25.086615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc573f5b-a7ad-4f6a-bff9-22ea226c45f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:25.087420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc573f5b-a7ad-4f6a-bff9-22ea226c45f2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:25.088094 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc573f5b-a7ad-4f6a-bff9-22ea226c45f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:25.088094 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc573f5b-a7ad-4f6a-bff9-22ea226c45f2 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:25.088882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc573f5b-a7ad-4f6a-bff9-22ea226c45f2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:25.089258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc573f5b-a7ad-4f6a-bff9-22ea226c45f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:25.090729 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc573f5b-a7ad-4f6a-bff9-22ea226c45f2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:25.095945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 465/926] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:56:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:25.101448 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc573f5b-a7ad-4f6a-bff9-22ea226c45f2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:25.156049 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:25.195230 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:25.213149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88122b5a-1c62-4447-9432-8de60c28affc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:25.223588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc573f5b-a7ad-4f6a-bff9-22ea226c45f2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:25.250405 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aad274-a1ef-4bf6-ad38-47125b7ac0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:25.251337 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aad274-a1ef-4bf6-ad38-47125b7ac0ea None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:25.251718 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aad274-a1ef-4bf6-ad38-47125b7ac0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:25.252145 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aad274-a1ef-4bf6-ad38-47125b7ac0ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:25.263338 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aad274-a1ef-4bf6-ad38-47125b7ac0ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:25.265136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aad274-a1ef-4bf6-ad38-47125b7ac0ea None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:25.269371 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01534b9c-73dd-4fa6-8b36-1f50c0c22392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:25.270240 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01534b9c-73dd-4fa6-8b36-1f50c0c22392 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:25.270677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01534b9c-73dd-4fa6-8b36-1f50c0c22392 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:25.271117 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01534b9c-73dd-4fa6-8b36-1f50c0c22392 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:25.272003 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01534b9c-73dd-4fa6-8b36-1f50c0c22392 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:25.272478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01534b9c-73dd-4fa6-8b36-1f50c0c22392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:25.274491 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01534b9c-73dd-4fa6-8b36-1f50c0c22392 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:25.280930 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 466/927] 10.222.0.73 () {56 vars in 1114 bytes} [Thu May 19 11:56:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:25.286960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01534b9c-73dd-4fa6-8b36-1f50c0c22392 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:25.290109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e6aad274-a1ef-4bf6-ad38-47125b7ac0ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:25.290109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:25.290109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:25.290109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:25.290109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:25.290109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:25.290109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:25.290109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:25.290109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:25.290109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:25.290109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:25.290109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:25.290109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:25.290109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:25.290109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:25.291038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:25.291038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:25.291038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:25.291038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:25.291038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:25.291038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:25.291038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:25.291038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:25.291038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:25.291038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:25.291038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:25.291038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:25.291038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:25.291038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:25.291038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:25.291038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:25.291038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:25.291898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:25.291898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:25.291898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:25.291898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:25.291898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 462/928] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:25.297923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aad274-a1ef-4bf6-ad38-47125b7ac0ea None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:25.410847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01534b9c-73dd-4fa6-8b36-1f50c0c22392 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:25.420563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aad274-a1ef-4bf6-ad38-47125b7ac0ea None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:25.433238 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:25.456374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e943c-6807-4030-942c-7715202b6053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:25.457042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e943c-6807-4030-942c-7715202b6053 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:25.457396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e943c-6807-4030-942c-7715202b6053 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:25.457899 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e943c-6807-4030-942c-7715202b6053 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:25.458541 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e943c-6807-4030-942c-7715202b6053 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:25.458916 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e943c-6807-4030-942c-7715202b6053 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:25.460680 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e943c-6807-4030-942c-7715202b6053 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:25.464122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bfa5d-863c-42bb-a286-0746c67c2bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:25.465011 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bfa5d-863c-42bb-a286-0746c67c2bb9 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:25.465495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bfa5d-863c-42bb-a286-0746c67c2bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:25.465957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bfa5d-863c-42bb-a286-0746c67c2bb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:25.466884 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bfa5d-863c-42bb-a286-0746c67c2bb9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:25.469649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:25.469902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bfa5d-863c-42bb-a286-0746c67c2bb9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:25.481797 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 463/929] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:25.482990 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e943c-6807-4030-942c-7715202b6053 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:25.504388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 467/930] 10.222.0.73 () {60 vars in 1144 bytes} [Thu May 19 11:56:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:56:25.606833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e943c-6807-4030-942c-7715202b6053 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:25.654437 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef8f94-737b-4f40-8cd1-49f4dbd6c294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:25.655606 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef8f94-737b-4f40-8cd1-49f4dbd6c294 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:25.656209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef8f94-737b-4f40-8cd1-49f4dbd6c294 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:25.657174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef8f94-737b-4f40-8cd1-49f4dbd6c294 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:25.665986 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef8f94-737b-4f40-8cd1-49f4dbd6c294 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:25.667757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef8f94-737b-4f40-8cd1-49f4dbd6c294 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:25.684865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-8eef8f94-737b-4f40-8cd1-49f4dbd6c294 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:56:25.684865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:25.684865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:25.684865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:25.684865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:25.684865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:25.684865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:25.684865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:25.684865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:25.684865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:25.684865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:25.684865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:25.684865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:56:25.684865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:56:25.684865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:56:25.684865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:25.685855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:25.686778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:25.686778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:25.686778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:56:25.686778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:56:25.686778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:56:25.686778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:56:25.686778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:56:25.686778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:56:25.686778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:56:25.686778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:25.690234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 464/931] 10.222.0.73 () {56 vars in 1117 bytes} [Thu May 19 11:56:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:25.696331 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bfa5d-863c-42bb-a286-0746c67c2bb9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:25.808688 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bfa5d-863c-42bb-a286-0746c67c2bb9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:25.844207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718d43a-0ca8-4599-9dbf-b0550d87d0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:25.844845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718d43a-0ca8-4599-9dbf-b0550d87d0bb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:25.845129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718d43a-0ca8-4599-9dbf-b0550d87d0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:25.845404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718d43a-0ca8-4599-9dbf-b0550d87d0bb None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:25.846243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718d43a-0ca8-4599-9dbf-b0550d87d0bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:25.846551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718d43a-0ca8-4599-9dbf-b0550d87d0bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:25.847988 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718d43a-0ca8-4599-9dbf-b0550d87d0bb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:25.865813 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 468/932] 10.222.0.73 () {56 vars in 1149 bytes} [Thu May 19 11:56:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:25.871313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef8f94-737b-4f40-8cd1-49f4dbd6c294 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:25.930563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:25.977714 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef8f94-737b-4f40-8cd1-49f4dbd6c294 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:26.017449 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92ade3-45bb-4aa9-92f5-f9f82d7c680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:26.018685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ade3-45bb-4aa9-92f5-f9f82d7c680b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.019182 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ade3-45bb-4aa9-92f5-f9f82d7c680b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.019683 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ade3-45bb-4aa9-92f5-f9f82d7c680b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.031650 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92ade3-45bb-4aa9-92f5-f9f82d7c680b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:26.033464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92ade3-45bb-4aa9-92f5-f9f82d7c680b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:26.052167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-bb92ade3-45bb-4aa9-92f5-f9f82d7c680b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:26.052167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:26.052167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:26.052167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:26.052167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:26.052167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:26.052167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:26.052167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:26.052167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:26.052167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:26.052167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:26.052167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:26.052167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:26.052167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:26.052167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:26.053164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:26.053164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:26.053164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:26.053164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:26.053164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:26.053164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:26.053164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:26.053164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:26.053164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:26.053164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:26.053164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:26.053164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:26.053164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:26.053164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:26.053164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:26.053164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:26.053164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:26.054033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:26.054033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:26.054033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:26.054033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:26.056329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 465/933] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:26.062165 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718d43a-0ca8-4599-9dbf-b0550d87d0bb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:26.092577 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:26.170446 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718d43a-0ca8-4599-9dbf-b0550d87d0bb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:26.185639 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47a855-1bb0-4350-9805-1a7e3a834563 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.186286 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47a855-1bb0-4350-9805-1a7e3a834563 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.186839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47a855-1bb0-4350-9805-1a7e3a834563 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.189566 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 466/934] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:26.196353 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedca8cb-71b6-473d-9dcd-3e316c9ef20c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.196353 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedca8cb-71b6-473d-9dcd-3e316c9ef20c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.196353 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedca8cb-71b6-473d-9dcd-3e316c9ef20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.215360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-eedca8cb-71b6-473d-9dcd-3e316c9ef20c None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:26.217937 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7158b1-5700-491b-ad14-af93b68dba46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:26.218900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7158b1-5700-491b-ad14-af93b68dba46 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.219465 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7158b1-5700-491b-ad14-af93b68dba46 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.219682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-eedca8cb-71b6-473d-9dcd-3e316c9ef20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:26.220194 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7158b1-5700-491b-ad14-af93b68dba46 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.221168 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7158b1-5700-491b-ad14-af93b68dba46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:26.221889 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7158b1-5700-491b-ad14-af93b68dba46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:26.224557 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7158b1-5700-491b-ad14-af93b68dba46 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:26.239624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 469/935] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:26.246200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7158b1-5700-491b-ad14-af93b68dba46 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:26.304294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 467/936] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:26.322936 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedca8cb-71b6-473d-9dcd-3e316c9ef20c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:26.354185 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:26.363616 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:26.373308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7158b1-5700-491b-ad14-af93b68dba46 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:26.422409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d82d9-cd66-470d-b10e-a4411d3968ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:26.423723 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d82d9-cd66-470d-b10e-a4411d3968ba None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.424198 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d82d9-cd66-470d-b10e-a4411d3968ba None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.424893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d82d9-cd66-470d-b10e-a4411d3968ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.434580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d82d9-cd66-470d-b10e-a4411d3968ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:26.436973 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d82d9-cd66-470d-b10e-a4411d3968ba None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:26.441676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedca8cb-71b6-473d-9dcd-3e316c9ef20c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:26.456757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-125d82d9-cd66-470d-b10e-a4411d3968ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:26.456757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:26.456757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:26.456757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:26.456757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:26.456757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:26.456757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:26.456757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:26.456757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:26.456757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:26.456757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:26.456757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:26.456757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:56:26.456757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:56:26.456757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:56:26.457910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:56:26.457910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:26.457910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:26.457910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:26.457910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:26.457910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:26.457910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:26.457910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:26.457910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:26.457910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:26.457910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:26.457910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:26.457910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:26.457910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:26.457910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:26.457910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:26.457910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:26.459016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:56:26.459016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:56:26.459016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:56:26.459016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:56:26.459016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:56:26.459016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:56:26.459016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:26.459016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:26.461881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 470/937] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:26.467286 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d82d9-cd66-470d-b10e-a4411d3968ba None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:26.493529 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6047223-5152-461a-be3c-24b929cf6609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:26.494910 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6047223-5152-461a-be3c-24b929cf6609 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.495792 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6047223-5152-461a-be3c-24b929cf6609 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.496278 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6047223-5152-461a-be3c-24b929cf6609 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.497387 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6047223-5152-461a-be3c-24b929cf6609 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:26.499946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6047223-5152-461a-be3c-24b929cf6609 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:26.516017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b6047223-5152-461a-be3c-24b929cf6609 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:56:26.516017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:26.516017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:26.516017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:26.516017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:26.516017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:26.516017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:26.516017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:26.516017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:56:26.516017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:26.516017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:26.516017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:26.516017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:26.516017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:26.516017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:26.516017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:26.516017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:26.517018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:26.517018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:26.517018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:26.517018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:26.517018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:26.517018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:26.517018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:26.517018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:26.517018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:26.517018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:26.517018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:26.517018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:26.517018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:26.517018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:26.517018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:26.517018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:26.517864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:26.517864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:26.517864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:26.517864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:26.517864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:26.517864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:26.517864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:26.517864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:26.517864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:26.517864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:26.517864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:26.517864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:26.517864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:56:26.517864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:26.520564 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 468/938] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:26.526657 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6047223-5152-461a-be3c-24b929cf6609 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:26.595181 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d82d9-cd66-470d-b10e-a4411d3968ba None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:26.632835 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b961418-0edd-4094-8831-a3b7d35e2d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:26.633528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961418-0edd-4094-8831-a3b7d35e2d39 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.633817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961418-0edd-4094-8831-a3b7d35e2d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.634101 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b961418-0edd-4094-8831-a3b7d35e2d39 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.635030 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b961418-0edd-4094-8831-a3b7d35e2d39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:26.635369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b961418-0edd-4094-8831-a3b7d35e2d39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:26.636907 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b961418-0edd-4094-8831-a3b7d35e2d39 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:26.650303 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 471/939] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:56:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:26.656816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b961418-0edd-4094-8831-a3b7d35e2d39 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:26.662565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:26.666094 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6047223-5152-461a-be3c-24b929cf6609 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:26.669175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:26.705085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c757313-ecc5-406f-a33d-31d2ddbf9045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:26.705805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c757313-ecc5-406f-a33d-31d2ddbf9045 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.706099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c757313-ecc5-406f-a33d-31d2ddbf9045 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.706381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c757313-ecc5-406f-a33d-31d2ddbf9045 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.707100 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c757313-ecc5-406f-a33d-31d2ddbf9045 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:26.707417 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c757313-ecc5-406f-a33d-31d2ddbf9045 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:26.709027 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c757313-ecc5-406f-a33d-31d2ddbf9045 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:26.718352 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 469/940] 10.222.0.73 () {56 vars in 1112 bytes} [Thu May 19 11:56:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:26.719387 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c757313-ecc5-406f-a33d-31d2ddbf9045 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:26.791765 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b961418-0edd-4094-8831-a3b7d35e2d39 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:26.831554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4306cf2-bdb3-46ce-8a22-4c903be33cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:26.832489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4306cf2-bdb3-46ce-8a22-4c903be33cee None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.832769 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4306cf2-bdb3-46ce-8a22-4c903be33cee None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.833045 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4306cf2-bdb3-46ce-8a22-4c903be33cee None admin] PATH_INFO: `/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/b6c5da324ab2405a84036db91a1366a0/roles/bcd07251993842dba52e681f3b559dd8` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.835240 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4306cf2-bdb3-46ce-8a22-4c903be33cee None admin] RBAC: Authorizing `identity:create_grant(project_id=d90551d9446e4f2cbd14312d2af9f7c9, user_id=b6c5da324ab2405a84036db91a1366a0, role_id=bcd07251993842dba52e681f3b559dd8)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:26.835987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c757313-ecc5-406f-a33d-31d2ddbf9045 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:26.836702 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4306cf2-bdb3-46ce-8a22-4c903be33cee None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:26.850594 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 472/941] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:56:26 2022] PUT /identity/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/b6c5da324ab2405a84036db91a1366a0/roles/bcd07251993842dba52e681f3b559dd8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 11:56:26.851797 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf07c52-ccfa-4a80-b988-b29a13593e03 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.852120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf07c52-ccfa-4a80-b988-b29a13593e03 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.852403 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf07c52-ccfa-4a80-b988-b29a13593e03 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.853900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 473/942] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:26.859475 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe8500-2c71-47a1-832c-f0f78af1faeb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.859760 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe8500-2c71-47a1-832c-f0f78af1faeb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.860073 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe8500-2c71-47a1-832c-f0f78af1faeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.878989 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9bfe8500-2c71-47a1-832c-f0f78af1faeb None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:26.880254 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9bfe8500-2c71-47a1-832c-f0f78af1faeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:26.886583 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cfaac-6ef5-4192-9b0f-9da950509292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:26.887666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cfaac-6ef5-4192-9b0f-9da950509292 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:26.888168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cfaac-6ef5-4192-9b0f-9da950509292 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:26.888792 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cfaac-6ef5-4192-9b0f-9da950509292 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:26.889591 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cfaac-6ef5-4192-9b0f-9da950509292 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:26.889992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cfaac-6ef5-4192-9b0f-9da950509292 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:26.892261 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cfaac-6ef5-4192-9b0f-9da950509292 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:26.898630 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 470/943] 10.222.0.73 () {56 vars in 1112 bytes} [Thu May 19 11:56:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:26.951687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:26.963739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 474/944] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:26.987796 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cfaac-6ef5-4192-9b0f-9da950509292 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:27.022570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:27.115325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cfaac-6ef5-4192-9b0f-9da950509292 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:27.153269 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c4bdd-b245-4277-9cd9-60884ebf300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:27.154084 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c4bdd-b245-4277-9cd9-60884ebf300e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:27.154364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c4bdd-b245-4277-9cd9-60884ebf300e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:27.154638 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c4bdd-b245-4277-9cd9-60884ebf300e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:27.155353 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c4bdd-b245-4277-9cd9-60884ebf300e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:27.156783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c4bdd-b245-4277-9cd9-60884ebf300e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:27.169011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-435c4bdd-b245-4277-9cd9-60884ebf300e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:56:27.169011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:27.169011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:27.169011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:27.169011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:27.169011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:27.169011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:27.169011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:27.169011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:56:27.169011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:27.169011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:27.169011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:27.169011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:27.169011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:27.169011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:27.169011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:27.169011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:27.170270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:27.170270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:27.170270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:27.170270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:27.170270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:27.170270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:27.170270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:27.170270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:27.170270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:27.170270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:27.170270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:27.170270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:27.170270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:27.170270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:27.170270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:27.170270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:27.171072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:27.171072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:27.171072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:27.171072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:27.171072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:27.171072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:27.171072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:27.171072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:27.171072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:27.171072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:27.171072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:27.171072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:27.171072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:56:27.171072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:27.171072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 471/945] 10.222.0.73 () {56 vars in 1126 bytes} [Thu May 19 11:56:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:27.183940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe8500-2c71-47a1-832c-f0f78af1faeb None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:27.276423 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe8500-2c71-47a1-832c-f0f78af1faeb None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:27.316683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dfdc3-0fe5-43b1-854e-f068c2255aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:27.317357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dfdc3-0fe5-43b1-854e-f068c2255aca None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:27.317644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dfdc3-0fe5-43b1-854e-f068c2255aca None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:27.317923 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dfdc3-0fe5-43b1-854e-f068c2255aca None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:27.318640 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3dfdc3-0fe5-43b1-854e-f068c2255aca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:27.318949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3dfdc3-0fe5-43b1-854e-f068c2255aca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:27.320338 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3dfdc3-0fe5-43b1-854e-f068c2255aca None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:27.325755 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 475/946] 10.222.0.73 () {56 vars in 1122 bytes} [Thu May 19 11:56:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:27.331087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c4bdd-b245-4277-9cd9-60884ebf300e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:27.432536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:27.443639 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c4bdd-b245-4277-9cd9-60884ebf300e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:27.480222 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8173f53-96f8-4d18-b8f1-5e6dc50cca51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:27.481169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8173f53-96f8-4d18-b8f1-5e6dc50cca51 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:27.481593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8173f53-96f8-4d18-b8f1-5e6dc50cca51 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:27.482010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8173f53-96f8-4d18-b8f1-5e6dc50cca51 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:27.482869 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8173f53-96f8-4d18-b8f1-5e6dc50cca51 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:27.483329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8173f53-96f8-4d18-b8f1-5e6dc50cca51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:27.485422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8173f53-96f8-4d18-b8f1-5e6dc50cca51 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:27.492046 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 472/947] 10.222.0.73 () {56 vars in 1122 bytes} [Thu May 19 11:56:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:27.497977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dfdc3-0fe5-43b1-854e-f068c2255aca None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:27.560172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:27.602310 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dfdc3-0fe5-43b1-854e-f068c2255aca None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:27.637615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bac1d9-e827-4dea-9643-6da36abab398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:27.638205 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bac1d9-e827-4dea-9643-6da36abab398 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:27.638497 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bac1d9-e827-4dea-9643-6da36abab398 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:27.638781 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bac1d9-e827-4dea-9643-6da36abab398 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:27.639576 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bac1d9-e827-4dea-9643-6da36abab398 None admin] RBAC: Adding query filter params (interface=public, service_id=171ff42c46dc471eba06a269458b5a80, region_id=RegionOne) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:27.639892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bac1d9-e827-4dea-9643-6da36abab398 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:27.641313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bac1d9-e827-4dea-9643-6da36abab398 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:27.647086 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 476/948] 10.222.0.73 () {56 vars in 1251 bytes} [Thu May 19 11:56:27 2022] GET /identity/v3/endpoints?service_id=171ff42c46dc471eba06a269458b5a80&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:27.652522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8173f53-96f8-4d18-b8f1-5e6dc50cca51 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:27.758110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8173f53-96f8-4d18-b8f1-5e6dc50cca51 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:27.798225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d2732-63bb-4c7a-b60f-55ee293ffef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:27.798892 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d2732-63bb-4c7a-b60f-55ee293ffef8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:27.799174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d2732-63bb-4c7a-b60f-55ee293ffef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:27.799451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d2732-63bb-4c7a-b60f-55ee293ffef8 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:27.800619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d2732-63bb-4c7a-b60f-55ee293ffef8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:27.801992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d2732-63bb-4c7a-b60f-55ee293ffef8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:27.808775 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 473/949] 10.222.0.73 () {56 vars in 1087 bytes} [Thu May 19 11:56:27 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 11:56:27.950644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb33f52-ef58-4008-9663-5b261cf7812d None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:27.951325 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb33f52-ef58-4008-9663-5b261cf7812d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:27.951821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb33f52-ef58-4008-9663-5b261cf7812d None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:27.954417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 477/950] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:27.960409 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f58ce-eb5b-4500-8408-88c944407ce4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:27.960994 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f58ce-eb5b-4500-8408-88c944407ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:27.961475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f58ce-eb5b-4500-8408-88c944407ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:27.979787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-030f58ce-eb5b-4500-8408-88c944407ce4 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:27.981408 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-030f58ce-eb5b-4500-8408-88c944407ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:28.002139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:28.060026 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 474/951] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:28.078448 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb33f52-ef58-4008-9663-5b261cf7812d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:28.195949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb33f52-ef58-4008-9663-5b261cf7812d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:28.220816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:28.226919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2122a4-6302-4af4-a30c-a49177297981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:28.227593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2122a4-6302-4af4-a30c-a49177297981 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:28.227881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2122a4-6302-4af4-a30c-a49177297981 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:28.228192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2122a4-6302-4af4-a30c-a49177297981 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:28.228904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2122a4-6302-4af4-a30c-a49177297981 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:28.231368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2122a4-6302-4af4-a30c-a49177297981 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:28.233075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: WARNING keystone.server.flask.common [None req-af2122a4-6302-4af4-a30c-a49177297981 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 11:56:28.252038 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.sql.core [None req-af2122a4-6302-4af4-a30c-a49177297981 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 11:56:28.252038 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 11:56:28.252038 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [parameters: {'id': '8cb21375de9e4dbabdf458646d4036b4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 11:56:28.252038 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80189) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 11:56:28.269262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-af2122a4-6302-4af4-a30c-a49177297981 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8cb21375de9e4dbabdf458646d4036b4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8cb21375de9e4dbabdf458646d4036b4. May 19 11:56:28.269262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:28.269262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:56:28.269262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:56:28.269262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:56:28.269262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:56:28.269262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:56:28.269262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:56:28.269262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:56:28.269262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application conn.query(q) May 19 11:56:28.269262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:56:28.269262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:56:28.269262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result.read() May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 11:56:28.270171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 11:56:28.271591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:56:28.271591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application next(self.gen) May 19 11:56:28.271591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 11:56:28.271591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application yield resource May 19 11:56:28.271591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:56:28.271591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application next(self.gen) May 19 11:56:28.271591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 11:56:28.271591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.session.rollback() May 19 11:56:28.271591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 11:56:28.271591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.force_reraise() May 19 11:56:28.271591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 11:56:28.271591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise self.value May 19 11:56:28.271591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 11:56:28.271591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 11:56:28.271591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 11:56:28.271591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application session.commit() May 19 11:56:28.271591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 11:56:28.272516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 11:56:28.272516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 11:56:28.272516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._prepare_impl() May 19 11:56:28.272516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 11:56:28.272516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.session.flush() May 19 11:56:28.272516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 11:56:28.272516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._flush(objects) May 19 11:56:28.272516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 11:56:28.272516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 11:56:28.272516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 11:56:28.272516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application compat.raise_( May 19 11:56:28.272516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:56:28.272516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception May 19 11:56:28.272516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 11:56:28.272516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application flush_context.execute() May 19 11:56:28.272516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 11:56:28.272516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rec.execute(self) May 19 11:56:28.273816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 11:56:28.273816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 11:56:28.273816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 11:56:28.273816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 11:56:28.273816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 11:56:28.273816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 11:56:28.273816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 11:56:28.273816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 11:56:28.273816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 11:56:28.273816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 11:56:28.273816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 11:56:28.273816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 11:56:28.273816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 11:56:28.273816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 11:56:28.273816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 11:56:28.275767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 11:56:28.275767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:56:28.275767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception May 19 11:56:28.275767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:56:28.275767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:56:28.275767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:56:28.275767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:56:28.275767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:56:28.275767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:56:28.275767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:56:28.275767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application conn.query(q) May 19 11:56:28.275767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:56:28.275767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:56:28.275767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:56:28.275767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result.read() May 19 11:56:28.275767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:56:28.275767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:56:28.277934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:56:28.277934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:56:28.277934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:56:28.277934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:56:28.277934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:56:28.277934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:56:28.277934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 11:56:28.277934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 11:56:28.277934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [parameters: {'id': '8cb21375de9e4dbabdf458646d4036b4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 11:56:28.277934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 11:56:28.277934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:28.277934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:28.277934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:28.277934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:28.277934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 11:56:28.279994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 11:56:28.279994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 11:56:28.279994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 11:56:28.279994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 11:56:28.279994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:28.279994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:28.279994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:28.279994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:28.279994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:28.279994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:28.279994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:28.279994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:28.279994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:28.279994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:28.279994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:28.279994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:28.279994 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:28.283234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:28.283234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 11:56:28.283234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 11:56:28.283234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:28.283234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:28.283234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 11:56:28.283234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 11:56:28.283234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8cb21375de9e4dbabdf458646d4036b4. May 19 11:56:28.283234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:28.283234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 478/952] 10.222.0.73 () {60 vars in 1140 bytes} [Thu May 19 11:56:28 2022] POST /identity/v3/projects => generated 262 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:28.291082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f58ce-eb5b-4500-8408-88c944407ce4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:28.398438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f58ce-eb5b-4500-8408-88c944407ce4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:28.434253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449a87b-37b1-4d32-8152-482c1e598a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:28.435047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449a87b-37b1-4d32-8152-482c1e598a28 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:28.435334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449a87b-37b1-4d32-8152-482c1e598a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:28.435616 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449a87b-37b1-4d32-8152-482c1e598a28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:28.443014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449a87b-37b1-4d32-8152-482c1e598a28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:28.444492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449a87b-37b1-4d32-8152-482c1e598a28 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:28.458902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-3449a87b-37b1-4d32-8152-482c1e598a28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:28.458902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:28.458902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:28.458902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:28.458902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:28.458902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:28.458902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:28.458902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:28.458902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:28.458902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:28.458902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:28.458902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:28.458902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:56:28.458902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:56:28.458902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:56:28.459854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:56:28.459854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:28.459854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:28.459854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:28.459854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:28.459854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:28.459854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:28.459854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:28.459854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:28.459854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:28.459854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:28.459854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:28.459854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:28.459854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:28.459854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:28.459854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:28.459854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:28.461243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:56:28.461243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:56:28.461243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:56:28.461243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:56:28.461243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:56:28.461243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:56:28.461243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:28.461243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:28.461243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 475/953] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:28.473308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2122a4-6302-4af4-a30c-a49177297981 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:28.577960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2122a4-6302-4af4-a30c-a49177297981 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:28.612623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f8389-f744-47c3-a796-4be7a7e9da06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:28.613666 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8389-f744-47c3-a796-4be7a7e9da06 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:28.614157 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8389-f744-47c3-a796-4be7a7e9da06 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:28.614655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8389-f744-47c3-a796-4be7a7e9da06 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:28.615639 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f8389-f744-47c3-a796-4be7a7e9da06 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:28.616270 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f8389-f744-47c3-a796-4be7a7e9da06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:28.618189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f8389-f744-47c3-a796-4be7a7e9da06 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:28.642208 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 479/954] 10.222.0.73 () {56 vars in 1112 bytes} [Thu May 19 11:56:28 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:29.257472 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2d865-f1a0-4284-8230-03f27758fa95 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:29.257876 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2d865-f1a0-4284-8230-03f27758fa95 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:29.258081 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2d865-f1a0-4284-8230-03f27758fa95 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:29.259649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 476/955] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:29.264927 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f41d8-223a-4c30-88ce-a141c225f666 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:29.265413 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f41d8-223a-4c30-88ce-a141c225f666 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:29.265584 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f41d8-223a-4c30-88ce-a141c225f666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:29.274085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfca4f-2d67-472a-9989-1a2b47c5cd52 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:29.274373 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfca4f-2d67-472a-9989-1a2b47c5cd52 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:29.274650 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfca4f-2d67-472a-9989-1a2b47c5cd52 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:29.276279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 477/956] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:29.283092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b7d3-2223-4b2b-8a5d-b0aad89f42a5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:29.283595 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b7d3-2223-4b2b-8a5d-b0aad89f42a5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:29.284142 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b7d3-2223-4b2b-8a5d-b0aad89f42a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:29.287409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e54f41d8-223a-4c30-88ce-a141c225f666 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:29.288971 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e54f41d8-223a-4c30-88ce-a141c225f666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:29.303452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6428b7d3-2223-4b2b-8a5d-b0aad89f42a5 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:29.304655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6428b7d3-2223-4b2b-8a5d-b0aad89f42a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:29.308364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:29.333331 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:29.374501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 480/957] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:29.387059 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 478/958] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:29.397119 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f41d8-223a-4c30-88ce-a141c225f666 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:29.411298 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428b7d3-2223-4b2b-8a5d-b0aad89f42a5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:29.506166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f41d8-223a-4c30-88ce-a141c225f666 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:29.518851 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428b7d3-2223-4b2b-8a5d-b0aad89f42a5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:29.543888 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e4dab-f2d4-4023-98e3-2e895cb77c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:29.545109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e4dab-f2d4-4023-98e3-2e895cb77c90 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:29.545398 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e4dab-f2d4-4023-98e3-2e895cb77c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:29.545676 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e4dab-f2d4-4023-98e3-2e895cb77c90 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:29.556142 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275358a-6d76-44fa-8fba-ce5ee5a9b324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:29.556818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275358a-6d76-44fa-8fba-ce5ee5a9b324 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:29.557055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e4dab-f2d4-4023-98e3-2e895cb77c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:29.557170 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275358a-6d76-44fa-8fba-ce5ee5a9b324 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:29.557366 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275358a-6d76-44fa-8fba-ce5ee5a9b324 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:29.558145 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275358a-6d76-44fa-8fba-ce5ee5a9b324 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:29.559526 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275358a-6d76-44fa-8fba-ce5ee5a9b324 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:29.565858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-a33e4dab-f2d4-4023-98e3-2e895cb77c90 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:56:29.565858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:29.565858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:29.565858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:29.565858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:29.565858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:29.565858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:29.565858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:29.565858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:29.565858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:29.565858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:29.565858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:29.565858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:29.565858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:29.565858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:29.565858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:29.567138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:29.567138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:29.567138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:29.567138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:29.567138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:29.567138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:29.567138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:29.567138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:29.567138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:29.567138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:29.567138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:29.567138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:29.567138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:29.567138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:29.567138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:29.567138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:29.568021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:29.568021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:29.568021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:29.568021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:29.568021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:29.568021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:29.568021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:29.568021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:29.568021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:29.568021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:29.568021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:56:29.568021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:29.568021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 481/959] 10.222.0.73 () {56 vars in 1120 bytes} [Thu May 19 11:56:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:29.572131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:29.573981 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e4dab-f2d4-4023-98e3-2e895cb77c90 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:29.584840 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 479/960] 10.222.0.73 () {60 vars in 1141 bytes} [Thu May 19 11:56:29 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:56:29.612688 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:29.695281 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e4dab-f2d4-4023-98e3-2e895cb77c90 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:29.740801 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6794e-3a68-4367-8ed2-6aca46f496c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:29.741490 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6794e-3a68-4367-8ed2-6aca46f496c8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:29.741779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6794e-3a68-4367-8ed2-6aca46f496c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:29.742143 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6794e-3a68-4367-8ed2-6aca46f496c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:29.742949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6794e-3a68-4367-8ed2-6aca46f496c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:29.743269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6794e-3a68-4367-8ed2-6aca46f496c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:29.744771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6794e-3a68-4367-8ed2-6aca46f496c8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:29.755836 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 482/961] 10.222.0.73 () {56 vars in 1115 bytes} [Thu May 19 11:56:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:29.761076 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275358a-6d76-44fa-8fba-ce5ee5a9b324 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:29.877865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275358a-6d76-44fa-8fba-ce5ee5a9b324 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:29.912827 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d46481-8eff-4445-a602-5c7ad587fad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:29.913619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d46481-8eff-4445-a602-5c7ad587fad9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:29.913900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d46481-8eff-4445-a602-5c7ad587fad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:29.914176 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d46481-8eff-4445-a602-5c7ad587fad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:29.925335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d46481-8eff-4445-a602-5c7ad587fad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:29.926783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d46481-8eff-4445-a602-5c7ad587fad9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:29.944471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-49d46481-8eff-4445-a602-5c7ad587fad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:29.944471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:29.944471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:29.944471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:29.944471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:29.944471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:29.944471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:29.944471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:29.944471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:29.944471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:29.944471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:29.944471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:29.944471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:29.944471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:29.944471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:29.945403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:29.945403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:29.945403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:29.945403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:29.945403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:29.945403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:29.945403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:29.945403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:29.945403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:29.945403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:29.945403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:29.945403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:29.945403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:29.945403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:29.945403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:29.945403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:29.945403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:29.946293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:29.946293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:29.946293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:29.946293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:29.946293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 480/962] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:29.952651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6794e-3a68-4367-8ed2-6aca46f496c8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:30.047564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:30.061016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6794e-3a68-4367-8ed2-6aca46f496c8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:30.097711 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef7fdf-5992-462b-8464-d242003510fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:30.098391 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef7fdf-5992-462b-8464-d242003510fa None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:30.098683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef7fdf-5992-462b-8464-d242003510fa None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:30.098968 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef7fdf-5992-462b-8464-d242003510fa None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:30.099696 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef7fdf-5992-462b-8464-d242003510fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:30.100040 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef7fdf-5992-462b-8464-d242003510fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:30.101407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef7fdf-5992-462b-8464-d242003510fa None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:30.114376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 483/963] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:30.119718 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d46481-8eff-4445-a602-5c7ad587fad9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:30.169624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ce630-7316-4866-abf5-31b3fb797875 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:30.170168 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ce630-7316-4866-abf5-31b3fb797875 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:30.170372 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ce630-7316-4866-abf5-31b3fb797875 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:30.176146 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 484/964] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:30.177829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddecd9-121f-4898-bf27-7d272b2b0ed3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:30.178226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddecd9-121f-4898-bf27-7d272b2b0ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:30.178738 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddecd9-121f-4898-bf27-7d272b2b0ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:30.178984 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:30.200864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-41ddecd9-121f-4898-bf27-7d272b2b0ed3 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:30.202047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-41ddecd9-121f-4898-bf27-7d272b2b0ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:30.245345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d46481-8eff-4445-a602-5c7ad587fad9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:30.283670 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 485/965] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:30.286993 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43312236-f859-4640-9196-a2e786ec2ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:30.287809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43312236-f859-4640-9196-a2e786ec2ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:30.288131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43312236-f859-4640-9196-a2e786ec2ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:30.288408 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43312236-f859-4640-9196-a2e786ec2ee5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:30.296420 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43312236-f859-4640-9196-a2e786ec2ee5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:30.298379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43312236-f859-4640-9196-a2e786ec2ee5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:30.300636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddecd9-121f-4898-bf27-7d272b2b0ed3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:30.319533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-43312236-f859-4640-9196-a2e786ec2ee5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:56:30.319533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:30.319533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:30.319533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:30.319533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:30.319533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:30.319533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:30.319533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:30.319533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:30.319533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:30.319533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:30.319533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:30.319533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:56:30.319533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:56:30.319533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:56:30.319533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:30.320544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:30.321490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:30.321490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:30.321490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:56:30.321490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:56:30.321490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:56:30.321490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:56:30.321490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:56:30.321490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:56:30.321490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 11:56:30.321490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:30.324245 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 481/966] 10.222.0.73 () {56 vars in 1117 bytes} [Thu May 19 11:56:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:30.329466 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43312236-f859-4640-9196-a2e786ec2ee5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:30.397419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:30.427000 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddecd9-121f-4898-bf27-7d272b2b0ed3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:30.465682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43312236-f859-4640-9196-a2e786ec2ee5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:30.479890 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:30.480463 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b510e0-fed9-40b2-9281-2d3f7c7ec23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:30.482402 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b510e0-fed9-40b2-9281-2d3f7c7ec23c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:30.482987 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b510e0-fed9-40b2-9281-2d3f7c7ec23c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:30.483623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b510e0-fed9-40b2-9281-2d3f7c7ec23c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:30.485107 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b510e0-fed9-40b2-9281-2d3f7c7ec23c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:30.487853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b510e0-fed9-40b2-9281-2d3f7c7ec23c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:30.504561 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0c24b-7581-4db7-b003-3419b2838164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:30.505175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-99b510e0-fed9-40b2-9281-2d3f7c7ec23c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:56:30.505175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:30.505175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:30.505175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:30.505175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:30.505175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:30.505175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:30.505175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:30.505175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:56:30.505175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:30.505175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:30.505175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:30.505175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:30.505175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:30.505175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:30.505175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:30.505175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:30.506224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:30.506224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:30.506224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:30.506224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:30.506224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:30.506224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:30.506224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:30.506224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:30.506224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:30.506224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:30.506224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:30.506224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:30.506224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:30.506224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:30.506224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:30.506224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:30.507047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:30.507047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:30.507047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:30.507047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:30.507047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:30.507047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:30.507047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:30.507047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:30.507047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:30.507047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:30.507047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:30.507047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:30.507047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:56:30.507047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:30.507778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0c24b-7581-4db7-b003-3419b2838164 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:30.507778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0c24b-7581-4db7-b003-3419b2838164 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:30.507778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0c24b-7581-4db7-b003-3419b2838164 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:30.507778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0c24b-7581-4db7-b003-3419b2838164 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:30.507778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0c24b-7581-4db7-b003-3419b2838164 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:30.509147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0c24b-7581-4db7-b003-3419b2838164 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:30.510566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 486/967] 10.222.0.73 () {56 vars in 1126 bytes} [Thu May 19 11:56:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:30.516754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b510e0-fed9-40b2-9281-2d3f7c7ec23c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:30.539048 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 482/968] 10.222.0.73 () {56 vars in 1149 bytes} [Thu May 19 11:56:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:30.540118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0c24b-7581-4db7-b003-3419b2838164 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:30.644157 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0c24b-7581-4db7-b003-3419b2838164 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:30.660782 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b510e0-fed9-40b2-9281-2d3f7c7ec23c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:30.683770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81681668-ab85-47c2-8af9-70b0f0f81d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:30.684373 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81681668-ab85-47c2-8af9-70b0f0f81d3a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:30.684655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81681668-ab85-47c2-8af9-70b0f0f81d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:30.684928 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81681668-ab85-47c2-8af9-70b0f0f81d3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:30.704286 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23c594-703c-489a-a794-0a63951bee19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:30.704954 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23c594-703c-489a-a794-0a63951bee19 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:30.705240 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23c594-703c-489a-a794-0a63951bee19 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:30.705517 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23c594-703c-489a-a794-0a63951bee19 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:30.706229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23c594-703c-489a-a794-0a63951bee19 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:30.706536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23c594-703c-489a-a794-0a63951bee19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:30.707900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23c594-703c-489a-a794-0a63951bee19 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:30.718095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 487/969] 10.222.0.73 () {56 vars in 1122 bytes} [Thu May 19 11:56:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:30.724811 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23c594-703c-489a-a794-0a63951bee19 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:30.731901 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:30.735143 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:30.769181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81681668-ab85-47c2-8af9-70b0f0f81d3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:30.771415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81681668-ab85-47c2-8af9-70b0f0f81d3a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:30.840820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23c594-703c-489a-a794-0a63951bee19 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:30.885825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0af64-dd78-42f2-a249-f9bcc1e57381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:30.887147 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0af64-dd78-42f2-a249-f9bcc1e57381 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:30.887801 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0af64-dd78-42f2-a249-f9bcc1e57381 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:30.888302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0af64-dd78-42f2-a249-f9bcc1e57381 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:30.889502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0af64-dd78-42f2-a249-f9bcc1e57381 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:30.889887 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0af64-dd78-42f2-a249-f9bcc1e57381 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:30.891849 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0af64-dd78-42f2-a249-f9bcc1e57381 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:30.897349 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 488/970] 10.222.0.73 () {56 vars in 1122 bytes} [Thu May 19 11:56:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:30.901698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 483/971] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:56:30 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:56:30.904876 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0af64-dd78-42f2-a249-f9bcc1e57381 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:30.907899 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81681668-ab85-47c2-8af9-70b0f0f81d3a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:30.981615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:30.995242 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:31.014508 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0af64-dd78-42f2-a249-f9bcc1e57381 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:31.029025 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81681668-ab85-47c2-8af9-70b0f0f81d3a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:31.049839 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324c4a0-942d-4799-ab06-34248695a353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:31.050497 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324c4a0-942d-4799-ab06-34248695a353 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.050787 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324c4a0-942d-4799-ab06-34248695a353 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.051065 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324c4a0-942d-4799-ab06-34248695a353 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.051801 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324c4a0-942d-4799-ab06-34248695a353 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:31.053186 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324c4a0-942d-4799-ab06-34248695a353 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:31.066333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8208226-a789-4f27-870c-7c9ded069acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:31.067427 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8208226-a789-4f27-870c-7c9ded069acc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.067942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8208226-a789-4f27-870c-7c9ded069acc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.068425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8208226-a789-4f27-870c-7c9ded069acc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.071735 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 489/972] 10.222.0.73 () {60 vars in 1144 bytes} [Thu May 19 11:56:30 2022] POST /identity/v3/endpoints => generated 349 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:31.073124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f6934-a1cd-4142-906c-662d1b709652 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.073412 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f6934-a1cd-4142-906c-662d1b709652 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.073731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f6934-a1cd-4142-906c-662d1b709652 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.075973 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 490/973] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:31.081316 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21fea4-8b7d-4dbe-91ab-13a3d3308d9f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.081611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21fea4-8b7d-4dbe-91ab-13a3d3308d9f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.081888 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21fea4-8b7d-4dbe-91ab-13a3d3308d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.086145 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8208226-a789-4f27-870c-7c9ded069acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:31.088046 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8208226-a789-4f27-870c-7c9ded069acc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:31.100415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3d21fea4-8b7d-4dbe-91ab-13a3d3308d9f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:31.101930 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3d21fea4-8b7d-4dbe-91ab-13a3d3308d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:31.108509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f8208226-a789-4f27-870c-7c9ded069acc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:31.108509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:31.108509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:31.108509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:31.108509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:31.108509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:31.108509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:31.108509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:31.108509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:31.108509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:31.108509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:31.108509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:31.108509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:31.108509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:31.108509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:31.109498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:31.109498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:31.109498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:31.109498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:31.109498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:31.109498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:31.109498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:31.109498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:31.109498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:31.109498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:31.109498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:31.109498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:31.109498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:31.109498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:31.109498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:31.109498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:31.109498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:31.110591 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:31.110591 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:31.110591 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:31.110591 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:31.110591 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 484/974] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:31.115952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8208226-a789-4f27-870c-7c9ded069acc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:31.220016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 491/975] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:31.241178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8208226-a789-4f27-870c-7c9ded069acc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:31.247908 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21fea4-8b7d-4dbe-91ab-13a3d3308d9f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:31.278213 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:31.294325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfeeb01-45fd-44aa-a6ce-6143fce9a7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:31.295348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfeeb01-45fd-44aa-a6ce-6143fce9a7ab None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.296269 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfeeb01-45fd-44aa-a6ce-6143fce9a7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.296269 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfeeb01-45fd-44aa-a6ce-6143fce9a7ab None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.296736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfeeb01-45fd-44aa-a6ce-6143fce9a7ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:31.297210 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfeeb01-45fd-44aa-a6ce-6143fce9a7ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:31.299188 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfeeb01-45fd-44aa-a6ce-6143fce9a7ab None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:31.313566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:31.315572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 485/976] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:31.321379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfeeb01-45fd-44aa-a6ce-6143fce9a7ab None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:31.386103 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21fea4-8b7d-4dbe-91ab-13a3d3308d9f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:31.422060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b617e-e94a-4377-a3ff-d245f0be334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:31.423123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b617e-e94a-4377-a3ff-d245f0be334c None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.423610 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b617e-e94a-4377-a3ff-d245f0be334c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.424118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b617e-e94a-4377-a3ff-d245f0be334c None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.425036 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b617e-e94a-4377-a3ff-d245f0be334c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:31.426691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b617e-e94a-4377-a3ff-d245f0be334c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:31.431032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfeeb01-45fd-44aa-a6ce-6143fce9a7ab None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:31.441271 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.sql.core [None req-b51b617e-e94a-4377-a3ff-d245f0be334c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 11:56:31.441271 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 11:56:31.441271 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [parameters: {'user_id': '4f885627ac0f4a8ca78e6859412e8685', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 11:56:31.441271 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80189) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 11:56:31.450167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b51b617e-e94a-4377-a3ff-d245f0be334c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 11:56:31.450167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:31.450167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:56:31.450167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:56:31.450167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:56:31.450167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:56:31.450167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:56:31.450167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:56:31.450167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:56:31.450167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application conn.query(q) May 19 11:56:31.450167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:56:31.450167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:56:31.450167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:56:31.450167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result.read() May 19 11:56:31.450167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:56:31.451004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application next(self.gen) May 19 11:56:31.451977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 11:56:31.451977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application yield resource May 19 11:56:31.451977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 11:56:31.451977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application next(self.gen) May 19 11:56:31.451977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 11:56:31.451977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.session.rollback() May 19 11:56:31.451977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 11:56:31.451977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.force_reraise() May 19 11:56:31.451977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 11:56:31.451977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise self.value May 19 11:56:31.451977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 11:56:31.451977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 11:56:31.451977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 11:56:31.451977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application session.commit() May 19 11:56:31.451977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 11:56:31.451977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 11:56:31.451977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 11:56:31.453521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._prepare_impl() May 19 11:56:31.453521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 11:56:31.453521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.session.flush() May 19 11:56:31.453521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 11:56:31.453521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._flush(objects) May 19 11:56:31.453521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 11:56:31.453521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 11:56:31.453521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 11:56:31.453521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application compat.raise_( May 19 11:56:31.453521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:56:31.453521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception May 19 11:56:31.453521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 11:56:31.453521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application flush_context.execute() May 19 11:56:31.453521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 11:56:31.453521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rec.execute(self) May 19 11:56:31.453521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 11:56:31.453521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 11:56:31.455560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 11:56:31.455560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 11:56:31.455560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 11:56:31.455560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 11:56:31.455560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 11:56:31.455560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 11:56:31.455560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 11:56:31.455560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 11:56:31.455560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 11:56:31.455560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 11:56:31.455560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 11:56:31.455560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 11:56:31.455560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 11:56:31.455560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 11:56:31.455560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 11:56:31.455560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception May 19 11:56:31.457606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 11:56:31.457606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 11:56:31.457606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 11:56:31.457606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 11:56:31.457606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 11:56:31.457606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result = self._query(query) May 19 11:56:31.457606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 11:56:31.457606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application conn.query(q) May 19 11:56:31.457606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 11:56:31.457606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 11:56:31.457606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 11:56:31.457606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application result.read() May 19 11:56:31.457606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 11:56:31.457606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 11:56:31.457606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 11:56:31.457606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 11:56:31.459641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 11:56:31.459641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 11:56:31.459641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 11:56:31.459641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 11:56:31.459641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 11:56:31.459641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 11:56:31.459641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [parameters: {'user_id': '4f885627ac0f4a8ca78e6859412e8685', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 11:56:31.459641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 11:56:31.459641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:31.459641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:31.459641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:31.459641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:31.459641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:31.459641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:31.459641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:31.461635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:31.461635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:31.461635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:31.461635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:31.461635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:31.461635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:31.461635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:31.461635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 11:56:31.461635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 11:56:31.461635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:31.461635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:31.461635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:56:31.461635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:31.461635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:56:31.461635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:31.461635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 11:56:31.461635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 11:56:31.464664 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 11:56:31.464664 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 11:56:31.464664 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 11:56:31.464664 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 11:56:31.464664 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 11:56:31.464664 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:31.467380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 492/977] 10.222.0.73 () {60 vars in 1131 bytes} [Thu May 19 11:56:31 2022] POST /identity/v3/users => generated 160 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:31.476001 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a94f6-bf1c-487b-bdb8-227e6d38771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:31.476001 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a94f6-bf1c-487b-bdb8-227e6d38771d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.476001 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a94f6-bf1c-487b-bdb8-227e6d38771d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.476001 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a94f6-bf1c-487b-bdb8-227e6d38771d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.477218 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b617e-e94a-4377-a3ff-d245f0be334c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:31.478593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a94f6-bf1c-487b-bdb8-227e6d38771d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:31.479362 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a94f6-bf1c-487b-bdb8-227e6d38771d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:31.494146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-fa2a94f6-bf1c-487b-bdb8-227e6d38771d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:31.494146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:31.494146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:31.494146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:31.494146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:31.494146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:31.494146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:31.494146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:31.494146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:31.494146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:31.494146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:31.494146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:31.494146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:56:31.494146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:56:31.494146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:56:31.496121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:56:31.496121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:31.496121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:31.496121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:31.496121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:31.496121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:31.496121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:31.496121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:31.496121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:31.496121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:31.496121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:31.496121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:31.496121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:31.496121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:31.496121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:31.496121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:31.496121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:31.498406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:56:31.498406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:56:31.498406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:56:31.498406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:56:31.498406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:56:31.498406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:56:31.498406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:31.498406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:31.501352 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 486/978] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:31.505525 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a94f6-bf1c-487b-bdb8-227e6d38771d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:31.565203 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:31.595974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b617e-e94a-4377-a3ff-d245f0be334c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:31.616931 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:31.641726 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8e231-0b75-43e5-b7a8-c07068a9af5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:31.642988 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8e231-0b75-43e5-b7a8-c07068a9af5d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.643477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8e231-0b75-43e5-b7a8-c07068a9af5d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.643749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a94f6-bf1c-487b-bdb8-227e6d38771d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:31.644250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8e231-0b75-43e5-b7a8-c07068a9af5d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.652865 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8e231-0b75-43e5-b7a8-c07068a9af5d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:31.654749 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8e231-0b75-43e5-b7a8-c07068a9af5d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:31.670751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-32b8e231-0b75-43e5-b7a8-c07068a9af5d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:56:31.670751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:31.670751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:31.670751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:31.670751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:31.670751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:31.670751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:31.670751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:31.670751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:31.670751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:31.670751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:31.670751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:31.670751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:56:31.670751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:56:31.670751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:56:31.670751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:31.672321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:31.673249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:31.673249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:31.673249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:56:31.673249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:56:31.673249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:56:31.673249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:56:31.673249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:56:31.673249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:56:31.673249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 11:56:31.673249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:31.675936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 493/979] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:56:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:31.681232 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8e231-0b75-43e5-b7a8-c07068a9af5d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:31.682313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51139e3f-4f12-47ff-bd2d-2191d43f1c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:31.682981 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51139e3f-4f12-47ff-bd2d-2191d43f1c6c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.683268 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51139e3f-4f12-47ff-bd2d-2191d43f1c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.683541 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51139e3f-4f12-47ff-bd2d-2191d43f1c6c None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.684374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51139e3f-4f12-47ff-bd2d-2191d43f1c6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:31.684680 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51139e3f-4f12-47ff-bd2d-2191d43f1c6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:31.687905 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51139e3f-4f12-47ff-bd2d-2191d43f1c6c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:31.704002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 487/980] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:56:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:31.708543 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51139e3f-4f12-47ff-bd2d-2191d43f1c6c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:31.807026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8e231-0b75-43e5-b7a8-c07068a9af5d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:31.842335 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2a7f8-c58e-41c3-b906-55d724ff9cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:31.843003 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2a7f8-c58e-41c3-b906-55d724ff9cbb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.843309 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2a7f8-c58e-41c3-b906-55d724ff9cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.843591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2a7f8-c58e-41c3-b906-55d724ff9cbb None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.844616 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2a7f8-c58e-41c3-b906-55d724ff9cbb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:31.844830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2a7f8-c58e-41c3-b906-55d724ff9cbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:31.846258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2a7f8-c58e-41c3-b906-55d724ff9cbb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:31.851010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51139e3f-4f12-47ff-bd2d-2191d43f1c6c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:31.852820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:31.887626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 494/981] 10.222.0.73 () {56 vars in 1101 bytes} [Thu May 19 11:56:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:31.899951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00d5ed-153d-4cc2-a939-f5e7f4a96bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:31.899951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00d5ed-153d-4cc2-a939-f5e7f4a96bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.899951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00d5ed-153d-4cc2-a939-f5e7f4a96bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.899951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00d5ed-153d-4cc2-a939-f5e7f4a96bc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.900397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00d5ed-153d-4cc2-a939-f5e7f4a96bc9 None admin] RBAC: Adding query filter params (role.id=bcd07251993842dba52e681f3b559dd8, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=b6c5da324ab2405a84036db91a1366a0) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:31.900397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00d5ed-153d-4cc2-a939-f5e7f4a96bc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:31.900397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00d5ed-153d-4cc2-a939-f5e7f4a96bc9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:31.906746 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 488/982] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:56:31 2022] GET /identity/v3/role_assignments?user.id=b6c5da324ab2405a84036db91a1366a0&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=bcd07251993842dba52e681f3b559dd8 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:31.969075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51440690-20e9-42dc-aadd-22b9fd7b51fd None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.969419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51440690-20e9-42dc-aadd-22b9fd7b51fd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.969643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51440690-20e9-42dc-aadd-22b9fd7b51fd None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.971606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 495/983] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:31.977288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c91f2b-3b22-425b-97d2-48c43a9a6585 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:31.977656 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c91f2b-3b22-425b-97d2-48c43a9a6585 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:31.977845 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c91f2b-3b22-425b-97d2-48c43a9a6585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:31.997430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c4c91f2b-3b22-425b-97d2-48c43a9a6585 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:31.998724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c4c91f2b-3b22-425b-97d2-48c43a9a6585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:32.079058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 489/984] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:32.101515 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51440690-20e9-42dc-aadd-22b9fd7b51fd None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:32.144138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:32.219674 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51440690-20e9-42dc-aadd-22b9fd7b51fd None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:32.255730 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067320e-8b18-4c27-872c-f6572c21643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:32.256944 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067320e-8b18-4c27-872c-f6572c21643a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:32.257473 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067320e-8b18-4c27-872c-f6572c21643a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:32.257972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067320e-8b18-4c27-872c-f6572c21643a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:32.258814 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067320e-8b18-4c27-872c-f6572c21643a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:32.260463 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067320e-8b18-4c27-872c-f6572c21643a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:32.273777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b067320e-8b18-4c27-872c-f6572c21643a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:56:32.273777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:32.273777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:32.273777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:32.273777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:32.273777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:32.273777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:32.273777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:32.273777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:56:32.273777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:32.273777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:32.273777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:32.273777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:32.273777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:32.273777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:32.273777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:32.273777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:32.274775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:32.274775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:32.274775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:32.274775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:32.274775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:32.274775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:32.274775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:32.274775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:32.274775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:32.274775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:32.274775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:32.274775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:32.274775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:32.274775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:32.274775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:32.274775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:32.275684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:32.275684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:32.275684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:32.275684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:32.275684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:32.275684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:32.275684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:32.275684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:32.275684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:32.275684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:32.275684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:32.275684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:32.275684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:56:32.275684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:32.277394 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 496/985] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:32.284072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c91f2b-3b22-425b-97d2-48c43a9a6585 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:32.389134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:32.396338 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c91f2b-3b22-425b-97d2-48c43a9a6585 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:32.431834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84eb134-950c-4fcb-a198-be420618c5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:32.432542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eb134-950c-4fcb-a198-be420618c5ef None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:32.432833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eb134-950c-4fcb-a198-be420618c5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:32.433111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eb134-950c-4fcb-a198-be420618c5ef None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:32.433824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84eb134-950c-4fcb-a198-be420618c5ef None admin] RBAC: Adding query filter params (name=compute) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:32.434135 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84eb134-950c-4fcb-a198-be420618c5ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:32.435511 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84eb134-950c-4fcb-a198-be420618c5ef None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:32.445034 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 490/986] 10.222.0.73 () {56 vars in 1112 bytes} [Thu May 19 11:56:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:32.446164 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067320e-8b18-4c27-872c-f6572c21643a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:32.554997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:32.562107 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067320e-8b18-4c27-872c-f6572c21643a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:32.596331 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d497d-bae3-45a7-a1d3-ddbffe5a7bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:32.596999 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d497d-bae3-45a7-a1d3-ddbffe5a7bae None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:32.597287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d497d-bae3-45a7-a1d3-ddbffe5a7bae None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:32.597570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d497d-bae3-45a7-a1d3-ddbffe5a7bae None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:32.598285 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d497d-bae3-45a7-a1d3-ddbffe5a7bae None admin] RBAC: Adding query filter params (type=compute) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:32.598603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d497d-bae3-45a7-a1d3-ddbffe5a7bae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:32.599996 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d497d-bae3-45a7-a1d3-ddbffe5a7bae None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:32.609512 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 497/987] 10.222.0.73 () {56 vars in 1112 bytes} [Thu May 19 11:56:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:32.610629 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84eb134-950c-4fcb-a198-be420618c5ef None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:32.711013 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84eb134-950c-4fcb-a198-be420618c5ef None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:32.744869 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661b4db-139b-4c6f-9e9c-a6622d2ee4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:32.745532 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661b4db-139b-4c6f-9e9c-a6622d2ee4ab None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:32.745821 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661b4db-139b-4c6f-9e9c-a6622d2ee4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:32.746101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661b4db-139b-4c6f-9e9c-a6622d2ee4ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:32.746895 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661b4db-139b-4c6f-9e9c-a6622d2ee4ab None admin] RBAC: Adding query filter params (interface=public, service_id=7fc9878ad14e42c9895b8007627ef3dc, region_id=RegionOne) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:32.747212 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661b4db-139b-4c6f-9e9c-a6622d2ee4ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:32.748599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661b4db-139b-4c6f-9e9c-a6622d2ee4ab None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:32.758693 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 491/988] 10.222.0.73 () {56 vars in 1251 bytes} [Thu May 19 11:56:32 2022] GET /identity/v3/endpoints?service_id=7fc9878ad14e42c9895b8007627ef3dc&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:32.759886 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d497d-bae3-45a7-a1d3-ddbffe5a7bae None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:32.860530 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d497d-bae3-45a7-a1d3-ddbffe5a7bae None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:32.898209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc984a-775a-40b9-9802-5b985f59804e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:32.898883 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc984a-775a-40b9-9802-5b985f59804e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:32.899174 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc984a-775a-40b9-9802-5b985f59804e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:32.899459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc984a-775a-40b9-9802-5b985f59804e None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:32.900213 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc984a-775a-40b9-9802-5b985f59804e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:32.901594 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc984a-775a-40b9-9802-5b985f59804e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:32.916026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 498/989] 10.222.0.73 () {56 vars in 1087 bytes} [Thu May 19 11:56:32 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 11:56:33.410461 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d983ac-4336-406a-9368-27607c638a47 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:33.410756 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d983ac-4336-406a-9368-27607c638a47 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:33.411041 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d983ac-4336-406a-9368-27607c638a47 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:33.412488 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 492/990] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:33.417656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536ffcc-232d-4800-b73b-5211c7b883b4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:33.417953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536ffcc-232d-4800-b73b-5211c7b883b4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:33.418232 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536ffcc-232d-4800-b73b-5211c7b883b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:33.435818 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5536ffcc-232d-4800-b73b-5211c7b883b4 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:33.437965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5536ffcc-232d-4800-b73b-5211c7b883b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:33.456897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:33.511950 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 499/991] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:33.531365 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d983ac-4336-406a-9368-27607c638a47 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:33.557681 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:33.637500 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d983ac-4336-406a-9368-27607c638a47 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:33.672386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178234b-3a55-41ef-a930-c5daaf851314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:33.673196 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178234b-3a55-41ef-a930-c5daaf851314 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:33.673476 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178234b-3a55-41ef-a930-c5daaf851314 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:33.673749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178234b-3a55-41ef-a930-c5daaf851314 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:33.674401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178234b-3a55-41ef-a930-c5daaf851314 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:33.675763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178234b-3a55-41ef-a930-c5daaf851314 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:33.687987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-d178234b-3a55-41ef-a930-c5daaf851314 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:56:33.687987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:33.687987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:33.687987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:33.687987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:33.687987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:33.687987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:33.687987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:33.687987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:56:33.687987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:33.687987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:33.687987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:33.687987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:33.687987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:33.687987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:33.687987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:33.687987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:33.688995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:33.688995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:33.688995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:33.688995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:33.688995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:33.688995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:33.688995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:33.688995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:33.688995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:33.688995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:33.688995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:33.688995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:33.688995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:33.688995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:33.688995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:33.688995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:33.689870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:33.689870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:33.689870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:33.689870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:33.689870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:33.689870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:33.689870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:33.689870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:33.689870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:33.689870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:33.689870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:33.689870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:33.689870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:56:33.689870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:33.689870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 493/992] 10.222.0.73 () {56 vars in 1126 bytes} [Thu May 19 11:56:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:33.697108 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536ffcc-232d-4800-b73b-5211c7b883b4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:33.801444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536ffcc-232d-4800-b73b-5211c7b883b4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:33.836255 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515c0ee-1ec6-441b-8fc4-b4bb052fef9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:33.836928 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c0ee-1ec6-441b-8fc4-b4bb052fef9a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:33.837758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c0ee-1ec6-441b-8fc4-b4bb052fef9a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:33.838046 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c0ee-1ec6-441b-8fc4-b4bb052fef9a None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:33.838768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515c0ee-1ec6-441b-8fc4-b4bb052fef9a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:33.839081 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515c0ee-1ec6-441b-8fc4-b4bb052fef9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:33.844362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515c0ee-1ec6-441b-8fc4-b4bb052fef9a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:33.849840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 500/993] 10.222.0.73 () {56 vars in 1122 bytes} [Thu May 19 11:56:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:33.855173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178234b-3a55-41ef-a930-c5daaf851314 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:33.943148 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:33.957097 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178234b-3a55-41ef-a930-c5daaf851314 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:33.990336 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081b6e8-db36-4251-a84b-398e36c2ada3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:33.991008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081b6e8-db36-4251-a84b-398e36c2ada3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:33.991294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081b6e8-db36-4251-a84b-398e36c2ada3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:33.991570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081b6e8-db36-4251-a84b-398e36c2ada3 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:33.992309 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081b6e8-db36-4251-a84b-398e36c2ada3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:33.992620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081b6e8-db36-4251-a84b-398e36c2ada3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:33.993998 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081b6e8-db36-4251-a84b-398e36c2ada3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:33.999072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 494/994] 10.222.0.73 () {56 vars in 1122 bytes} [Thu May 19 11:56:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:34.004630 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515c0ee-1ec6-441b-8fc4-b4bb052fef9a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:34.027304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:34.112079 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515c0ee-1ec6-441b-8fc4-b4bb052fef9a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:34.146760 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f63e51-1ae2-45dd-8723-903449f5a246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:34.147429 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f63e51-1ae2-45dd-8723-903449f5a246 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:34.147719 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f63e51-1ae2-45dd-8723-903449f5a246 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:34.148032 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f63e51-1ae2-45dd-8723-903449f5a246 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:34.148838 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f63e51-1ae2-45dd-8723-903449f5a246 None admin] RBAC: Adding query filter params (interface=admin, service_id=171ff42c46dc471eba06a269458b5a80, region_id=RegionOne) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:34.149157 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f63e51-1ae2-45dd-8723-903449f5a246 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:34.150521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f63e51-1ae2-45dd-8723-903449f5a246 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:34.156403 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 501/995] 10.222.0.73 () {56 vars in 1249 bytes} [Thu May 19 11:56:34 2022] GET /identity/v3/endpoints?service_id=171ff42c46dc471eba06a269458b5a80&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:34.161556 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081b6e8-db36-4251-a84b-398e36c2ada3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:34.210382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de485743-abdf-4d4f-8982-407a0f3b6358 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:34.210598 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de485743-abdf-4d4f-8982-407a0f3b6358 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:34.210880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de485743-abdf-4d4f-8982-407a0f3b6358 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:34.212299 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 502/996] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:34.217478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67bf3f-8c7c-4a36-9082-9bd524466bcc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:34.217953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67bf3f-8c7c-4a36-9082-9bd524466bcc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:34.218259 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67bf3f-8c7c-4a36-9082-9bd524466bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:34.234675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9b67bf3f-8c7c-4a36-9082-9bd524466bcc None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:34.235832 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9b67bf3f-8c7c-4a36-9082-9bd524466bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:34.271780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081b6e8-db36-4251-a84b-398e36c2ada3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:34.307655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e124d10-52c0-4457-8131-c626939caab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:34.312884 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 503/997] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:34.313074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e124d10-52c0-4457-8131-c626939caab6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:34.313074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e124d10-52c0-4457-8131-c626939caab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:34.313074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e124d10-52c0-4457-8131-c626939caab6 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:34.313074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e124d10-52c0-4457-8131-c626939caab6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:34.313074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e124d10-52c0-4457-8131-c626939caab6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:34.323892 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 495/998] 10.222.0.73 () {56 vars in 1087 bytes} [Thu May 19 11:56:34 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 11:56:34.331365 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67bf3f-8c7c-4a36-9082-9bd524466bcc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:34.347819 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:34.446985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67bf3f-8c7c-4a36-9082-9bd524466bcc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:34.485058 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87964c1e-64f3-49af-8db7-54eae84f1300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:34.485830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87964c1e-64f3-49af-8db7-54eae84f1300 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:34.486060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87964c1e-64f3-49af-8db7-54eae84f1300 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:34.486336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87964c1e-64f3-49af-8db7-54eae84f1300 None admin] PATH_INFO: `/v3/services/image` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:34.486993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87964c1e-64f3-49af-8db7-54eae84f1300 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:34.488398 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87964c1e-64f3-49af-8db7-54eae84f1300 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:34.500516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-87964c1e-64f3-49af-8db7-54eae84f1300 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:56:34.500516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:34.500516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:34.500516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:34.500516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:34.500516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:34.500516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:34.500516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:34.500516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:56:34.500516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:34.500516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:34.500516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:34.500516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:34.500516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:34.500516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:34.500516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:34.500516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:34.501612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:34.501612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:34.501612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:34.501612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:34.501612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:34.501612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:34.501612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:34.501612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:34.501612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:34.501612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:34.501612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:34.501612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:34.501612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:34.501612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:34.501612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:34.501612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:34.503588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:34.503588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:34.503588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:34.503588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:34.503588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:34.503588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:34.503588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:34.503588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:34.503588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:34.503588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:34.503588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:34.503588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:34.503588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:56:34.503588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:34.503588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 504/999] 10.222.0.73 () {56 vars in 1105 bytes} [Thu May 19 11:56:34 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:34.507855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e124d10-52c0-4457-8131-c626939caab6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:34.527547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:34.610163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e124d10-52c0-4457-8131-c626939caab6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:34.643370 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce02a6c-a236-4c4e-936c-e0edfbe8f6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:34.644162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02a6c-a236-4c4e-936c-e0edfbe8f6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:34.644338 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02a6c-a236-4c4e-936c-e0edfbe8f6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:34.644614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce02a6c-a236-4c4e-936c-e0edfbe8f6e5 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:34.645319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce02a6c-a236-4c4e-936c-e0edfbe8f6e5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:34.645626 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce02a6c-a236-4c4e-936c-e0edfbe8f6e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:34.646985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce02a6c-a236-4c4e-936c-e0edfbe8f6e5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:34.657135 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 496/1000] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:34.658625 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87964c1e-64f3-49af-8db7-54eae84f1300 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:34.736257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:34.759573 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87964c1e-64f3-49af-8db7-54eae84f1300 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:34.793706 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab1377-8e5a-4032-8ae2-46dad7112b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:34.794377 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1377-8e5a-4032-8ae2-46dad7112b42 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:34.794661 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1377-8e5a-4032-8ae2-46dad7112b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:34.795191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1377-8e5a-4032-8ae2-46dad7112b42 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:34.795896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab1377-8e5a-4032-8ae2-46dad7112b42 None admin] RBAC: Adding query filter params (type=image) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:34.796230 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab1377-8e5a-4032-8ae2-46dad7112b42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:34.797600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab1377-8e5a-4032-8ae2-46dad7112b42 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:34.808014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 505/1001] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:35.137986 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfd0fa-eb97-48ce-aae3-e49d07c2bf2d None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:35.138334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfd0fa-eb97-48ce-aae3-e49d07c2bf2d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:35.138590 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfd0fa-eb97-48ce-aae3-e49d07c2bf2d None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:35.140083 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 497/1002] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:35.145887 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc69a80-f887-4c1d-a3c6-623c75356d3b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:35.146182 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc69a80-f887-4c1d-a3c6-623c75356d3b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:35.146464 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc69a80-f887-4c1d-a3c6-623c75356d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:35.163157 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fdc69a80-f887-4c1d-a3c6-623c75356d3b None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:35.164370 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fdc69a80-f887-4c1d-a3c6-623c75356d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:35.232742 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 506/1003] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:35.255427 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfd0fa-eb97-48ce-aae3-e49d07c2bf2d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:35.338686 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:35.360008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfd0fa-eb97-48ce-aae3-e49d07c2bf2d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:35.401017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378f23b-bafd-4f41-ab0b-46b8058edadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:35.401760 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378f23b-bafd-4f41-ab0b-46b8058edadb None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:35.402041 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378f23b-bafd-4f41-ab0b-46b8058edadb None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:35.402308 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378f23b-bafd-4f41-ab0b-46b8058edadb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:35.402945 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378f23b-bafd-4f41-ab0b-46b8058edadb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:35.404326 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378f23b-bafd-4f41-ab0b-46b8058edadb None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:35.415858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-7378f23b-bafd-4f41-ab0b-46b8058edadb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:56:35.415858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:35.415858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:35.415858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:35.415858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:35.415858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:35.415858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:35.415858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:35.415858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:56:35.415858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:35.415858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:35.415858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:35.415858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:35.415858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:35.415858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:35.415858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:35.415858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:35.416877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:35.416877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:35.416877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:35.416877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:35.416877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:35.416877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:35.416877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:35.416877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:35.416877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:35.416877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:35.416877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:35.416877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:35.416877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:35.416877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:35.416877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:35.416877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:35.418312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:35.418312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:35.418312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:35.418312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:35.418312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:35.418312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:35.418312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:35.418312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:35.418312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:35.418312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:35.418312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:35.418312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:35.418312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 11:56:35.418312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:35.418312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 498/1004] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:35.423615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc69a80-f887-4c1d-a3c6-623c75356d3b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:35.493977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:35.527613 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc69a80-f887-4c1d-a3c6-623c75356d3b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:35.564475 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c4118-368a-4974-857f-e5a1ccfd0638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:35.565426 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c4118-368a-4974-857f-e5a1ccfd0638 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:35.565932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c4118-368a-4974-857f-e5a1ccfd0638 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:35.566365 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c4118-368a-4974-857f-e5a1ccfd0638 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:35.567227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c4118-368a-4974-857f-e5a1ccfd0638 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:35.567700 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c4118-368a-4974-857f-e5a1ccfd0638 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:35.569264 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c4118-368a-4974-857f-e5a1ccfd0638 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:35.574847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 507/1005] 10.222.0.73 () {56 vars in 1112 bytes} [Thu May 19 11:56:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:35.580176 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378f23b-bafd-4f41-ab0b-46b8058edadb None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:35.683254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378f23b-bafd-4f41-ab0b-46b8058edadb None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:35.716037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2e9f3-5cbd-42c2-b687-ed5aa9610896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:35.716700 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2e9f3-5cbd-42c2-b687-ed5aa9610896 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:35.716979 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2e9f3-5cbd-42c2-b687-ed5aa9610896 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:35.717257 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2e9f3-5cbd-42c2-b687-ed5aa9610896 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:35.717962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2e9f3-5cbd-42c2-b687-ed5aa9610896 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:35.718838 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2e9f3-5cbd-42c2-b687-ed5aa9610896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:35.720205 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2e9f3-5cbd-42c2-b687-ed5aa9610896 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:35.725196 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 499/1006] 10.222.0.73 () {56 vars in 1112 bytes} [Thu May 19 11:56:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:35.730518 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c4118-368a-4974-857f-e5a1ccfd0638 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:35.829032 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c4118-368a-4974-857f-e5a1ccfd0638 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:35.862923 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae730ec-b960-4a45-a77e-6a902cc6d6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:35.863585 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae730ec-b960-4a45-a77e-6a902cc6d6fa None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:35.863870 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae730ec-b960-4a45-a77e-6a902cc6d6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:35.864178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae730ec-b960-4a45-a77e-6a902cc6d6fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:35.864927 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae730ec-b960-4a45-a77e-6a902cc6d6fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:35.866317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae730ec-b960-4a45-a77e-6a902cc6d6fa None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:35.869662 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:35.891959 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 508/1007] 10.222.0.73 () {60 vars in 1144 bytes} [Thu May 19 11:56:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:36.560511 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd4212-168c-427d-b7a3-dd067ae8bad4 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:36.560869 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd4212-168c-427d-b7a3-dd067ae8bad4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:36.561085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd4212-168c-427d-b7a3-dd067ae8bad4 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:36.563957 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 500/1008] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:36.568335 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfb836-1a64-4580-a168-b9d31bc4f62b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:36.568773 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfb836-1a64-4580-a168-b9d31bc4f62b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:36.568955 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfb836-1a64-4580-a168-b9d31bc4f62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:36.586126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5ddfb836-1a64-4580-a168-b9d31bc4f62b None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:36.587307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5ddfb836-1a64-4580-a168-b9d31bc4f62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:36.661648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 509/1009] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:36 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:36.683695 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd4212-168c-427d-b7a3-dd067ae8bad4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:36.696370 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:36.787177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd4212-168c-427d-b7a3-dd067ae8bad4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:36.821177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdcaf5-701a-424a-8e2a-00a81ca628de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:36.821979 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdcaf5-701a-424a-8e2a-00a81ca628de None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:36.822263 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdcaf5-701a-424a-8e2a-00a81ca628de None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:36.822535 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdcaf5-701a-424a-8e2a-00a81ca628de None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:36.823177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdcaf5-701a-424a-8e2a-00a81ca628de None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:36.824565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdcaf5-701a-424a-8e2a-00a81ca628de None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:36.836356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-bbfdcaf5-701a-424a-8e2a-00a81ca628de None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:56:36.836356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:36.836356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:36.836356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:36.836356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:36.836356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:36.836356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:36.836356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:36.836356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:56:36.836356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:36.836356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:36.836356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:36.836356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:36.836356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:36.836356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:36.836356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:36.836356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:36.837359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:36.837359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:36.837359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:36.837359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:36.837359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:36.837359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:36.837359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:36.837359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:36.837359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:36.837359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:36.837359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:36.837359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:36.837359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:36.837359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:36.837359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:36.837359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:36.838198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:36.838198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:36.838198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:36.838198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:36.838198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:36.838198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:36.838198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:36.838198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:36.838198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:36.838198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:36.838198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:36.838198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:36.838198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 11:56:36.838198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:36.840002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 501/1010] 10.222.0.73 () {56 vars in 1126 bytes} [Thu May 19 11:56:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:36.843796 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfb836-1a64-4580-a168-b9d31bc4f62b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:36.949235 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfb836-1a64-4580-a168-b9d31bc4f62b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:36.965875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:36.984723 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e7590-db52-42ff-acf6-8a4041162101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:36.985385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e7590-db52-42ff-acf6-8a4041162101 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:36.985667 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e7590-db52-42ff-acf6-8a4041162101 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:36.985940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e7590-db52-42ff-acf6-8a4041162101 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:36.986641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e7590-db52-42ff-acf6-8a4041162101 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:36.986947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e7590-db52-42ff-acf6-8a4041162101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:36.988323 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e7590-db52-42ff-acf6-8a4041162101 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:36.997577 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 510/1011] 10.222.0.73 () {56 vars in 1122 bytes} [Thu May 19 11:56:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:36.998683 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdcaf5-701a-424a-8e2a-00a81ca628de None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:37.050060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cd204-ad93-44e2-86c4-b40bc6f8ca70 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:37.050349 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cd204-ad93-44e2-86c4-b40bc6f8ca70 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:37.050643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cd204-ad93-44e2-86c4-b40bc6f8ca70 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:37.052260 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 511/1012] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:37.057139 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aeddf0-befd-4da4-80d6-b05bb7c958a9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:37.057430 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aeddf0-befd-4da4-80d6-b05bb7c958a9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:37.057712 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aeddf0-befd-4da4-80d6-b05bb7c958a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:37.071909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:37.075876 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f8aeddf0-befd-4da4-80d6-b05bb7c958a9 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:37.077183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f8aeddf0-befd-4da4-80d6-b05bb7c958a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:37.104162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdcaf5-701a-424a-8e2a-00a81ca628de None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:37.139264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab0f04-5dd8-460a-a926-8a3d9c8ebd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:37.139944 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab0f04-5dd8-460a-a926-8a3d9c8ebd34 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:37.140266 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab0f04-5dd8-460a-a926-8a3d9c8ebd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:37.140540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab0f04-5dd8-460a-a926-8a3d9c8ebd34 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:37.141243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab0f04-5dd8-460a-a926-8a3d9c8ebd34 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:37.141547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab0f04-5dd8-460a-a926-8a3d9c8ebd34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:37.142901 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab0f04-5dd8-460a-a926-8a3d9c8ebd34 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:37.147750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 502/1013] 10.222.0.73 () {56 vars in 1122 bytes} [Thu May 19 11:56:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:37.153411 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab0f04-5dd8-460a-a926-8a3d9c8ebd34 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:37.156189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 512/1014] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:37 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:37.177734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aeddf0-befd-4da4-80d6-b05bb7c958a9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:37.258836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab0f04-5dd8-460a-a926-8a3d9c8ebd34 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:37.281237 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aeddf0-befd-4da4-80d6-b05bb7c958a9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:37.292466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:37.293003 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f8879-a477-44cd-a26e-c40f375d6413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:37.293664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f8879-a477-44cd-a26e-c40f375d6413 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:37.293947 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f8879-a477-44cd-a26e-c40f375d6413 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:37.294285 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f8879-a477-44cd-a26e-c40f375d6413 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:37.295335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f8879-a477-44cd-a26e-c40f375d6413 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:37.297270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f8879-a477-44cd-a26e-c40f375d6413 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:37.301651 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:37.314648 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 503/1015] 10.222.0.73 () {60 vars in 1144 bytes} [Thu May 19 11:56:37 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:37.327244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3535144-6198-48ae-8f85-02db27120867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:37.327960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3535144-6198-48ae-8f85-02db27120867 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:37.328256 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3535144-6198-48ae-8f85-02db27120867 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:37.328528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3535144-6198-48ae-8f85-02db27120867 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:37.329269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3535144-6198-48ae-8f85-02db27120867 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:37.330669 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3535144-6198-48ae-8f85-02db27120867 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:37.347980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 513/1016] 10.222.0.73 () {60 vars in 1141 bytes} [Thu May 19 11:56:37 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:56:38.201304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f149d4-96e8-4b35-acd8-d09a3706a821 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:38.201835 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f149d4-96e8-4b35-acd8-d09a3706a821 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:38.201835 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f149d4-96e8-4b35-acd8-d09a3706a821 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:38.203779 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 504/1017] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:38.209179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30fed4-b5a3-4f15-ba14-28b64003d3a7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:38.209584 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30fed4-b5a3-4f15-ba14-28b64003d3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:38.209770 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30fed4-b5a3-4f15-ba14-28b64003d3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:38.226843 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8d30fed4-b5a3-4f15-ba14-28b64003d3a7 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:38.228043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8d30fed4-b5a3-4f15-ba14-28b64003d3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:38.299400 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 514/1018] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:38.322405 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f149d4-96e8-4b35-acd8-d09a3706a821 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:38.430600 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f149d4-96e8-4b35-acd8-d09a3706a821 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:38.465733 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6352619-f8d7-4ea1-80ee-3d907b10d122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:38.466476 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6352619-f8d7-4ea1-80ee-3d907b10d122 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:38.466756 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6352619-f8d7-4ea1-80ee-3d907b10d122 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:38.467030 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6352619-f8d7-4ea1-80ee-3d907b10d122 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:38.477480 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6352619-f8d7-4ea1-80ee-3d907b10d122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:38.486288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e6352619-f8d7-4ea1-80ee-3d907b10d122 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:56:38.486288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:38.486288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:38.486288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:38.486288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:38.486288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:38.486288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:38.486288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:38.486288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:38.486288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:38.486288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:38.486288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:38.486288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:38.486288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:38.486288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:38.486288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:38.487302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:38.487302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:38.487302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:38.487302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:38.487302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:38.487302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:38.487302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:38.487302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:38.487302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:38.487302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:38.487302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:38.487302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:38.487302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:38.487302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:38.487302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:38.487302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:38.488800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:38.488800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:38.488800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:38.488800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:38.488800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:38.488800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:38.488800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:38.488800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:38.488800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:38.488800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:38.488800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:56:38.488800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:38.489821 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 505/1019] 10.222.0.73 () {56 vars in 1120 bytes} [Thu May 19 11:56:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:38.493622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30fed4-b5a3-4f15-ba14-28b64003d3a7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:38.584840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:38.595181 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30fed4-b5a3-4f15-ba14-28b64003d3a7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:38.629426 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957492dc-9cab-47e9-9590-5bdcaa39f8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:38.630097 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957492dc-9cab-47e9-9590-5bdcaa39f8dc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:38.630376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957492dc-9cab-47e9-9590-5bdcaa39f8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:38.630648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957492dc-9cab-47e9-9590-5bdcaa39f8dc None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:38.631391 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957492dc-9cab-47e9-9590-5bdcaa39f8dc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:38.631700 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957492dc-9cab-47e9-9590-5bdcaa39f8dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:38.633090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957492dc-9cab-47e9-9590-5bdcaa39f8dc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:38.648414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 515/1020] 10.222.0.73 () {56 vars in 1115 bytes} [Thu May 19 11:56:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:38.652072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6352619-f8d7-4ea1-80ee-3d907b10d122 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:38.711376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:38.756671 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6352619-f8d7-4ea1-80ee-3d907b10d122 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:38.789780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d83de-ea9f-4fed-a1fa-642a8ae18f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:38.790618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d83de-ea9f-4fed-a1fa-642a8ae18f2a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:38.790907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d83de-ea9f-4fed-a1fa-642a8ae18f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:38.791184 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d83de-ea9f-4fed-a1fa-642a8ae18f2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:38.802655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d83de-ea9f-4fed-a1fa-642a8ae18f2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:38.804121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d83de-ea9f-4fed-a1fa-642a8ae18f2a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:38.820862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-853d83de-ea9f-4fed-a1fa-642a8ae18f2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:38.820862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:38.820862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:38.820862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:38.820862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:38.820862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:38.820862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:38.820862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:38.820862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:38.820862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:38.820862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:38.820862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:38.820862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:38.820862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:38.820862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:38.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:38.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:38.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:38.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:38.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:38.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:38.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:38.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:38.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:38.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:38.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:38.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:38.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:38.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:38.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:38.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:38.821715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:38.822597 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:38.822597 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:38.822597 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:38.822597 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:38.826667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 506/1021] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:38.828095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957492dc-9cab-47e9-9590-5bdcaa39f8dc None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:38.928183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957492dc-9cab-47e9-9590-5bdcaa39f8dc None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:38.963003 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8574040-ac39-41d0-a64c-2fbd5fc96aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:38.964213 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8574040-ac39-41d0-a64c-2fbd5fc96aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:38.964737 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8574040-ac39-41d0-a64c-2fbd5fc96aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:38.965262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8574040-ac39-41d0-a64c-2fbd5fc96aa3 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:38.966643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8574040-ac39-41d0-a64c-2fbd5fc96aa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:38.967225 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8574040-ac39-41d0-a64c-2fbd5fc96aa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:38.970398 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8574040-ac39-41d0-a64c-2fbd5fc96aa3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:38.992064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 516/1022] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:38.993399 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d83de-ea9f-4fed-a1fa-642a8ae18f2a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:39.097396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d83de-ea9f-4fed-a1fa-642a8ae18f2a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:39.106601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:39.133815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d82c8-2842-4bf2-aa7d-6bd1a75d1576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:39.134611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d82c8-2842-4bf2-aa7d-6bd1a75d1576 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:39.134894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d82c8-2842-4bf2-aa7d-6bd1a75d1576 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:39.135168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d82c8-2842-4bf2-aa7d-6bd1a75d1576 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:39.143401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d82c8-2842-4bf2-aa7d-6bd1a75d1576 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:39.144872 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d82c8-2842-4bf2-aa7d-6bd1a75d1576 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:39.159384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-010d82c8-2842-4bf2-aa7d-6bd1a75d1576 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:56:39.159384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:39.159384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:39.159384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:39.159384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:39.159384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:39.159384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:39.159384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:39.159384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:39.159384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:39.159384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:39.159384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:39.159384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:56:39.159384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:56:39.159384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:56:39.159384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:39.160372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:39.161319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:39.161319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:39.161319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:56:39.161319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:56:39.161319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:56:39.161319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:56:39.161319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:56:39.161319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:56:39.161319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:56:39.161319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:39.162622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 507/1023] 10.222.0.73 () {56 vars in 1093 bytes} [Thu May 19 11:56:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:39.166404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8574040-ac39-41d0-a64c-2fbd5fc96aa3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:39.183741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:39.271371 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8574040-ac39-41d0-a64c-2fbd5fc96aa3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:39.305890 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe77fdb-7efa-4612-afdc-0f9cff419a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:39.306560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe77fdb-7efa-4612-afdc-0f9cff419a96 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:39.306850 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe77fdb-7efa-4612-afdc-0f9cff419a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:39.307125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe77fdb-7efa-4612-afdc-0f9cff419a96 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:39.307995 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe77fdb-7efa-4612-afdc-0f9cff419a96 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:39.308312 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe77fdb-7efa-4612-afdc-0f9cff419a96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:39.309737 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe77fdb-7efa-4612-afdc-0f9cff419a96 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:39.331869 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 517/1024] 10.222.0.73 () {56 vars in 1133 bytes} [Thu May 19 11:56:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:39.333074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d82c8-2842-4bf2-aa7d-6bd1a75d1576 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:39.451204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d82c8-2842-4bf2-aa7d-6bd1a75d1576 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:39.485161 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004466ba-42e0-4590-8280-ae33ff510263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:39.485812 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004466ba-42e0-4590-8280-ae33ff510263 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:39.486100 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004466ba-42e0-4590-8280-ae33ff510263 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:39.486374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004466ba-42e0-4590-8280-ae33ff510263 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:39.524808 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:39.559407 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004466ba-42e0-4590-8280-ae33ff510263 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:39.560900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004466ba-42e0-4590-8280-ae33ff510263 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:39.567240 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a8a48-230e-4152-b81f-789c6a5381f5 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:39.567535 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a8a48-230e-4152-b81f-789c6a5381f5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:39.567811 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a8a48-230e-4152-b81f-789c6a5381f5 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:39.569416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 518/1025] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:39.574010 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84e6a8-23f4-480d-be91-f66afb50cd3d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:39.574300 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84e6a8-23f4-480d-be91-f66afb50cd3d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:39.574578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84e6a8-23f4-480d-be91-f66afb50cd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:39.592724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3f84e6a8-23f4-480d-be91-f66afb50cd3d None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:39.593948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3f84e6a8-23f4-480d-be91-f66afb50cd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:39.661428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 519/1026] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:39.662647 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e490a1-d382-415e-bffa-b8f3fd7809a5 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:39.662939 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e490a1-d382-415e-bffa-b8f3fd7809a5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:39.663217 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e490a1-d382-415e-bffa-b8f3fd7809a5 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:39.664114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 508/1027] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:56:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 11:56:39.668557 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 520/1028] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:39.668906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004466ba-42e0-4590-8280-ae33ff510263 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:39.669675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b46a02-be0c-4c15-badf-836aa7c88dc8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:39.670217 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b46a02-be0c-4c15-badf-836aa7c88dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:39.670495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b46a02-be0c-4c15-badf-836aa7c88dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:39.678587 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:39.695633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-54b46a02-be0c-4c15-badf-836aa7c88dc8 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:39.696908 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-54b46a02-be0c-4c15-badf-836aa7c88dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:39.737562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:39.763272 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 521/1029] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:39.764132 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b46a02-be0c-4c15-badf-836aa7c88dc8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:39.774601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004466ba-42e0-4590-8280-ae33ff510263 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:39.809056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306d7c2-d355-4503-8c0b-99d14dc5363e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:39.809846 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306d7c2-d355-4503-8c0b-99d14dc5363e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:39.810438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306d7c2-d355-4503-8c0b-99d14dc5363e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:39.810438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306d7c2-d355-4503-8c0b-99d14dc5363e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:39.820625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306d7c2-d355-4503-8c0b-99d14dc5363e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:39.822054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306d7c2-d355-4503-8c0b-99d14dc5363e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:39.839469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-c306d7c2-d355-4503-8c0b-99d14dc5363e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:39.839469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:39.839469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:39.839469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:39.839469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:39.839469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:39.839469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:39.839469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:39.839469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:39.839469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:39.839469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:39.839469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:39.839469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:39.839469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:39.839469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:39.840563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:39.840563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:39.840563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:39.840563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:39.840563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:39.840563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:39.840563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:39.840563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:39.840563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:39.840563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:39.840563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:39.840563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:39.840563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:39.840563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:39.840563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:39.840563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:39.840563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:39.841456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:39.841456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:39.841456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:39.841456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:39.841456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 509/1030] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:39.841456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306d7c2-d355-4503-8c0b-99d14dc5363e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:39.866192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b46a02-be0c-4c15-badf-836aa7c88dc8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:39.897192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:39.903415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07240b12-7f27-4308-962a-5752b77c3ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:39.905046 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07240b12-7f27-4308-962a-5752b77c3ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:39.905330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07240b12-7f27-4308-962a-5752b77c3ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:39.905640 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07240b12-7f27-4308-962a-5752b77c3ca0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:39.906803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07240b12-7f27-4308-962a-5752b77c3ca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:39.909148 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07240b12-7f27-4308-962a-5752b77c3ca0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:39.910768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 522/1031] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:39.911568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07240b12-7f27-4308-962a-5752b77c3ca0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:39.946272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306d7c2-d355-4503-8c0b-99d14dc5363e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:39.966267 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:39.980241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b28dbc-27ab-4359-96dc-aefc2947eee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:39.981025 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b28dbc-27ab-4359-96dc-aefc2947eee3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:39.981312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b28dbc-27ab-4359-96dc-aefc2947eee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:39.981591 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b28dbc-27ab-4359-96dc-aefc2947eee3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:39.982248 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b28dbc-27ab-4359-96dc-aefc2947eee3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:39.984147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b28dbc-27ab-4359-96dc-aefc2947eee3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:39.995565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-97b28dbc-27ab-4359-96dc-aefc2947eee3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:56:39.995565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:39.995565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:39.995565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:39.995565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:39.995565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:39.995565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:39.995565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:39.995565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:56:39.995565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:39.995565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:39.995565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:39.995565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:39.995565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:39.995565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:39.995565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:39.995565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:39.996627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:39.996627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:39.996627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:39.996627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:39.996627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:39.996627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:39.996627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:39.996627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:39.996627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:39.996627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:39.996627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:39.996627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:39.996627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:39.996627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:39.996627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:39.996627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:39.997462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:39.997462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:39.997462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:39.997462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:39.997462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:39.997462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:39.997462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:39.997462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:39.997462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:39.997462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:39.997462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:39.997462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:39.997462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:56:39.997462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:39.997462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 510/1032] 10.222.0.73 () {56 vars in 1105 bytes} [Thu May 19 11:56:39 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:39.998244 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b28dbc-27ab-4359-96dc-aefc2947eee3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:40.011109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07240b12-7f27-4308-962a-5752b77c3ca0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:40.044446 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7391fdd-70b9-43fe-bf7a-53c82763a845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:40.045548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7391fdd-70b9-43fe-bf7a-53c82763a845 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:40.045828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7391fdd-70b9-43fe-bf7a-53c82763a845 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:40.046101 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7391fdd-70b9-43fe-bf7a-53c82763a845 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:40.047317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7391fdd-70b9-43fe-bf7a-53c82763a845 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:40.047622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7391fdd-70b9-43fe-bf7a-53c82763a845 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:40.049013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7391fdd-70b9-43fe-bf7a-53c82763a845 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:40.059897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 523/1033] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:40.060699 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7391fdd-70b9-43fe-bf7a-53c82763a845 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:40.097932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b28dbc-27ab-4359-96dc-aefc2947eee3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:40.121072 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:40.131789 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5a4b1-9181-41fd-8fd6-7aeb1a1043fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:40.132475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5a4b1-9181-41fd-8fd6-7aeb1a1043fa None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:40.132753 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5a4b1-9181-41fd-8fd6-7aeb1a1043fa None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:40.133031 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5a4b1-9181-41fd-8fd6-7aeb1a1043fa None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:40.133761 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5a4b1-9181-41fd-8fd6-7aeb1a1043fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:40.135216 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5a4b1-9181-41fd-8fd6-7aeb1a1043fa None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:40.159473 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 511/1034] 10.222.0.73 () {60 vars in 1141 bytes} [Thu May 19 11:56:39 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:40.160307 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5a4b1-9181-41fd-8fd6-7aeb1a1043fa None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:40.161789 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7391fdd-70b9-43fe-bf7a-53c82763a845 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:40.203561 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:40.208792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e004b-8769-4e22-8cf7-c8d8bbd6cd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:40.209487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e004b-8769-4e22-8cf7-c8d8bbd6cd4c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:40.209768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e004b-8769-4e22-8cf7-c8d8bbd6cd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:40.210048 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e004b-8769-4e22-8cf7-c8d8bbd6cd4c None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:40.210825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e004b-8769-4e22-8cf7-c8d8bbd6cd4c None admin] RBAC: Adding query filter params (name=image) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:40.211125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e004b-8769-4e22-8cf7-c8d8bbd6cd4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:40.212771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e004b-8769-4e22-8cf7-c8d8bbd6cd4c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:40.224460 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 524/1035] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:40.225695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e004b-8769-4e22-8cf7-c8d8bbd6cd4c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:40.289097 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5a4b1-9181-41fd-8fd6-7aeb1a1043fa None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:40.329131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326d80b-45bb-46a1-abae-3d903de87766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:40.330058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326d80b-45bb-46a1-abae-3d903de87766 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:40.330340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326d80b-45bb-46a1-abae-3d903de87766 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:40.330737 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326d80b-45bb-46a1-abae-3d903de87766 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:40.336527 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e004b-8769-4e22-8cf7-c8d8bbd6cd4c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:40.338425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326d80b-45bb-46a1-abae-3d903de87766 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:40.340059 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326d80b-45bb-46a1-abae-3d903de87766 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:40.355510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-3326d80b-45bb-46a1-abae-3d903de87766 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:40.355510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:40.355510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:40.355510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:40.355510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:40.355510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:40.355510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:40.355510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:40.355510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:40.355510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:40.355510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:40.355510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:40.355510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:56:40.355510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:56:40.355510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:56:40.356534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:56:40.356534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:40.356534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:40.356534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:40.356534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:40.356534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:40.356534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:40.356534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:40.356534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:40.356534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:40.356534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:40.356534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:40.356534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:40.356534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:40.356534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:40.356534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:40.356534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:40.357438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:56:40.357438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:56:40.357438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:56:40.357438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:56:40.357438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:56:40.357438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:56:40.357438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:40.357438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:40.357438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 512/1036] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:40.363332 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:40.363515 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326d80b-45bb-46a1-abae-3d903de87766 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:40.380251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4d5fb-548b-461e-abc5-91283bead6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:40.380939 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4d5fb-548b-461e-abc5-91283bead6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:40.381227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4d5fb-548b-461e-abc5-91283bead6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:40.381508 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4d5fb-548b-461e-abc5-91283bead6e5 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:40.382703 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4d5fb-548b-461e-abc5-91283bead6e5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:40.382703 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4d5fb-548b-461e-abc5-91283bead6e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:40.384465 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4d5fb-548b-461e-abc5-91283bead6e5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:40.390275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 525/1037] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:40.396926 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4d5fb-548b-461e-abc5-91283bead6e5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:40.463593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:40.472477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326d80b-45bb-46a1-abae-3d903de87766 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:40.501539 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4d5fb-548b-461e-abc5-91283bead6e5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:40.507069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a578cb-c690-451d-b7eb-06c1988104b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:40.507736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a578cb-c690-451d-b7eb-06c1988104b4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:40.508052 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a578cb-c690-451d-b7eb-06c1988104b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:40.508332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a578cb-c690-451d-b7eb-06c1988104b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:40.509124 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a578cb-c690-451d-b7eb-06c1988104b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:40.509436 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a578cb-c690-451d-b7eb-06c1988104b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:40.510874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a578cb-c690-451d-b7eb-06c1988104b4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:40.524766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 513/1038] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:56:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:40.530232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a578cb-c690-451d-b7eb-06c1988104b4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:40.544334 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cee63e-a25e-48f9-b0b1-f2fff0f8ee93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:40.545251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cee63e-a25e-48f9-b0b1-f2fff0f8ee93 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:40.545540 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cee63e-a25e-48f9-b0b1-f2fff0f8ee93 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:40.545817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cee63e-a25e-48f9-b0b1-f2fff0f8ee93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:40.547168 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cee63e-a25e-48f9-b0b1-f2fff0f8ee93 None admin] RBAC: Adding query filter params (interface=public, service_id=a27c9f9a0a6645efb9b1190e9fe2949e, region_id=RegionOne) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:40.547483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cee63e-a25e-48f9-b0b1-f2fff0f8ee93 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:40.548857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cee63e-a25e-48f9-b0b1-f2fff0f8ee93 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:40.554637 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 526/1039] 10.222.0.73 () {56 vars in 1251 bytes} [Thu May 19 11:56:40 2022] GET /identity/v3/endpoints?service_id=a27c9f9a0a6645efb9b1190e9fe2949e&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:40.559938 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cee63e-a25e-48f9-b0b1-f2fff0f8ee93 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:40.617779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:40.637564 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a578cb-c690-451d-b7eb-06c1988104b4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:40.670417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cee63e-a25e-48f9-b0b1-f2fff0f8ee93 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:40.674224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c515c1-1f9d-4f4e-be22-fd3be2496978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:40.674879 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c515c1-1f9d-4f4e-be22-fd3be2496978 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:40.675163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c515c1-1f9d-4f4e-be22-fd3be2496978 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:40.675439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c515c1-1f9d-4f4e-be22-fd3be2496978 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:40.676298 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c515c1-1f9d-4f4e-be22-fd3be2496978 None admin] RBAC: Adding query filter params (role.id=bcd07251993842dba52e681f3b559dd8, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=bd0c1f0710f3447d94e67048a508781e) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:40.676613 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c515c1-1f9d-4f4e-be22-fd3be2496978 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:40.678035 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c515c1-1f9d-4f4e-be22-fd3be2496978 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:40.683800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 514/1040] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:56:40 2022] GET /identity/v3/role_assignments?user.id=bd0c1f0710f3447d94e67048a508781e&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=bcd07251993842dba52e681f3b559dd8 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:40.707952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29fd37-83c5-4e31-8b12-a5bc52e3dca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:40.708658 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29fd37-83c5-4e31-8b12-a5bc52e3dca9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:40.708945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29fd37-83c5-4e31-8b12-a5bc52e3dca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:40.709223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29fd37-83c5-4e31-8b12-a5bc52e3dca9 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:40.709933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29fd37-83c5-4e31-8b12-a5bc52e3dca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:40.711347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29fd37-83c5-4e31-8b12-a5bc52e3dca9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:40.719711 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 527/1041] 10.222.0.73 () {56 vars in 1087 bytes} [Thu May 19 11:56:40 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 11:56:42.439533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c4dbc-05c7-4a21-b59c-8787a05faa01 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.440057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c4dbc-05c7-4a21-b59c-8787a05faa01 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.440157 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c4dbc-05c7-4a21-b59c-8787a05faa01 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.441646 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 515/1042] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:42.446781 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed8d9d-f35e-4f70-8949-e6b6d8f1e91d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.447163 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed8d9d-f35e-4f70-8949-e6b6d8f1e91d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.447342 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed8d9d-f35e-4f70-8949-e6b6d8f1e91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.464368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ebed8d9d-f35e-4f70-8949-e6b6d8f1e91d None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:42.465558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ebed8d9d-f35e-4f70-8949-e6b6d8f1e91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:42.536009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 528/1043] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:42.558919 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c4dbc-05c7-4a21-b59c-8787a05faa01 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:42.585447 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:42.667942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c4dbc-05c7-4a21-b59c-8787a05faa01 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:42.702627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257117d1-a68b-4710-9465-ed144225a749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:42.703416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257117d1-a68b-4710-9465-ed144225a749 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.703700 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257117d1-a68b-4710-9465-ed144225a749 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.704001 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257117d1-a68b-4710-9465-ed144225a749 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.705167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257117d1-a68b-4710-9465-ed144225a749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:42.706602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257117d1-a68b-4710-9465-ed144225a749 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:42.708400 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 516/1044] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:42.713930 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed8d9d-f35e-4f70-8949-e6b6d8f1e91d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:42.765904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:42.825780 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed8d9d-f35e-4f70-8949-e6b6d8f1e91d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:42.862687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1afb19-95ee-4770-876a-1fcc4286d97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:42.864282 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1afb19-95ee-4770-876a-1fcc4286d97d None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.864858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1afb19-95ee-4770-876a-1fcc4286d97d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.865325 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1afb19-95ee-4770-876a-1fcc4286d97d None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.866300 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1afb19-95ee-4770-876a-1fcc4286d97d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:42.868487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1afb19-95ee-4770-876a-1fcc4286d97d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:42.891426 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 529/1045] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:56:42 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:42.932297 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e979c3-19dc-4719-8abb-f9a5017c70d5 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.932545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e979c3-19dc-4719-8abb-f9a5017c70d5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.932786 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e979c3-19dc-4719-8abb-f9a5017c70d5 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.934414 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 517/1046] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:42.939934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340c1da-5c75-446e-be3d-45526e721936 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.940254 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340c1da-5c75-446e-be3d-45526e721936 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.940541 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340c1da-5c75-446e-be3d-45526e721936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.959198 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0340c1da-5c75-446e-be3d-45526e721936 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:42.960475 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0340c1da-5c75-446e-be3d-45526e721936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:42.962825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a904a-36e7-4397-b77f-8c0b19d31cdf None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.963119 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a904a-36e7-4397-b77f-8c0b19d31cdf None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.963407 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a904a-36e7-4397-b77f-8c0b19d31cdf None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.964838 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 518/1047] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:42.972001 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df5d4-6a4b-4608-bc94-46f17f8dc3da None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:42.972344 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df5d4-6a4b-4608-bc94-46f17f8dc3da None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:42.972971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df5d4-6a4b-4608-bc94-46f17f8dc3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:42.990365 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3a9df5d4-6a4b-4608-bc94-46f17f8dc3da None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:42.991816 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3a9df5d4-6a4b-4608-bc94-46f17f8dc3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:43.037769 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 530/1048] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:43.061506 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340c1da-5c75-446e-be3d-45526e721936 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:43.078002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 519/1049] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:43.098820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:43.101386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9df5d4-6a4b-4608-bc94-46f17f8dc3da None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:43.125575 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:43.185785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340c1da-5c75-446e-be3d-45526e721936 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:43.222277 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9df5d4-6a4b-4608-bc94-46f17f8dc3da None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:43.234003 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e8c9f-9323-4e35-a71b-dedbfc122df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:43.235253 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e8c9f-9323-4e35-a71b-dedbfc122df9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:43.235616 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e8c9f-9323-4e35-a71b-dedbfc122df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:43.236263 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e8c9f-9323-4e35-a71b-dedbfc122df9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:43.248094 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e8c9f-9323-4e35-a71b-dedbfc122df9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:43.256856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-a21e8c9f-9323-4e35-a71b-dedbfc122df9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:56:43.256856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:43.256856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:43.256856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:43.256856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:43.256856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:43.256856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:43.256856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:43.256856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:43.256856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:43.256856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:43.256856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:43.256856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:43.256856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:43.256856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:43.256856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:43.257786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:43.257786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:43.257786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:43.257786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:43.257786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:43.257786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:43.257786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:43.257786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:43.257786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:43.257786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:43.257786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:43.257786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:43.257786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:43.257786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:43.257786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:43.257786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:43.258615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:43.258615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:43.258615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:43.258615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:43.258615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:43.258615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:43.258615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:43.258615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:43.258615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:43.258615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:43.258615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:56:43.258615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:43.258615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 531/1050] 10.222.0.73 () {56 vars in 1120 bytes} [Thu May 19 11:56:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:43.262909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a153989-d10a-48e7-9f1f-3569369c4584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:43.263711 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a153989-d10a-48e7-9f1f-3569369c4584 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:43.263823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e8c9f-9323-4e35-a71b-dedbfc122df9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:43.264028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a153989-d10a-48e7-9f1f-3569369c4584 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:43.264309 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a153989-d10a-48e7-9f1f-3569369c4584 None admin] PATH_INFO: `/v3/services/image` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:43.265557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a153989-d10a-48e7-9f1f-3569369c4584 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.266945 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a153989-d10a-48e7-9f1f-3569369c4584 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.279007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-9a153989-d10a-48e7-9f1f-3569369c4584 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:56:43.279007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:43.279007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:56:43.279007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:56:43.279007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:56:43.279007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:56:43.279007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:56:43.279007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:43.279007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:56:43.279007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:43.279007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:56:43.279007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:43.279007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:43.279007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:43.279007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:43.279007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:43.279007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:43.280032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:43.280032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:43.280032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:43.280032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:43.280032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:43.280032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:43.280032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:56:43.280032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:56:43.280032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:56:43.280032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:56:43.280032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:43.280032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:43.280032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:43.280032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:43.280032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:43.280032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:43.280904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:43.280904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:43.280904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:43.280904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:43.280904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:43.280904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:43.280904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:43.280904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:43.280904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:43.280904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:43.280904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:56:43.280904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:56:43.280904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 11:56:43.280904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:43.285332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 520/1051] 10.222.0.73 () {56 vars in 1105 bytes} [Thu May 19 11:56:43 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:43.286074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a153989-d10a-48e7-9f1f-3569369c4584 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:43.373203 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:43.379775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:43.386878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e8c9f-9323-4e35-a71b-dedbfc122df9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:43.399381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a153989-d10a-48e7-9f1f-3569369c4584 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:43.426844 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb76392-75ee-44b0-b306-27156640259f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:43.427511 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb76392-75ee-44b0-b306-27156640259f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:43.427902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb76392-75ee-44b0-b306-27156640259f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:43.428194 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb76392-75ee-44b0-b306-27156640259f None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:43.428911 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb76392-75ee-44b0-b306-27156640259f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:43.429270 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb76392-75ee-44b0-b306-27156640259f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.430572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb76392-75ee-44b0-b306-27156640259f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.435101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a57e6-994a-4bcc-98d3-ddc0c0476346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:43.435773 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a57e6-994a-4bcc-98d3-ddc0c0476346 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:43.436143 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a57e6-994a-4bcc-98d3-ddc0c0476346 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:43.436396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a57e6-994a-4bcc-98d3-ddc0c0476346 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:43.437605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a57e6-994a-4bcc-98d3-ddc0c0476346 None admin] RBAC: Adding query filter params (name=image) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:43.437916 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a57e6-994a-4bcc-98d3-ddc0c0476346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.439508 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a57e6-994a-4bcc-98d3-ddc0c0476346 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.439611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 532/1052] 10.222.0.73 () {56 vars in 1115 bytes} [Thu May 19 11:56:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:43.448841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 521/1053] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:43.449339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb76392-75ee-44b0-b306-27156640259f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:43.450103 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a57e6-994a-4bcc-98d3-ddc0c0476346 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:43.551057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb76392-75ee-44b0-b306-27156640259f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:43.557347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a57e6-994a-4bcc-98d3-ddc0c0476346 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:43.592198 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69dde8-17e0-476f-8106-a78cefbb13f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:43.593060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69dde8-17e0-476f-8106-a78cefbb13f5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:43.593847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69dde8-17e0-476f-8106-a78cefbb13f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:43.594118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69dde8-17e0-476f-8106-a78cefbb13f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:43.594417 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cd120-416b-4326-a327-88bb37a7cd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:43.595072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cd120-416b-4326-a327-88bb37a7cd23 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:43.595354 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cd120-416b-4326-a327-88bb37a7cd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:43.595627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cd120-416b-4326-a327-88bb37a7cd23 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:43.596367 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cd120-416b-4326-a327-88bb37a7cd23 None admin] RBAC: Adding query filter params (type=image) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:43.596672 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cd120-416b-4326-a327-88bb37a7cd23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.598032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cd120-416b-4326-a327-88bb37a7cd23 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.602966 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 522/1054] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:43.605995 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69dde8-17e0-476f-8106-a78cefbb13f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.607507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69dde8-17e0-476f-8106-a78cefbb13f5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.608555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cd120-416b-4326-a327-88bb37a7cd23 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:43.621708 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:43.626416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-3d69dde8-17e0-476f-8106-a78cefbb13f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:43.626416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:43.626416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:43.626416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:43.626416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:43.626416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:43.626416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:43.626416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:43.626416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:43.626416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:43.626416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:43.626416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:43.626416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:43.626416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:43.626416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:43.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:43.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:43.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:43.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:43.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:43.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:43.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:43.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:43.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:43.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:43.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:43.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:43.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:43.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:43.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:43.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:43.627275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:43.628190 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:43.628190 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:43.628190 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:43.628190 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:43.632294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 533/1055] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:43.633144 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69dde8-17e0-476f-8106-a78cefbb13f5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:43.643360 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:43.722459 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cd120-416b-4326-a327-88bb37a7cd23 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:43.744951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69dde8-17e0-476f-8106-a78cefbb13f5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:43.758516 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bc427-b518-423b-b059-b5714db39182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:43.759269 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bc427-b518-423b-b059-b5714db39182 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:43.759462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bc427-b518-423b-b059-b5714db39182 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:43.759741 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bc427-b518-423b-b059-b5714db39182 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:43.760516 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bc427-b518-423b-b059-b5714db39182 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.761986 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bc427-b518-423b-b059-b5714db39182 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.782397 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c74e7-c63c-4a8c-b4ee-1317b62b9173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:43.783101 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c74e7-c63c-4a8c-b4ee-1317b62b9173 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:43.783390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c74e7-c63c-4a8c-b4ee-1317b62b9173 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:43.783676 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c74e7-c63c-4a8c-b4ee-1317b62b9173 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:43.792050 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 523/1056] 10.222.0.73 () {60 vars in 1144 bytes} [Thu May 19 11:56:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:43.792248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c74e7-c63c-4a8c-b4ee-1317b62b9173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:43.792248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c74e7-c63c-4a8c-b4ee-1317b62b9173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.792248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c74e7-c63c-4a8c-b4ee-1317b62b9173 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.805146 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 534/1057] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:43.811280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bc427-b518-423b-b059-b5714db39182 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:43.882971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:43.931075 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bc427-b518-423b-b059-b5714db39182 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:43.969972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40a4b7-c706-4732-8980-657f23f8a9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:43.970773 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40a4b7-c706-4732-8980-657f23f8a9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:43.971056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40a4b7-c706-4732-8980-657f23f8a9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:43.971329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40a4b7-c706-4732-8980-657f23f8a9b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:43.980053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40a4b7-c706-4732-8980-657f23f8a9b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:43.981427 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40a4b7-c706-4732-8980-657f23f8a9b9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:43.995168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-fd40a4b7-c706-4732-8980-657f23f8a9b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:56:43.995168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:43.995168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:43.995168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:43.995168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:43.995168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:43.995168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:43.995168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:43.995168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:43.995168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:43.995168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:43.995168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:43.995168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:56:43.995168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:56:43.995168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:56:43.995168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:43.996168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:43.997109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:43.997109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:43.997109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:56:43.997109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:56:43.997109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:56:43.997109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:56:43.997109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:56:43.997109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:56:43.997109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:56:43.997109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:43.997109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 524/1058] 10.222.0.73 () {56 vars in 1093 bytes} [Thu May 19 11:56:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:44.002695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c74e7-c63c-4a8c-b4ee-1317b62b9173 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:44.070093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:44.107344 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c74e7-c63c-4a8c-b4ee-1317b62b9173 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:44.143255 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83dd8a-d39d-4a35-bb8d-1e163e8ec9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:44.143937 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83dd8a-d39d-4a35-bb8d-1e163e8ec9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:44.144235 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83dd8a-d39d-4a35-bb8d-1e163e8ec9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:44.144510 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83dd8a-d39d-4a35-bb8d-1e163e8ec9b2 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:44.145341 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83dd8a-d39d-4a35-bb8d-1e163e8ec9b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:44.145676 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83dd8a-d39d-4a35-bb8d-1e163e8ec9b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:44.147196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83dd8a-d39d-4a35-bb8d-1e163e8ec9b2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:44.165120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 535/1059] 10.222.0.73 () {56 vars in 1133 bytes} [Thu May 19 11:56:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:44.171072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40a4b7-c706-4732-8980-657f23f8a9b9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:44.273114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40a4b7-c706-4732-8980-657f23f8a9b9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:44.299791 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:44.313325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fc43a-f19e-4e3e-b5df-9f1ce655598b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:44.314366 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fc43a-f19e-4e3e-b5df-9f1ce655598b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:44.314805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fc43a-f19e-4e3e-b5df-9f1ce655598b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:44.315251 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fc43a-f19e-4e3e-b5df-9f1ce655598b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:44.327368 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fc43a-f19e-4e3e-b5df-9f1ce655598b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:44.329086 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fc43a-f19e-4e3e-b5df-9f1ce655598b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:44.346304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-308fc43a-f19e-4e3e-b5df-9f1ce655598b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:44.346304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:44.346304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:44.346304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:44.346304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:44.346304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:44.346304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:44.346304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:44.346304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:44.346304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:44.346304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:44.346304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:44.346304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:44.346304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:44.346304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:44.347287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:44.347287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:44.347287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:44.347287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:44.347287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:44.347287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:44.347287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:44.347287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:44.347287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:44.347287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:44.347287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:44.347287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:44.347287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:44.347287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:44.347287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:44.347287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:44.347287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:44.348200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:44.348200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:44.348200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:44.348200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:44.349296 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 525/1060] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:44.353827 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83dd8a-d39d-4a35-bb8d-1e163e8ec9b2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:44.456855 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83dd8a-d39d-4a35-bb8d-1e163e8ec9b2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:44.480549 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:44.492655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee533309-50f9-40fc-9f99-16393e52a465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:44.493321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee533309-50f9-40fc-9f99-16393e52a465 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:44.493606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee533309-50f9-40fc-9f99-16393e52a465 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:44.493878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee533309-50f9-40fc-9f99-16393e52a465 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:44.494616 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee533309-50f9-40fc-9f99-16393e52a465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:44.494899 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee533309-50f9-40fc-9f99-16393e52a465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:44.496273 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee533309-50f9-40fc-9f99-16393e52a465 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:44.512735 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 536/1061] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:44.514127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fc43a-f19e-4e3e-b5df-9f1ce655598b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:44.616765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fc43a-f19e-4e3e-b5df-9f1ce655598b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:44.650437 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395f71a-1710-4ef3-9c11-b10ec11ee044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:44.651236 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395f71a-1710-4ef3-9c11-b10ec11ee044 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:44.651521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395f71a-1710-4ef3-9c11-b10ec11ee044 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:44.651800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395f71a-1710-4ef3-9c11-b10ec11ee044 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:44.658691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395f71a-1710-4ef3-9c11-b10ec11ee044 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:44.660163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395f71a-1710-4ef3-9c11-b10ec11ee044 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:44.675092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-5395f71a-1710-4ef3-9c11-b10ec11ee044 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:44.675092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:44.675092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:44.675092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:44.675092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:44.675092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:44.675092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:44.675092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:44.675092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:44.675092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:44.675092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:44.675092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:44.675092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:56:44.675092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:56:44.675092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:56:44.676020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:56:44.676020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:44.676020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:44.676020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:44.676020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:44.676020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:44.676020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:44.676020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:44.676020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:44.676020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:44.676020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:44.676020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:44.676020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:44.676020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:44.676020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:44.676020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:44.676020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:44.677036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:56:44.677036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:56:44.677036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:56:44.677036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:56:44.677036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:56:44.677036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:56:44.677036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:44.677036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:44.678224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 526/1062] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:44.681978 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee533309-50f9-40fc-9f99-16393e52a465 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:44.784842 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee533309-50f9-40fc-9f99-16393e52a465 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:44.818346 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d9fb0-a8f5-4ad2-8331-f2b785981873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:44.819008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d9fb0-a8f5-4ad2-8331-f2b785981873 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:44.819295 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d9fb0-a8f5-4ad2-8331-f2b785981873 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:44.819575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d9fb0-a8f5-4ad2-8331-f2b785981873 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:44.820387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d9fb0-a8f5-4ad2-8331-f2b785981873 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:44.820703 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d9fb0-a8f5-4ad2-8331-f2b785981873 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:44.822149 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d9fb0-a8f5-4ad2-8331-f2b785981873 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:44.839147 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 537/1063] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:56:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:44.840423 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395f71a-1710-4ef3-9c11-b10ec11ee044 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:44.876554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:44.949310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395f71a-1710-4ef3-9c11-b10ec11ee044 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:44.983211 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b006448-1f6d-4aad-9238-a870c69b9486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:44.984689 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006448-1f6d-4aad-9238-a870c69b9486 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:44.984973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006448-1f6d-4aad-9238-a870c69b9486 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:44.985241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006448-1f6d-4aad-9238-a870c69b9486 None admin] PATH_INFO: `/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/bd0c1f0710f3447d94e67048a508781e/roles/bcd07251993842dba52e681f3b559dd8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:44.987419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b006448-1f6d-4aad-9238-a870c69b9486 None admin] RBAC: Authorizing `identity:create_grant(project_id=d90551d9446e4f2cbd14312d2af9f7c9, user_id=bd0c1f0710f3447d94e67048a508781e, role_id=bcd07251993842dba52e681f3b559dd8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:44.988897 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b006448-1f6d-4aad-9238-a870c69b9486 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:45.001787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 527/1064] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:56:44 2022] PUT /identity/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/bd0c1f0710f3447d94e67048a508781e/roles/bcd07251993842dba52e681f3b559dd8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:56:45.234707 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e8a17-5941-4337-8861-52e89f047f67 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:45.235054 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e8a17-5941-4337-8861-52e89f047f67 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:45.235235 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e8a17-5941-4337-8861-52e89f047f67 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:45.236771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 538/1065] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:45.241788 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a900a15-368e-4395-bfd1-8f0ec1b7b2e1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:45.242086 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a900a15-368e-4395-bfd1-8f0ec1b7b2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:45.242371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a900a15-368e-4395-bfd1-8f0ec1b7b2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:45.259414 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2a900a15-368e-4395-bfd1-8f0ec1b7b2e1 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:45.260631 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2a900a15-368e-4395-bfd1-8f0ec1b7b2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:45.329750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 528/1066] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:45.353559 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e8a17-5941-4337-8861-52e89f047f67 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:45.410323 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:45.466405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e8a17-5941-4337-8861-52e89f047f67 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:45.500910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59994e1c-cdf4-418e-8921-b214823fcb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:45.501647 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59994e1c-cdf4-418e-8921-b214823fcb29 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:45.501938 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59994e1c-cdf4-418e-8921-b214823fcb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:45.502221 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59994e1c-cdf4-418e-8921-b214823fcb29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:45.513460 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59994e1c-cdf4-418e-8921-b214823fcb29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:45.521698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-59994e1c-cdf4-418e-8921-b214823fcb29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:45.521698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:45.521698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:45.521698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:45.521698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:45.521698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:45.521698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:45.521698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:45.521698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:45.521698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:45.521698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:45.521698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:45.521698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:45.521698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:45.521698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:45.521698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:45.522656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:45.522656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:45.522656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:45.522656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:45.522656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:45.522656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:45.522656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:45.522656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:45.522656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:45.522656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:45.522656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:45.522656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:45.522656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:45.522656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:45.522656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:45.522656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:45.523722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:45.523722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:45.523722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:45.523722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:45.523722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:45.523722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:45.523722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:45.523722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:45.523722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:45.523722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:45.523722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:45.523722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:45.523722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 539/1067] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:56:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:45.528765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a900a15-368e-4395-bfd1-8f0ec1b7b2e1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:45.554058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:45.637335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a900a15-368e-4395-bfd1-8f0ec1b7b2e1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:45.671512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cc451-c504-4058-b883-9c6e2fc3a2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:45.672277 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cc451-c504-4058-b883-9c6e2fc3a2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:45.672567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cc451-c504-4058-b883-9c6e2fc3a2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:45.672848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cc451-c504-4058-b883-9c6e2fc3a2e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:45.673608 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cc451-c504-4058-b883-9c6e2fc3a2e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:45.673920 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cc451-c504-4058-b883-9c6e2fc3a2e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:45.675302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cc451-c504-4058-b883-9c6e2fc3a2e6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:45.684243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 529/1068] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:56:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:45.690293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59994e1c-cdf4-418e-8921-b214823fcb29 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:45.791825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59994e1c-cdf4-418e-8921-b214823fcb29 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:45.794158 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:45.828425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2a95f-fea5-4f15-95f6-17b620b7f02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:45.829339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2a95f-fea5-4f15-95f6-17b620b7f02b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:45.829628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2a95f-fea5-4f15-95f6-17b620b7f02b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:45.829915 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2a95f-fea5-4f15-95f6-17b620b7f02b None admin] PATH_INFO: `/v3/users/0bb6abf8226a4d73b849b66f7137a6db` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:45.845928 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2a95f-fea5-4f15-95f6-17b620b7f02b None admin] RBAC: Authorizing `identity:get_user(user_id=0bb6abf8226a4d73b849b66f7137a6db)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:45.847435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2a95f-fea5-4f15-95f6-17b620b7f02b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:45.849532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 540/1069] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:56:45 2022] GET /identity/v3/users/0bb6abf8226a4d73b849b66f7137a6db => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:45.855155 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cc451-c504-4058-b883-9c6e2fc3a2e6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:45.942667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:45.960135 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cc451-c504-4058-b883-9c6e2fc3a2e6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:45.993770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf3c4f-efb9-41e6-8e88-3b47a85380cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:45.994427 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3c4f-efb9-41e6-8e88-3b47a85380cb None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:45.994714 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3c4f-efb9-41e6-8e88-3b47a85380cb None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:45.994990 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3c4f-efb9-41e6-8e88-3b47a85380cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.019490 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4119a-842e-4b8a-a7c6-48f608bd872e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:46.019778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4119a-842e-4b8a-a7c6-48f608bd872e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:46.020141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4119a-842e-4b8a-a7c6-48f608bd872e None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.021480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 541/1070] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:46.026196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2f904-89c2-4e9e-b9ef-b8ff90f7d4aa None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:46.026488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2f904-89c2-4e9e-b9ef-b8ff90f7d4aa None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:46.026772 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2f904-89c2-4e9e-b9ef-b8ff90f7d4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.043691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-16a2f904-89c2-4e9e-b9ef-b8ff90f7d4aa None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:46.045152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-16a2f904-89c2-4e9e-b9ef-b8ff90f7d4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:46.066215 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf3c4f-efb9-41e6-8e88-3b47a85380cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:46.067683 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf3c4f-efb9-41e6-8e88-3b47a85380cb None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:46.116350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 542/1071] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:46.138857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2f904-89c2-4e9e-b9ef-b8ff90f7d4aa None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:46.166993 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:46.184735 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 530/1072] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:56:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:56:46.191865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf3c4f-efb9-41e6-8e88-3b47a85380cb None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:46.243290 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:46.254509 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2f904-89c2-4e9e-b9ef-b8ff90f7d4aa None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:46.291426 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce44ef-53ad-4b18-a48e-18bf98802ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:46.292121 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce44ef-53ad-4b18-a48e-18bf98802ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:46.292411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce44ef-53ad-4b18-a48e-18bf98802ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:46.292873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce44ef-53ad-4b18-a48e-18bf98802ba5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.302381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf3c4f-efb9-41e6-8e88-3b47a85380cb None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:46.336825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991da0cf-3e45-4616-8373-e69d17e46da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:46.337680 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991da0cf-3e45-4616-8373-e69d17e46da0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:46.337989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991da0cf-3e45-4616-8373-e69d17e46da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:46.338471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991da0cf-3e45-4616-8373-e69d17e46da0 None admin] PATH_INFO: `/v3/projects/8a3a1f5f53e6496d8726aacadb28b1a2` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.339389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991da0cf-3e45-4616-8373-e69d17e46da0 None admin] RBAC: Authorizing `identity:get_project(project_id=8a3a1f5f53e6496d8726aacadb28b1a2)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:46.340878 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991da0cf-3e45-4616-8373-e69d17e46da0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:46.342730 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 531/1073] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:56:46 2022] GET /identity/v3/projects/8a3a1f5f53e6496d8726aacadb28b1a2 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:46.348997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991da0cf-3e45-4616-8373-e69d17e46da0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:46.370516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce44ef-53ad-4b18-a48e-18bf98802ba5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:46.373960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce44ef-53ad-4b18-a48e-18bf98802ba5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:46.411105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:46.458497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991da0cf-3e45-4616-8373-e69d17e46da0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:46.478195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:46.495275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 543/1074] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:56:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 11:56:46.496296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce44ef-53ad-4b18-a48e-18bf98802ba5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:46.498245 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d03e2-5de6-4e67-9983-1c80928e8565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:46.498966 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d03e2-5de6-4e67-9983-1c80928e8565 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:46.499772 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d03e2-5de6-4e67-9983-1c80928e8565 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:46.500092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d03e2-5de6-4e67-9983-1c80928e8565 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.500928 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d03e2-5de6-4e67-9983-1c80928e8565 None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=8a3a1f5f53e6496d8726aacadb28b1a2, user.id=0bb6abf8226a4d73b849b66f7137a6db) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:46.501244 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d03e2-5de6-4e67-9983-1c80928e8565 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:46.502695 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d03e2-5de6-4e67-9983-1c80928e8565 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:46.519963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 532/1075] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:56:46 2022] GET /identity/v3/role_assignments?user.id=0bb6abf8226a4d73b849b66f7137a6db&scope.project.id=8a3a1f5f53e6496d8726aacadb28b1a2&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:46.604385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce44ef-53ad-4b18-a48e-18bf98802ba5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:46.641524 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ad6d2-6238-42e2-bf60-d54a3f450af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:46.642333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ad6d2-6238-42e2-bf60-d54a3f450af6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:46.642618 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ad6d2-6238-42e2-bf60-d54a3f450af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:46.642891 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ad6d2-6238-42e2-bf60-d54a3f450af6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.654252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ad6d2-6238-42e2-bf60-d54a3f450af6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:46.655764 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ad6d2-6238-42e2-bf60-d54a3f450af6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:46.675110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-441ad6d2-6238-42e2-bf60-d54a3f450af6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:46.675110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:46.675110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:46.675110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:46.675110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:46.675110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:46.675110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:46.675110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:46.675110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:46.675110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:46.675110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:46.675110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:46.675110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:46.675110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:46.675110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:46.676461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:46.676461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:46.676461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:46.676461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:46.676461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:46.676461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:46.676461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:46.676461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:46.676461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:46.676461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:46.676461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:46.676461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:46.676461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:46.676461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:46.676461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:46.676461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:46.676461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:46.677347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:46.677347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:46.677347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:46.677347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:46.677347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 544/1076] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:46.682398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d03e2-5de6-4e67-9983-1c80928e8565 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:46.803596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d03e2-5de6-4e67-9983-1c80928e8565 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:46.821270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:46.838959 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce451f70-5b9d-44cc-922b-1a85eaf293f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:46.839618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce451f70-5b9d-44cc-922b-1a85eaf293f9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:46.839899 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce451f70-5b9d-44cc-922b-1a85eaf293f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:46.840199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce451f70-5b9d-44cc-922b-1a85eaf293f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:46.840906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce451f70-5b9d-44cc-922b-1a85eaf293f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:46.841209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce451f70-5b9d-44cc-922b-1a85eaf293f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:46.842571 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce451f70-5b9d-44cc-922b-1a85eaf293f9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:46.854530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 533/1077] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:47.234829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ed722-cb42-4779-b373-bf5218f7a43b None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.235014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ed722-cb42-4779-b373-bf5218f7a43b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.235291 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ed722-cb42-4779-b373-bf5218f7a43b None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.236724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 545/1078] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:47.241890 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa1b09-dbad-4c01-ac66-2200ee2ed34f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.242247 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa1b09-dbad-4c01-ac66-2200ee2ed34f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.242594 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa1b09-dbad-4c01-ac66-2200ee2ed34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.258998 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-73aa1b09-dbad-4c01-ac66-2200ee2ed34f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:47.260207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-73aa1b09-dbad-4c01-ac66-2200ee2ed34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:47.325457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 534/1079] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:47.349739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ed722-cb42-4779-b373-bf5218f7a43b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:47.396754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:47.450094 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ed722-cb42-4779-b373-bf5218f7a43b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:47.483300 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7afa8-d5ff-4754-bb2e-c38cde867a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:47.484180 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7afa8-d5ff-4754-bb2e-c38cde867a3a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.484463 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7afa8-d5ff-4754-bb2e-c38cde867a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.484753 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7afa8-d5ff-4754-bb2e-c38cde867a3a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.494602 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7afa8-d5ff-4754-bb2e-c38cde867a3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:47.502821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-99d7afa8-d5ff-4754-bb2e-c38cde867a3a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:56:47.502821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:47.502821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:47.502821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:47.502821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:47.502821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:47.502821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:47.502821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:47.502821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:47.502821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:47.502821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:47.502821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:47.502821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:47.502821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:47.502821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:47.502821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:47.503727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:47.503727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:47.503727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:47.503727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:47.503727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:47.503727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:47.503727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:47.503727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:47.503727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:47.503727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:47.503727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:47.503727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:47.503727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:47.503727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:47.503727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:47.503727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:47.505150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:47.505150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:47.505150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:47.505150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:47.505150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:47.505150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:47.505150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:47.505150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:47.505150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:47.505150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:47.505150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 11:56:47.505150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:47.505150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 546/1080] 10.222.0.73 () {56 vars in 1120 bytes} [Thu May 19 11:56:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:47.509928 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa1b09-dbad-4c01-ac66-2200ee2ed34f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:47.607133 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa1b09-dbad-4c01-ac66-2200ee2ed34f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:47.616334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:47.643661 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0844346-fc8f-48f2-b265-2a0dad7c9d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:47.644367 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0844346-fc8f-48f2-b265-2a0dad7c9d7e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.644645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0844346-fc8f-48f2-b265-2a0dad7c9d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.644916 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0844346-fc8f-48f2-b265-2a0dad7c9d7e None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.645670 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0844346-fc8f-48f2-b265-2a0dad7c9d7e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:47.645976 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0844346-fc8f-48f2-b265-2a0dad7c9d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:47.647337 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0844346-fc8f-48f2-b265-2a0dad7c9d7e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:47.655543 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 535/1081] 10.222.0.73 () {56 vars in 1115 bytes} [Thu May 19 11:56:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:47.661598 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7afa8-d5ff-4754-bb2e-c38cde867a3a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:47.759329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7afa8-d5ff-4754-bb2e-c38cde867a3a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:47.761549 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:47.792803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce558cc2-5737-4b86-85c6-626c77b7c880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:47.793595 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce558cc2-5737-4b86-85c6-626c77b7c880 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.793881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce558cc2-5737-4b86-85c6-626c77b7c880 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.794159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce558cc2-5737-4b86-85c6-626c77b7c880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.804863 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce558cc2-5737-4b86-85c6-626c77b7c880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:47.806314 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce558cc2-5737-4b86-85c6-626c77b7c880 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:47.823296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-ce558cc2-5737-4b86-85c6-626c77b7c880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:47.823296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:47.823296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:47.823296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:47.823296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:47.823296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:47.823296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:47.823296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:47.823296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:47.823296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:47.823296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:47.823296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:47.823296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:47.823296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:47.823296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:47.824223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:47.824223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:47.824223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:47.824223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:47.824223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:47.824223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:47.824223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:47.824223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:47.824223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:47.824223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:47.824223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:47.824223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:47.824223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:47.824223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:47.824223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:47.824223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:47.824223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:47.825093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:47.825093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:47.825093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:47.825093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:47.825093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 547/1082] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:47.830693 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0844346-fc8f-48f2-b265-2a0dad7c9d7e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:47.930037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0844346-fc8f-48f2-b265-2a0dad7c9d7e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:47.962871 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccd229-7c9e-4ade-8eb9-1f722e8731f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:47.963519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd229-7c9e-4ade-8eb9-1f722e8731f1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:47.963800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd229-7c9e-4ade-8eb9-1f722e8731f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:47.964106 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd229-7c9e-4ade-8eb9-1f722e8731f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:47.964818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccd229-7c9e-4ade-8eb9-1f722e8731f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:47.965122 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccd229-7c9e-4ade-8eb9-1f722e8731f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:47.966504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccd229-7c9e-4ade-8eb9-1f722e8731f1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:47.977633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 536/1083] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:47.983161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce558cc2-5737-4b86-85c6-626c77b7c880 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:48.080823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce558cc2-5737-4b86-85c6-626c77b7c880 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:48.112979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d5bd8-313a-407c-af05-408fa7706c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:48.113780 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d5bd8-313a-407c-af05-408fa7706c51 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:48.114059 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d5bd8-313a-407c-af05-408fa7706c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:48.114333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d5bd8-313a-407c-af05-408fa7706c51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:48.122558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d5bd8-313a-407c-af05-408fa7706c51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:48.124028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d5bd8-313a-407c-af05-408fa7706c51 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:48.140993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-a26d5bd8-313a-407c-af05-408fa7706c51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 11:56:48.140993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:48.140993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:48.140993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:48.140993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:48.140993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:48.140993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:48.140993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:48.140993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:48.140993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:48.140993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:48.140993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:48.140993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:56:48.140993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:56:48.140993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:56:48.140993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:48.142141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:48.143076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:48.143076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:48.143076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:56:48.143076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:56:48.143076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:56:48.143076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:56:48.143076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:56:48.143076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:56:48.143076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 11:56:48.143076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:48.143076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 548/1084] 10.222.0.73 () {56 vars in 1093 bytes} [Thu May 19 11:56:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:48.147882 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccd229-7c9e-4ade-8eb9-1f722e8731f1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:48.177524 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:48.249976 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccd229-7c9e-4ade-8eb9-1f722e8731f1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:48.283322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80f329-c499-41b4-84c0-d7e042480a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:48.284011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80f329-c499-41b4-84c0-d7e042480a6c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:48.284297 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80f329-c499-41b4-84c0-d7e042480a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:48.284570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80f329-c499-41b4-84c0-d7e042480a6c None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:48.285399 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80f329-c499-41b4-84c0-d7e042480a6c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:48.285706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80f329-c499-41b4-84c0-d7e042480a6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:48.287123 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80f329-c499-41b4-84c0-d7e042480a6c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:48.304350 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 537/1085] 10.222.0.73 () {56 vars in 1133 bytes} [Thu May 19 11:56:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:48.310017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d5bd8-313a-407c-af05-408fa7706c51 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:48.329139 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:48.420060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d5bd8-313a-407c-af05-408fa7706c51 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:48.453316 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dabcc-a0b7-4a47-b3b4-abbc51e68073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:48.453958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dabcc-a0b7-4a47-b3b4-abbc51e68073 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:48.454245 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dabcc-a0b7-4a47-b3b4-abbc51e68073 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:48.454522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dabcc-a0b7-4a47-b3b4-abbc51e68073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:48.519371 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dabcc-a0b7-4a47-b3b4-abbc51e68073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:48.520847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dabcc-a0b7-4a47-b3b4-abbc51e68073 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:48.537427 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:48.621554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 549/1086] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:56:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:56:48.627258 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80f329-c499-41b4-84c0-d7e042480a6c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:48.711989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:48.725239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80f329-c499-41b4-84c0-d7e042480a6c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:48.746658 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995bfb-7b7c-491a-a19d-422aadd8dd09 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:48.746950 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995bfb-7b7c-491a-a19d-422aadd8dd09 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:48.747230 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995bfb-7b7c-491a-a19d-422aadd8dd09 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:48.748652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 550/1087] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:56:48.753565 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847e0e1-e298-4b44-9b2c-fa0551f0a7f8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:48.753856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847e0e1-e298-4b44-9b2c-fa0551f0a7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:48.754135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847e0e1-e298-4b44-9b2c-fa0551f0a7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:48.759083 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007b4fd-cffe-425e-acdc-74e40910adf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:48.759873 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007b4fd-cffe-425e-acdc-74e40910adf3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:48.760203 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007b4fd-cffe-425e-acdc-74e40910adf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:48.760481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007b4fd-cffe-425e-acdc-74e40910adf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:48.770267 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6847e0e1-e298-4b44-9b2c-fa0551f0a7f8 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:48.770465 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007b4fd-cffe-425e-acdc-74e40910adf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:48.771432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6847e0e1-e298-4b44-9b2c-fa0551f0a7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:48.771933 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007b4fd-cffe-425e-acdc-74e40910adf3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:48.789658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e007b4fd-cffe-425e-acdc-74e40910adf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:48.789658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:48.789658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:48.789658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:48.789658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:48.789658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:48.789658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:48.789658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:48.789658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:48.789658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:48.789658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:48.789658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:48.789658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:56:48.789658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:56:48.789658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:56:48.790530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:56:48.790530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:48.790530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:48.790530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:48.790530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:48.790530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:48.790530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:48.790530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:48.790530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:48.790530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:48.790530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:48.790530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:48.790530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:48.790530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:48.790530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:48.790530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:48.790530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:48.791425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:56:48.791425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:56:48.791425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:56:48.791425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:48.791425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 538/1088] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:48.797107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007b4fd-cffe-425e-acdc-74e40910adf3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:48.840188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 551/1089] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:56:48.862802 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847e0e1-e298-4b44-9b2c-fa0551f0a7f8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:48.895200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007b4fd-cffe-425e-acdc-74e40910adf3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:48.907715 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:48.929003 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0927a0-6d08-4163-944c-5ba8b6ef2016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:48.929659 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0927a0-6d08-4163-944c-5ba8b6ef2016 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:48.929942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0927a0-6d08-4163-944c-5ba8b6ef2016 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:48.930217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0927a0-6d08-4163-944c-5ba8b6ef2016 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:48.930941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0927a0-6d08-4163-944c-5ba8b6ef2016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:48.931245 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0927a0-6d08-4163-944c-5ba8b6ef2016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:48.932631 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0927a0-6d08-4163-944c-5ba8b6ef2016 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:48.940679 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:48.948664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 539/1090] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:48.949457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0927a0-6d08-4163-944c-5ba8b6ef2016 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:48.959876 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847e0e1-e298-4b44-9b2c-fa0551f0a7f8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:48.993841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c01a1-d5af-46bd-96d4-d12d77fe7d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:48.994637 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c01a1-d5af-46bd-96d4-d12d77fe7d65 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:48.994922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c01a1-d5af-46bd-96d4-d12d77fe7d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:48.995202 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c01a1-d5af-46bd-96d4-d12d77fe7d65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.005852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c01a1-d5af-46bd-96d4-d12d77fe7d65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:49.013447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-a90c01a1-d5af-46bd-96d4-d12d77fe7d65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:49.013447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:49.013447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:49.013447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:49.013447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:49.013447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:49.013447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:49.013447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:49.013447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:49.013447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:49.013447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:49.013447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:49.013447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:49.013447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:49.013447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:49.013447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:49.014353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:49.014353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:49.014353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:49.014353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:49.014353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:49.014353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:49.014353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:49.014353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:49.014353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:49.014353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:49.014353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:49.014353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:49.014353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:49.014353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:49.014353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:49.014353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:49.015991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:49.015991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:49.015991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:49.015991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:49.015991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:49.015991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:49.015991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:49.015991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:49.015991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:49.015991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:49.015991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:49.015991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:49.015991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 552/1091] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:56:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:56:49.020980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c01a1-d5af-46bd-96d4-d12d77fe7d65 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:49.049401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0927a0-6d08-4163-944c-5ba8b6ef2016 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:49.082821 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cd04d-8aca-4ed3-9383-6339aa2e997b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:49.083532 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cd04d-8aca-4ed3-9383-6339aa2e997b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.083532 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cd04d-8aca-4ed3-9383-6339aa2e997b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.083696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cd04d-8aca-4ed3-9383-6339aa2e997b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.096751 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cd04d-8aca-4ed3-9383-6339aa2e997b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:49.099501 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cd04d-8aca-4ed3-9383-6339aa2e997b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:49.115006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-179cd04d-8aca-4ed3-9383-6339aa2e997b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:49.115006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:49.115006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:49.115006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:49.115006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:49.115006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:49.115006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:49.115006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:49.115006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:49.115006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:49.115006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:49.115006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:49.115006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:56:49.115006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:56:49.115006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:56:49.115904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:56:49.115904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:49.115904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:49.115904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:49.115904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:49.115904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:49.115904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:49.115904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:49.115904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:56:49.115904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:49.115904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:49.115904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:49.115904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:49.115904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:49.115904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:49.115904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:49.115904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:49.116865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:56:49.116865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:56:49.116865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:56:49.116865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:56:49.116865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:56:49.116865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:56:49.116865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:56:49.116865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:56:49.116865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 540/1092] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:56:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:49.121839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cd04d-8aca-4ed3-9383-6339aa2e997b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:49.126167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c01a1-d5af-46bd-96d4-d12d77fe7d65 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:49.133133 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:49.169584 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de68da2-ea18-41cc-ab1d-cfcf1ea44256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:49.170702 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de68da2-ea18-41cc-ab1d-cfcf1ea44256 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.170997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de68da2-ea18-41cc-ab1d-cfcf1ea44256 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.171277 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de68da2-ea18-41cc-ab1d-cfcf1ea44256 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.172312 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de68da2-ea18-41cc-ab1d-cfcf1ea44256 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:49.172625 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de68da2-ea18-41cc-ab1d-cfcf1ea44256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:49.174743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de68da2-ea18-41cc-ab1d-cfcf1ea44256 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:49.185852 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:49.188076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 553/1093] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:56:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:49.192461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de68da2-ea18-41cc-ab1d-cfcf1ea44256 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:49.233025 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cd04d-8aca-4ed3-9383-6339aa2e997b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:49.278602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bbecb-8538-445c-a4a7-22bb2dc764da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:49.279281 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bbecb-8538-445c-a4a7-22bb2dc764da None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.279567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bbecb-8538-445c-a4a7-22bb2dc764da None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.279841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bbecb-8538-445c-a4a7-22bb2dc764da None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.280715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bbecb-8538-445c-a4a7-22bb2dc764da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:49.281035 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bbecb-8538-445c-a4a7-22bb2dc764da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:49.282794 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bbecb-8538-445c-a4a7-22bb2dc764da None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:49.297131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 541/1094] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:56:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:49.302988 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bbecb-8538-445c-a4a7-22bb2dc764da None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:49.313077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de68da2-ea18-41cc-ab1d-cfcf1ea44256 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:49.348538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d70202-c77d-402d-ae01-a47db3245da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:49.349411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d70202-c77d-402d-ae01-a47db3245da0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.349700 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d70202-c77d-402d-ae01-a47db3245da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.349978 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d70202-c77d-402d-ae01-a47db3245da0 None admin] PATH_INFO: `/v3/users/0bb6abf8226a4d73b849b66f7137a6db` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.351182 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d70202-c77d-402d-ae01-a47db3245da0 None admin] RBAC: Authorizing `identity:get_user(user_id=0bb6abf8226a4d73b849b66f7137a6db)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:49.352659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d70202-c77d-402d-ae01-a47db3245da0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:49.354308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 554/1095] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:56:49 2022] GET /identity/v3/users/0bb6abf8226a4d73b849b66f7137a6db => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:49.359828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d70202-c77d-402d-ae01-a47db3245da0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:49.405289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:49.410439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bbecb-8538-445c-a4a7-22bb2dc764da None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:49.431524 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:49.453341 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad22644-3542-408a-b108-397a65fcf504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:49.454220 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad22644-3542-408a-b108-397a65fcf504 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.454513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad22644-3542-408a-b108-397a65fcf504 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.455057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad22644-3542-408a-b108-397a65fcf504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.455627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad22644-3542-408a-b108-397a65fcf504 None admin] RBAC: Adding query filter params (role.id=bcd07251993842dba52e681f3b559dd8, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=bd0c1f0710f3447d94e67048a508781e) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:49.455984 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad22644-3542-408a-b108-397a65fcf504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:49.457424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad22644-3542-408a-b108-397a65fcf504 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:49.468118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 542/1096] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:56:49 2022] GET /identity/v3/role_assignments?user.id=bd0c1f0710f3447d94e67048a508781e&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=bcd07251993842dba52e681f3b559dd8 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:49.477462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d70202-c77d-402d-ae01-a47db3245da0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:49.513825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba741c97-e808-4f14-a66c-5d14165e6204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:49.514787 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba741c97-e808-4f14-a66c-5d14165e6204 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.515072 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba741c97-e808-4f14-a66c-5d14165e6204 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.515351 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba741c97-e808-4f14-a66c-5d14165e6204 None admin] PATH_INFO: `/v3/projects/8a3a1f5f53e6496d8726aacadb28b1a2` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.517141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba741c97-e808-4f14-a66c-5d14165e6204 None admin] RBAC: Authorizing `identity:get_project(project_id=8a3a1f5f53e6496d8726aacadb28b1a2)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:49.518602 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba741c97-e808-4f14-a66c-5d14165e6204 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:49.520605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 555/1097] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:56:49 2022] GET /identity/v3/projects/8a3a1f5f53e6496d8726aacadb28b1a2 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:49.526763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad22644-3542-408a-b108-397a65fcf504 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:49.633852 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad22644-3542-408a-b108-397a65fcf504 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:49.667574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390363bc-396a-4f49-be69-ff1e42866a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:49.668522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390363bc-396a-4f49-be69-ff1e42866a11 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:49.668800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390363bc-396a-4f49-be69-ff1e42866a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:49.669073 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390363bc-396a-4f49-be69-ff1e42866a11 None admin] PATH_INFO: `/v3/projects/8a3a1f5f53e6496d8726aacadb28b1a2/users/0bb6abf8226a4d73b849b66f7137a6db/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:49.671807 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390363bc-396a-4f49-be69-ff1e42866a11 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a3a1f5f53e6496d8726aacadb28b1a2, user_id=0bb6abf8226a4d73b849b66f7137a6db, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:49.673269 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390363bc-396a-4f49-be69-ff1e42866a11 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:49.687614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 543/1098] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:56:49 2022] PUT /identity/v3/projects/8a3a1f5f53e6496d8726aacadb28b1a2/users/0bb6abf8226a4d73b849b66f7137a6db/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:56:51.860814 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce074d5-d7be-468f-ad7c-9ae59689cc9b None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:51.861388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce074d5-d7be-468f-ad7c-9ae59689cc9b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:51.861388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce074d5-d7be-468f-ad7c-9ae59689cc9b None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:51.862750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 556/1099] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:51.867933 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f067cf-11de-4012-8fe7-160856b45735 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:51.868319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f067cf-11de-4012-8fe7-160856b45735 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:51.868495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f067cf-11de-4012-8fe7-160856b45735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:51.884971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-19f067cf-11de-4012-8fe7-160856b45735 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:51.886135 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-19f067cf-11de-4012-8fe7-160856b45735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:51.925816 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:51.952668 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 544/1100] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:51.975707 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce074d5-d7be-468f-ad7c-9ae59689cc9b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:52.073080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce074d5-d7be-468f-ad7c-9ae59689cc9b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:52.075288 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:52.106457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7262e-f583-42f4-90f7-8af1c287aef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:52.107229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7262e-f583-42f4-90f7-8af1c287aef4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:52.107510 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7262e-f583-42f4-90f7-8af1c287aef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:52.107785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7262e-f583-42f4-90f7-8af1c287aef4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:52.118005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7262e-f583-42f4-90f7-8af1c287aef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:56:52.125382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-75c7262e-f583-42f4-90f7-8af1c287aef4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:52.125382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:56:52.125382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:56:52.125382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:56:52.125382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:56:52.125382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:56:52.125382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:56:52.125382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:56:52.125382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:56:52.125382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:56:52.125382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:56:52.125382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:56:52.125382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:56:52.125382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:56:52.125382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:56:52.125382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:56:52.126555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:56:52.126555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:56:52.126555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:56:52.126555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:56:52.126555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:56:52.126555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:56:52.126555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:56:52.126555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:56:52.126555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:56:52.126555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:56:52.126555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:56:52.126555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:56:52.126555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:56:52.126555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:56:52.126555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:56:52.126555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:56:52.127695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:56:52.127695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:56:52.127695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:56:52.127695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:56:52.127695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:56:52.127695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:56:52.127695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:56:52.127695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:56:52.127695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:56:52.127695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:56:52.127695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:56:52.127695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:56:52.127695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 557/1101] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:56:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:56:52.132340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f067cf-11de-4012-8fe7-160856b45735 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:52.228841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f067cf-11de-4012-8fe7-160856b45735 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:52.261354 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ab268-d8cc-4c3c-9fb2-e09b073ef8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:52.262005 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ab268-d8cc-4c3c-9fb2-e09b073ef8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:52.262289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ab268-d8cc-4c3c-9fb2-e09b073ef8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:52.262565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ab268-d8cc-4c3c-9fb2-e09b073ef8a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:52.263306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ab268-d8cc-4c3c-9fb2-e09b073ef8a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:52.263614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ab268-d8cc-4c3c-9fb2-e09b073ef8a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:52.265542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ab268-d8cc-4c3c-9fb2-e09b073ef8a4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:52.273305 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 545/1102] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:56:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:52.278846 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7262e-f583-42f4-90f7-8af1c287aef4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:52.375065 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7262e-f583-42f4-90f7-8af1c287aef4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:52.408125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2d67c-82f2-4ada-b711-11159217b240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:52.409009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2d67c-82f2-4ada-b711-11159217b240 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:52.409290 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2d67c-82f2-4ada-b711-11159217b240 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:52.409565 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2d67c-82f2-4ada-b711-11159217b240 None admin] PATH_INFO: `/v3/users/0bb6abf8226a4d73b849b66f7137a6db` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:52.410746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2d67c-82f2-4ada-b711-11159217b240 None admin] RBAC: Authorizing `identity:get_user(user_id=0bb6abf8226a4d73b849b66f7137a6db)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:52.412191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2d67c-82f2-4ada-b711-11159217b240 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:52.413844 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 558/1103] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:56:52 2022] GET /identity/v3/users/0bb6abf8226a4d73b849b66f7137a6db => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:52.419406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ab268-d8cc-4c3c-9fb2-e09b073ef8a4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:52.454700 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:52.516517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ab268-d8cc-4c3c-9fb2-e09b073ef8a4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:52.548914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b250fcd-60f3-4290-b67f-a89d461a8bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:52.549539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b250fcd-60f3-4290-b67f-a89d461a8bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:52.549821 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b250fcd-60f3-4290-b67f-a89d461a8bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:52.550096 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b250fcd-60f3-4290-b67f-a89d461a8bb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:52.613433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b250fcd-60f3-4290-b67f-a89d461a8bb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:52.614856 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b250fcd-60f3-4290-b67f-a89d461a8bb1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:52.646378 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:52.707798 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 546/1104] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:56:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:56:52.713542 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2d67c-82f2-4ada-b711-11159217b240 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:52.743762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:52.810689 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2d67c-82f2-4ada-b711-11159217b240 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:52.843645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13687a-97d0-4252-b557-602cf8e6d8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:52.844515 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13687a-97d0-4252-b557-602cf8e6d8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:52.844799 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13687a-97d0-4252-b557-602cf8e6d8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:52.845074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13687a-97d0-4252-b557-602cf8e6d8c6 None admin] PATH_INFO: `/v3/projects/8a3a1f5f53e6496d8726aacadb28b1a2` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:52.846248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13687a-97d0-4252-b557-602cf8e6d8c6 None admin] RBAC: Authorizing `identity:get_project(project_id=8a3a1f5f53e6496d8726aacadb28b1a2)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:52.847659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13687a-97d0-4252-b557-602cf8e6d8c6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:52.849367 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 559/1105] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:56:52 2022] GET /identity/v3/projects/8a3a1f5f53e6496d8726aacadb28b1a2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:52.855363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b250fcd-60f3-4290-b67f-a89d461a8bb1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:52.953561 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b250fcd-60f3-4290-b67f-a89d461a8bb1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:52.985785 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6f1d0-102c-44df-bf1e-ec21500d70d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:52.986434 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6f1d0-102c-44df-bf1e-ec21500d70d4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:52.986717 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6f1d0-102c-44df-bf1e-ec21500d70d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:52.986992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6f1d0-102c-44df-bf1e-ec21500d70d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:52.987816 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6f1d0-102c-44df-bf1e-ec21500d70d4 None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=8a3a1f5f53e6496d8726aacadb28b1a2, user.id=0bb6abf8226a4d73b849b66f7137a6db) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:52.988160 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6f1d0-102c-44df-bf1e-ec21500d70d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:52.989579 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6f1d0-102c-44df-bf1e-ec21500d70d4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:52.992418 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:52.995782 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 547/1106] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:56:52 2022] GET /identity/v3/role_assignments?user.id=0bb6abf8226a4d73b849b66f7137a6db&scope.project.id=8a3a1f5f53e6496d8726aacadb28b1a2&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:55.189942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722ac4f-f841-47e3-8457-094468ed47f8 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:55.190492 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722ac4f-f841-47e3-8457-094468ed47f8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:55.190492 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722ac4f-f841-47e3-8457-094468ed47f8 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:55.191845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 560/1107] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:55.197122 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f3938-18c2-40e0-9f59-d47dc8c71992 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:55.197512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f3938-18c2-40e0-9f59-d47dc8c71992 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:55.197677 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f3938-18c2-40e0-9f59-d47dc8c71992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:55.213982 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-841f3938-18c2-40e0-9f59-d47dc8c71992 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:55.215141 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-841f3938-18c2-40e0-9f59-d47dc8c71992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:55.278031 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 548/1108] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:55.302653 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722ac4f-f841-47e3-8457-094468ed47f8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:55.400429 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:55.404679 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722ac4f-f841-47e3-8457-094468ed47f8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:55.438984 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c202f-9c1d-4069-98f4-bc8932010291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:55.439753 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c202f-9c1d-4069-98f4-bc8932010291 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:55.440117 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c202f-9c1d-4069-98f4-bc8932010291 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:55.440348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c202f-9c1d-4069-98f4-bc8932010291 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:55.441506 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c202f-9c1d-4069-98f4-bc8932010291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:55.442916 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c202f-9c1d-4069-98f4-bc8932010291 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:55.444526 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 561/1109] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:56:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:55.450160 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f3938-18c2-40e0-9f59-d47dc8c71992 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:55.545062 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f3938-18c2-40e0-9f59-d47dc8c71992 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:55.572478 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:55.579257 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea18f53-10ab-4b4b-befd-94249d9aa9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:55.579931 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea18f53-10ab-4b4b-befd-94249d9aa9b0 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:55.580225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea18f53-10ab-4b4b-befd-94249d9aa9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:55.580500 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea18f53-10ab-4b4b-befd-94249d9aa9b0 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:55.581195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea18f53-10ab-4b4b-befd-94249d9aa9b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:55.582607 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea18f53-10ab-4b4b-befd-94249d9aa9b0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:55.601829 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 549/1110] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:56:55 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:56:57.828482 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facc3d1-d0ba-4e4b-a6a7-a7afbb8b0082 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:57.829013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facc3d1-d0ba-4e4b-a6a7-a7afbb8b0082 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:57.829119 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facc3d1-d0ba-4e4b-a6a7-a7afbb8b0082 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:57.830438 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 562/1111] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:56:57.835584 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b7405-7429-420a-ab6f-cd022b117aca None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:57.835977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b7405-7429-420a-ab6f-cd022b117aca None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:57.836184 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b7405-7429-420a-ab6f-cd022b117aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:57.852568 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-499b7405-7429-420a-ab6f-cd022b117aca None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:56:57.853747 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-499b7405-7429-420a-ab6f-cd022b117aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:56:57.918713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 550/1112] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:56:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:56:57.943204 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facc3d1-d0ba-4e4b-a6a7-a7afbb8b0082 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:58.047978 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facc3d1-d0ba-4e4b-a6a7-a7afbb8b0082 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:58.080848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da10724-e2b9-4e22-ba83-a03dc29d621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:58.081645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da10724-e2b9-4e22-ba83-a03dc29d621b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:58.081927 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da10724-e2b9-4e22-ba83-a03dc29d621b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:58.082203 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da10724-e2b9-4e22-ba83-a03dc29d621b None admin] PATH_INFO: `/v3/roles/a1fb3b01c7424cf18f71b9a2b8333f03` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:58.083643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da10724-e2b9-4e22-ba83-a03dc29d621b None admin] RBAC: Authorizing `identity:get_role(role_id=a1fb3b01c7424cf18f71b9a2b8333f03)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:58.085038 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da10724-e2b9-4e22-ba83-a03dc29d621b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:58.086405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 563/1113] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:56:57 2022] GET /identity/v3/roles/a1fb3b01c7424cf18f71b9a2b8333f03 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:58.092170 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b7405-7429-420a-ab6f-cd022b117aca None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:58.188216 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b7405-7429-420a-ab6f-cd022b117aca None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:58.205316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:58.226518 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52910701-3675-4f9c-9799-bbb84c384eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:58.227390 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52910701-3675-4f9c-9799-bbb84c384eee None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:58.227671 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52910701-3675-4f9c-9799-bbb84c384eee None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:58.227973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52910701-3675-4f9c-9799-bbb84c384eee None admin] PATH_INFO: `/v3/users/e694497450e94e4a935e05baaca8f749` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:58.241425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52910701-3675-4f9c-9799-bbb84c384eee None admin] RBAC: Authorizing `identity:get_user(user_id=e694497450e94e4a935e05baaca8f749)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:58.242875 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52910701-3675-4f9c-9799-bbb84c384eee None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:58.244555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 551/1114] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:56:58 2022] GET /identity/v3/users/e694497450e94e4a935e05baaca8f749 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:56:58.250285 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da10724-e2b9-4e22-ba83-a03dc29d621b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:58.284410 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:58.361848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da10724-e2b9-4e22-ba83-a03dc29d621b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:58.395780 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0356ed7-565a-4f5d-8791-bfed31b7df60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:58.396462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0356ed7-565a-4f5d-8791-bfed31b7df60 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:58.396747 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0356ed7-565a-4f5d-8791-bfed31b7df60 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:58.397024 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0356ed7-565a-4f5d-8791-bfed31b7df60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:58.474767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0356ed7-565a-4f5d-8791-bfed31b7df60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:58.476893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0356ed7-565a-4f5d-8791-bfed31b7df60 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:58.512614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:58.579058 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 564/1115] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:56:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:56:58.585149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52910701-3675-4f9c-9799-bbb84c384eee None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:58.684157 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52910701-3675-4f9c-9799-bbb84c384eee None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:58.718125 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a683ff-63be-471a-b390-60e955053f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:58.719064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a683ff-63be-471a-b390-60e955053f29 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:58.719347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a683ff-63be-471a-b390-60e955053f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:58.719619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a683ff-63be-471a-b390-60e955053f29 None admin] PATH_INFO: `/v3/projects/8a3a1f5f53e6496d8726aacadb28b1a2` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:58.720812 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a683ff-63be-471a-b390-60e955053f29 None admin] RBAC: Authorizing `identity:get_project(project_id=8a3a1f5f53e6496d8726aacadb28b1a2)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:58.722229 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a683ff-63be-471a-b390-60e955053f29 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:58.724041 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 552/1116] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:56:58 2022] GET /identity/v3/projects/8a3a1f5f53e6496d8726aacadb28b1a2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:56:58.730112 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0356ed7-565a-4f5d-8791-bfed31b7df60 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:56:58.827277 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0356ed7-565a-4f5d-8791-bfed31b7df60 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:56:58.860500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39efec1-83c9-46ba-af4b-b3e51046c2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:56:58.861150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39efec1-83c9-46ba-af4b-b3e51046c2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:56:58.861413 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39efec1-83c9-46ba-af4b-b3e51046c2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:56:58.861688 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39efec1-83c9-46ba-af4b-b3e51046c2b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:56:58.862651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39efec1-83c9-46ba-af4b-b3e51046c2b6 None admin] RBAC: Adding query filter params (role.id=a1fb3b01c7424cf18f71b9a2b8333f03, scope.project.id=8a3a1f5f53e6496d8726aacadb28b1a2, user.id=e694497450e94e4a935e05baaca8f749) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:56:58.862967 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39efec1-83c9-46ba-af4b-b3e51046c2b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:56:58.864404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39efec1-83c9-46ba-af4b-b3e51046c2b6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:56:58.867328 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:56:58.870489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 565/1117] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:56:58 2022] GET /identity/v3/role_assignments?user.id=e694497450e94e4a935e05baaca8f749&scope.project.id=8a3a1f5f53e6496d8726aacadb28b1a2&role.id=a1fb3b01c7424cf18f71b9a2b8333f03 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:01.021523 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaf9ed-710a-434e-b964-6892c4ec1428 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.022075 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaf9ed-710a-434e-b964-6892c4ec1428 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.022075 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaf9ed-710a-434e-b964-6892c4ec1428 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.023438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 553/1118] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:01.028478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cba64-6791-4bab-8acc-e9de6b9bc618 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.028893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cba64-6791-4bab-8acc-e9de6b9bc618 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.029043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cba64-6791-4bab-8acc-e9de6b9bc618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.046484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ca2cba64-6791-4bab-8acc-e9de6b9bc618 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:01.047661 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ca2cba64-6791-4bab-8acc-e9de6b9bc618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:01.111564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 566/1119] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:57:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:57:01.133824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaf9ed-710a-434e-b964-6892c4ec1428 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:01.178275 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:01.242294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaf9ed-710a-434e-b964-6892c4ec1428 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:01.275424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d9011-38a5-4394-ae93-8cd5b910146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:01.276238 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d9011-38a5-4394-ae93-8cd5b910146d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.276520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d9011-38a5-4394-ae93-8cd5b910146d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.276793 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d9011-38a5-4394-ae93-8cd5b910146d None admin] PATH_INFO: `/v3/roles/a1fb3b01c7424cf18f71b9a2b8333f03` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.278250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d9011-38a5-4394-ae93-8cd5b910146d None admin] RBAC: Authorizing `identity:get_role(role_id=a1fb3b01c7424cf18f71b9a2b8333f03)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:01.279615 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d9011-38a5-4394-ae93-8cd5b910146d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:01.281510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 554/1120] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:57:01 2022] GET /identity/v3/roles/a1fb3b01c7424cf18f71b9a2b8333f03 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:01.287274 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cba64-6791-4bab-8acc-e9de6b9bc618 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:01.383135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cba64-6791-4bab-8acc-e9de6b9bc618 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:01.410701 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:01.416810 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8856ac1-7094-4d68-8469-63db7d1ae84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:01.417690 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8856ac1-7094-4d68-8469-63db7d1ae84c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.417975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8856ac1-7094-4d68-8469-63db7d1ae84c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.418255 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8856ac1-7094-4d68-8469-63db7d1ae84c None admin] PATH_INFO: `/v3/users/e694497450e94e4a935e05baaca8f749` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.419434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8856ac1-7094-4d68-8469-63db7d1ae84c None admin] RBAC: Authorizing `identity:get_user(user_id=e694497450e94e4a935e05baaca8f749)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:01.421757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8856ac1-7094-4d68-8469-63db7d1ae84c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:01.423385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 567/1121] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:57:01 2022] GET /identity/v3/users/e694497450e94e4a935e05baaca8f749 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:01.429183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d9011-38a5-4394-ae93-8cd5b910146d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:01.524349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d9011-38a5-4394-ae93-8cd5b910146d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:01.535362 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:01.563241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15504be7-ba29-477d-ac7c-5b54dbefc9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:01.564112 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15504be7-ba29-477d-ac7c-5b54dbefc9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.564396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15504be7-ba29-477d-ac7c-5b54dbefc9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.564672 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15504be7-ba29-477d-ac7c-5b54dbefc9e3 None admin] PATH_INFO: `/v3/projects/8a3a1f5f53e6496d8726aacadb28b1a2` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.565833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15504be7-ba29-477d-ac7c-5b54dbefc9e3 None admin] RBAC: Authorizing `identity:get_project(project_id=8a3a1f5f53e6496d8726aacadb28b1a2)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:01.567259 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15504be7-ba29-477d-ac7c-5b54dbefc9e3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:01.568964 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 555/1122] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:57:01 2022] GET /identity/v3/projects/8a3a1f5f53e6496d8726aacadb28b1a2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:01.574721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8856ac1-7094-4d68-8469-63db7d1ae84c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:01.671124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8856ac1-7094-4d68-8469-63db7d1ae84c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:01.703488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8766af-0a94-48d0-a039-bb45ef9ffbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:01.704390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8766af-0a94-48d0-a039-bb45ef9ffbab None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:01.704675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8766af-0a94-48d0-a039-bb45ef9ffbab None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:01.704955 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8766af-0a94-48d0-a039-bb45ef9ffbab None admin] PATH_INFO: `/v3/projects/8a3a1f5f53e6496d8726aacadb28b1a2/users/e694497450e94e4a935e05baaca8f749/roles/a1fb3b01c7424cf18f71b9a2b8333f03` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:01.707144 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8766af-0a94-48d0-a039-bb45ef9ffbab None admin] RBAC: Authorizing `identity:create_grant(project_id=8a3a1f5f53e6496d8726aacadb28b1a2, user_id=e694497450e94e4a935e05baaca8f749, role_id=a1fb3b01c7424cf18f71b9a2b8333f03)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:01.708597 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8766af-0a94-48d0-a039-bb45ef9ffbab None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:01.721371 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 568/1123] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:57:01 2022] PUT /identity/v3/projects/8a3a1f5f53e6496d8726aacadb28b1a2/users/e694497450e94e4a935e05baaca8f749/roles/a1fb3b01c7424cf18f71b9a2b8333f03 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:57:03.888111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee184c-4a3b-4150-a3e6-1db711cd1a05 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:03.888650 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee184c-4a3b-4150-a3e6-1db711cd1a05 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:03.888650 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee184c-4a3b-4150-a3e6-1db711cd1a05 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:03.890036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 556/1124] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:03.895358 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c551349-d318-438e-965c-7b677841acbe None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:03.895758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c551349-d318-438e-965c-7b677841acbe None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:03.895940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c551349-d318-438e-965c-7b677841acbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:03.912252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0c551349-d318-438e-965c-7b677841acbe None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:03.913433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0c551349-d318-438e-965c-7b677841acbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:03.964918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:03.978872 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 569/1125] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:57:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:57:04.002816 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee184c-4a3b-4150-a3e6-1db711cd1a05 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:04.100648 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee184c-4a3b-4150-a3e6-1db711cd1a05 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:04.132874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c0938-134c-4ef7-bf1a-5a8ebca4c484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:04.133718 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c0938-134c-4ef7-bf1a-5a8ebca4c484 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.134001 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c0938-134c-4ef7-bf1a-5a8ebca4c484 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.134275 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c0938-134c-4ef7-bf1a-5a8ebca4c484 None admin] PATH_INFO: `/v3/roles/a1fb3b01c7424cf18f71b9a2b8333f03` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.135728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c0938-134c-4ef7-bf1a-5a8ebca4c484 None admin] RBAC: Authorizing `identity:get_role(role_id=a1fb3b01c7424cf18f71b9a2b8333f03)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:04.137130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c0938-134c-4ef7-bf1a-5a8ebca4c484 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:04.138521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 557/1126] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:57:04 2022] GET /identity/v3/roles/a1fb3b01c7424cf18f71b9a2b8333f03 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:04.144535 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c551349-d318-438e-965c-7b677841acbe None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:04.239708 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c551349-d318-438e-965c-7b677841acbe None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:04.272665 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce5eb3-65b3-4f44-9ac4-81a539c2cec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:04.273522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce5eb3-65b3-4f44-9ac4-81a539c2cec9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.273805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce5eb3-65b3-4f44-9ac4-81a539c2cec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.274081 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce5eb3-65b3-4f44-9ac4-81a539c2cec9 None admin] PATH_INFO: `/v3/users/e694497450e94e4a935e05baaca8f749` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.275247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce5eb3-65b3-4f44-9ac4-81a539c2cec9 None admin] RBAC: Authorizing `identity:get_user(user_id=e694497450e94e4a935e05baaca8f749)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:04.276687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce5eb3-65b3-4f44-9ac4-81a539c2cec9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:04.278287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 570/1127] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:57:04 2022] GET /identity/v3/users/e694497450e94e4a935e05baaca8f749 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:04.283667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c0938-134c-4ef7-bf1a-5a8ebca4c484 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:04.329540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:04.381197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c0938-134c-4ef7-bf1a-5a8ebca4c484 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:04.414037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65086b44-0761-4433-bacb-e240af39556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:04.414619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65086b44-0761-4433-bacb-e240af39556f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.414903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65086b44-0761-4433-bacb-e240af39556f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.415180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65086b44-0761-4433-bacb-e240af39556f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.479901 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65086b44-0761-4433-bacb-e240af39556f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:04.481386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65086b44-0761-4433-bacb-e240af39556f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:04.524349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:04.576391 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 558/1128] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:57:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:57:04.582710 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce5eb3-65b3-4f44-9ac4-81a539c2cec9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:04.636339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:04.680782 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce5eb3-65b3-4f44-9ac4-81a539c2cec9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:04.714236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3437b-2717-49ff-b1ab-44b1a91894dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:04.715085 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3437b-2717-49ff-b1ab-44b1a91894dc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.715366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3437b-2717-49ff-b1ab-44b1a91894dc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.715640 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3437b-2717-49ff-b1ab-44b1a91894dc None admin] PATH_INFO: `/v3/projects/8a3a1f5f53e6496d8726aacadb28b1a2` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.716827 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3437b-2717-49ff-b1ab-44b1a91894dc None admin] RBAC: Authorizing `identity:get_project(project_id=8a3a1f5f53e6496d8726aacadb28b1a2)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:04.718910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3437b-2717-49ff-b1ab-44b1a91894dc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:04.720621 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 571/1129] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:57:04 2022] GET /identity/v3/projects/8a3a1f5f53e6496d8726aacadb28b1a2 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:04.726685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65086b44-0761-4433-bacb-e240af39556f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:04.820466 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65086b44-0761-4433-bacb-e240af39556f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:04.854601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e5d02-b6fc-4977-8658-5029844d35f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:04.855244 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e5d02-b6fc-4977-8658-5029844d35f9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:04.855526 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e5d02-b6fc-4977-8658-5029844d35f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:04.855803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e5d02-b6fc-4977-8658-5029844d35f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:04.856662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e5d02-b6fc-4977-8658-5029844d35f9 None admin] RBAC: Adding query filter params (role.id=a1fb3b01c7424cf18f71b9a2b8333f03, scope.project.id=8a3a1f5f53e6496d8726aacadb28b1a2, user.id=e694497450e94e4a935e05baaca8f749) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:04.856979 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e5d02-b6fc-4977-8658-5029844d35f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:04.858428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e5d02-b6fc-4977-8658-5029844d35f9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:04.864087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 559/1130] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:57:04 2022] GET /identity/v3/role_assignments?user.id=e694497450e94e4a935e05baaca8f749&scope.project.id=8a3a1f5f53e6496d8726aacadb28b1a2&role.id=a1fb3b01c7424cf18f71b9a2b8333f03 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:07.057315 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234be488-6fb9-452a-81fc-13ebb214aeec None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:07.057845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234be488-6fb9-452a-81fc-13ebb214aeec None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:07.057955 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234be488-6fb9-452a-81fc-13ebb214aeec None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:07.059244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 572/1131] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:07.064493 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab9c45-23d6-433e-99d9-733353f3759f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:07.064880 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab9c45-23d6-433e-99d9-733353f3759f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:07.065041 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab9c45-23d6-433e-99d9-733353f3759f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:07.081805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c7ab9c45-23d6-433e-99d9-733353f3759f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:07.082965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c7ab9c45-23d6-433e-99d9-733353f3759f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:07.085622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:07.146907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 560/1132] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:57:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:57:07.170099 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234be488-6fb9-452a-81fc-13ebb214aeec None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:07.277408 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234be488-6fb9-452a-81fc-13ebb214aeec None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:07.300291 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:07.311980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3ab73-0967-4b39-ad72-3c180dfe73cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:07.312778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3ab73-0967-4b39-ad72-3c180dfe73cf None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:07.313066 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3ab73-0967-4b39-ad72-3c180dfe73cf None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:07.313346 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3ab73-0967-4b39-ad72-3c180dfe73cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:07.314534 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3ab73-0967-4b39-ad72-3c180dfe73cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:07.315981 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3ab73-0967-4b39-ad72-3c180dfe73cf None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:07.317603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 573/1133] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:57:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:07.323382 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab9c45-23d6-433e-99d9-733353f3759f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:07.419129 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab9c45-23d6-433e-99d9-733353f3759f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:07.452438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778a04e-3d62-43ab-b69b-64c14cd6fbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:07.453084 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778a04e-3d62-43ab-b69b-64c14cd6fbf0 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:07.453364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778a04e-3d62-43ab-b69b-64c14cd6fbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:07.453635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778a04e-3d62-43ab-b69b-64c14cd6fbf0 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:07.454349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778a04e-3d62-43ab-b69b-64c14cd6fbf0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:07.455756 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778a04e-3d62-43ab-b69b-64c14cd6fbf0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:07.465016 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:07.480514 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 561/1134] 10.222.0.73 () {60 vars in 1141 bytes} [Thu May 19 11:57:07 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:57:09.723500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649e45e-927e-4be5-8343-ba1ce7b42559 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:09.724071 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649e45e-927e-4be5-8343-ba1ce7b42559 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:09.724071 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649e45e-927e-4be5-8343-ba1ce7b42559 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:09.725373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 574/1135] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:09.730935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62077ee8-134c-4327-9394-7ead1e2627c6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:09.731358 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62077ee8-134c-4327-9394-7ead1e2627c6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:09.731492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62077ee8-134c-4327-9394-7ead1e2627c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:09.748448 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-62077ee8-134c-4327-9394-7ead1e2627c6 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:09.749606 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-62077ee8-134c-4327-9394-7ead1e2627c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:09.813053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 562/1136] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:57:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:57:09.837322 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649e45e-927e-4be5-8343-ba1ce7b42559 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:09.937036 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649e45e-927e-4be5-8343-ba1ce7b42559 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:09.969788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68139d5-bb8c-4a03-a8c4-cfbedacd1ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:09.970564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68139d5-bb8c-4a03-a8c4-cfbedacd1ead None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:09.970849 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68139d5-bb8c-4a03-a8c4-cfbedacd1ead None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:09.971129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68139d5-bb8c-4a03-a8c4-cfbedacd1ead None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:09.972320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68139d5-bb8c-4a03-a8c4-cfbedacd1ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:09.973787 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68139d5-bb8c-4a03-a8c4-cfbedacd1ead None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:09.975330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 575/1137] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:57:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:09.980952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62077ee8-134c-4327-9394-7ead1e2627c6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:10.074281 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62077ee8-134c-4327-9394-7ead1e2627c6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:10.096497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:10.108349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf7515-27fb-4a34-b761-78e7bf481c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:10.109007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf7515-27fb-4a34-b761-78e7bf481c94 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:10.109288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf7515-27fb-4a34-b761-78e7bf481c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:10.109560 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf7515-27fb-4a34-b761-78e7bf481c94 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:10.110261 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf7515-27fb-4a34-b761-78e7bf481c94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:10.111680 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf7515-27fb-4a34-b761-78e7bf481c94 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:10.130677 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 563/1138] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:57:09 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:57:12.347688 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95405db8-4283-4fab-a536-720b1e0a5371 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.348257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95405db8-4283-4fab-a536-720b1e0a5371 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.348257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95405db8-4283-4fab-a536-720b1e0a5371 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.349654 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 576/1139] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:12.354966 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b7954-025d-4082-81c2-538f441c04da None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.355364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b7954-025d-4082-81c2-538f441c04da None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.355535 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b7954-025d-4082-81c2-538f441c04da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.372640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-519b7954-025d-4082-81c2-538f441c04da None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:12.374375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-519b7954-025d-4082-81c2-538f441c04da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:12.439045 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 564/1140] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:57:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:57:12.461761 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95405db8-4283-4fab-a536-720b1e0a5371 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:12.520009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:12.560443 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95405db8-4283-4fab-a536-720b1e0a5371 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:12.592916 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350d832-0904-4af1-b1f3-53ee59a83c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:12.593683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350d832-0904-4af1-b1f3-53ee59a83c06 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.593964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350d832-0904-4af1-b1f3-53ee59a83c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.594241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350d832-0904-4af1-b1f3-53ee59a83c06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.604095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350d832-0904-4af1-b1f3-53ee59a83c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:12.612120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b350d832-0904-4af1-b1f3-53ee59a83c06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:12.612120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:12.612120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:12.612120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:12.612120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:12.612120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:12.612120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:12.612120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:12.612120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:12.612120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:12.612120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:12.612120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:12.612120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:12.612120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:12.612120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:12.612120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:12.613215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:12.613215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:12.613215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:12.613215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:12.613215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:12.613215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:12.613215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:12.613215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:12.613215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:12.613215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:12.613215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:12.613215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:57:12.613215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:12.613215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:12.613215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:12.613215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:12.614420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:12.614420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:12.614420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:12.614420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:12.614420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:12.614420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:12.614420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:12.614420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:12.614420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:12.614420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:12.614420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:12.614420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:57:12.614420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 577/1141] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:57:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:12.619122 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b7954-025d-4082-81c2-538f441c04da None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:12.713144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b7954-025d-4082-81c2-538f441c04da None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:12.723101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:12.748529 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0ad7a-d049-46c2-bb5b-5f062229d1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:12.749182 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0ad7a-d049-46c2-bb5b-5f062229d1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.749466 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0ad7a-d049-46c2-bb5b-5f062229d1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.749737 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0ad7a-d049-46c2-bb5b-5f062229d1a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.750476 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0ad7a-d049-46c2-bb5b-5f062229d1a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:12.750783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0ad7a-d049-46c2-bb5b-5f062229d1a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:12.752167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0ad7a-d049-46c2-bb5b-5f062229d1a1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:12.759910 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 565/1142] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:57:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:12.765647 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350d832-0904-4af1-b1f3-53ee59a83c06 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:12.862759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350d832-0904-4af1-b1f3-53ee59a83c06 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:12.881469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:12.895688 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d4cd8-76a6-43d4-85e4-bdf16a4954d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:12.896571 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d4cd8-76a6-43d4-85e4-bdf16a4954d0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:12.896859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d4cd8-76a6-43d4-85e4-bdf16a4954d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:12.897140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d4cd8-76a6-43d4-85e4-bdf16a4954d0 None admin] PATH_INFO: `/v3/users/1b2ce1f4c3f94a5bb185272dc4cedb1b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:12.910328 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d4cd8-76a6-43d4-85e4-bdf16a4954d0 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2ce1f4c3f94a5bb185272dc4cedb1b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:12.911767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d4cd8-76a6-43d4-85e4-bdf16a4954d0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:12.913412 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 578/1143] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:57:12 2022] GET /identity/v3/users/1b2ce1f4c3f94a5bb185272dc4cedb1b => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:12.918942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0ad7a-d049-46c2-bb5b-5f062229d1a1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:13.017920 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0ad7a-d049-46c2-bb5b-5f062229d1a1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:13.051196 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac06db4-b1f3-4d7c-860c-ca8a1db507ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:13.051822 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac06db4-b1f3-4d7c-860c-ca8a1db507ff None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:13.052276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac06db4-b1f3-4d7c-860c-ca8a1db507ff None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:13.052556 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac06db4-b1f3-4d7c-860c-ca8a1db507ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:13.089435 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:13.118522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac06db4-b1f3-4d7c-860c-ca8a1db507ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:13.120060 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac06db4-b1f3-4d7c-860c-ca8a1db507ff None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:13.215653 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 566/1144] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:57:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:57:13.221594 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d4cd8-76a6-43d4-85e4-bdf16a4954d0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:13.317528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d4cd8-76a6-43d4-85e4-bdf16a4954d0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:13.355835 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e06354-32c8-438f-a997-afc5130a4f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:13.357382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e06354-32c8-438f-a997-afc5130a4f81 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:13.357914 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e06354-32c8-438f-a997-afc5130a4f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:13.358427 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e06354-32c8-438f-a997-afc5130a4f81 None admin] PATH_INFO: `/v3/projects/59d103467dc24ce1b79fcad27b5fae09` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:13.360599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e06354-32c8-438f-a997-afc5130a4f81 None admin] RBAC: Authorizing `identity:get_project(project_id=59d103467dc24ce1b79fcad27b5fae09)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:13.363369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e06354-32c8-438f-a997-afc5130a4f81 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:13.366510 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 579/1145] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:57:13 2022] GET /identity/v3/projects/59d103467dc24ce1b79fcad27b5fae09 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:13.372652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac06db4-b1f3-4d7c-860c-ca8a1db507ff None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:13.440007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:13.474074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac06db4-b1f3-4d7c-860c-ca8a1db507ff None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:13.516351 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfa1a1-79c0-4118-a8b4-feb8604be5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:13.517276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfa1a1-79c0-4118-a8b4-feb8604be5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:13.517560 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfa1a1-79c0-4118-a8b4-feb8604be5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:13.517838 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfa1a1-79c0-4118-a8b4-feb8604be5b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:13.518662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfa1a1-79c0-4118-a8b4-feb8604be5b5 None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=59d103467dc24ce1b79fcad27b5fae09, user.id=1b2ce1f4c3f94a5bb185272dc4cedb1b) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:13.518975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfa1a1-79c0-4118-a8b4-feb8604be5b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:13.520428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfa1a1-79c0-4118-a8b4-feb8604be5b5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:13.525757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 567/1146] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:57:13 2022] GET /identity/v3/role_assignments?user.id=1b2ce1f4c3f94a5bb185272dc4cedb1b&scope.project.id=59d103467dc24ce1b79fcad27b5fae09&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:15.684376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce5c64-4d54-4999-8edf-8d8cbf62505b None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:15.684884 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce5c64-4d54-4999-8edf-8d8cbf62505b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:15.684884 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce5c64-4d54-4999-8edf-8d8cbf62505b None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:15.686698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 580/1147] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:15.691757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54dd04-00e7-4304-bbce-d38fe514aa9e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:15.692172 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54dd04-00e7-4304-bbce-d38fe514aa9e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:15.692361 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54dd04-00e7-4304-bbce-d38fe514aa9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:15.709270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8f54dd04-00e7-4304-bbce-d38fe514aa9e None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:15.710452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8f54dd04-00e7-4304-bbce-d38fe514aa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:15.774560 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 568/1148] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:57:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:57:15.797352 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce5c64-4d54-4999-8edf-8d8cbf62505b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:15.843009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:15.894080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce5c64-4d54-4999-8edf-8d8cbf62505b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:15.926515 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b79320-e6bf-4cbe-8795-f6c24b44a10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:15.927281 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b79320-e6bf-4cbe-8795-f6c24b44a10a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:15.927564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b79320-e6bf-4cbe-8795-f6c24b44a10a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:15.927838 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b79320-e6bf-4cbe-8795-f6c24b44a10a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:15.938178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b79320-e6bf-4cbe-8795-f6c24b44a10a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:15.945677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-17b79320-e6bf-4cbe-8795-f6c24b44a10a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:15.945677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:15.945677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:15.945677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:15.945677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:15.945677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:15.945677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:15.945677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:15.945677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:15.945677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:15.945677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:15.945677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:15.945677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:15.945677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:15.945677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:15.945677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:15.946771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:15.946771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:15.946771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:15.946771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:15.946771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:15.946771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:15.946771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:15.946771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:15.946771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:15.946771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:15.946771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:15.946771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:57:15.946771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:15.946771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:15.946771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:15.946771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:15.947812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:15.947812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:15.947812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:15.947812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:15.947812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:15.947812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:15.947812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:15.947812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:15.947812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:15.947812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:15.947812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:15.947812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:57:15.947812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 581/1149] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:57:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:15.952579 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54dd04-00e7-4304-bbce-d38fe514aa9e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:16.010740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:16.046578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54dd04-00e7-4304-bbce-d38fe514aa9e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:16.078744 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272b887-5dfe-4d98-824d-94112297b72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:16.079390 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272b887-5dfe-4d98-824d-94112297b72b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:16.079670 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272b887-5dfe-4d98-824d-94112297b72b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:16.079967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272b887-5dfe-4d98-824d-94112297b72b None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:16.080700 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272b887-5dfe-4d98-824d-94112297b72b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:16.081004 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272b887-5dfe-4d98-824d-94112297b72b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:16.082356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272b887-5dfe-4d98-824d-94112297b72b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:16.090034 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 569/1150] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:57:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:16.095750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b79320-e6bf-4cbe-8795-f6c24b44a10a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:16.195816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b79320-e6bf-4cbe-8795-f6c24b44a10a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:16.202375 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:16.228864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c2b47-4065-4050-9b7b-43dbb244382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:16.229738 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c2b47-4065-4050-9b7b-43dbb244382a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:16.230019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c2b47-4065-4050-9b7b-43dbb244382a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:16.230294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c2b47-4065-4050-9b7b-43dbb244382a None admin] PATH_INFO: `/v3/users/1b2ce1f4c3f94a5bb185272dc4cedb1b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:16.231459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c2b47-4065-4050-9b7b-43dbb244382a None admin] RBAC: Authorizing `identity:get_user(user_id=1b2ce1f4c3f94a5bb185272dc4cedb1b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:16.233518 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c2b47-4065-4050-9b7b-43dbb244382a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:16.235125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 582/1151] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:57:16 2022] GET /identity/v3/users/1b2ce1f4c3f94a5bb185272dc4cedb1b => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:16.240962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272b887-5dfe-4d98-824d-94112297b72b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:16.339611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272b887-5dfe-4d98-824d-94112297b72b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:16.363306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:16.375102 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a90e0f-8ad9-4ab6-90ff-2db156cdc069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:16.376004 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a90e0f-8ad9-4ab6-90ff-2db156cdc069 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:16.376291 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a90e0f-8ad9-4ab6-90ff-2db156cdc069 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:16.376678 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a90e0f-8ad9-4ab6-90ff-2db156cdc069 None admin] PATH_INFO: `/v3/projects/59d103467dc24ce1b79fcad27b5fae09` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:16.377752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a90e0f-8ad9-4ab6-90ff-2db156cdc069 None admin] RBAC: Authorizing `identity:get_project(project_id=59d103467dc24ce1b79fcad27b5fae09)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:16.379187 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a90e0f-8ad9-4ab6-90ff-2db156cdc069 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:16.380922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 570/1152] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:57:16 2022] GET /identity/v3/projects/59d103467dc24ce1b79fcad27b5fae09 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:16.386675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c2b47-4065-4050-9b7b-43dbb244382a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:16.482986 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c2b47-4065-4050-9b7b-43dbb244382a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:16.515483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca84209-800f-442d-816f-c7af0c907853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:16.516453 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca84209-800f-442d-816f-c7af0c907853 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:16.516740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca84209-800f-442d-816f-c7af0c907853 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:16.517020 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca84209-800f-442d-816f-c7af0c907853 None admin] PATH_INFO: `/v3/projects/59d103467dc24ce1b79fcad27b5fae09/users/1b2ce1f4c3f94a5bb185272dc4cedb1b/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:16.518954 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca84209-800f-442d-816f-c7af0c907853 None admin] RBAC: Authorizing `identity:create_grant(project_id=59d103467dc24ce1b79fcad27b5fae09, user_id=1b2ce1f4c3f94a5bb185272dc4cedb1b, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:16.520407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca84209-800f-442d-816f-c7af0c907853 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:16.533248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 583/1153] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:57:16 2022] PUT /identity/v3/projects/59d103467dc24ce1b79fcad27b5fae09/users/1b2ce1f4c3f94a5bb185272dc4cedb1b/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:57:18.691226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ce552-0287-4e3a-84d6-c7af34f5cfe4 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:18.691723 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ce552-0287-4e3a-84d6-c7af34f5cfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:18.691723 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ce552-0287-4e3a-84d6-c7af34f5cfe4 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:18.693096 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 571/1154] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:18.698310 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b9a7d-d10a-44c0-8bbf-db486d87ee6d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:18.698697 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b9a7d-d10a-44c0-8bbf-db486d87ee6d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:18.698879 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b9a7d-d10a-44c0-8bbf-db486d87ee6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:18.715244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-cd0b9a7d-d10a-44c0-8bbf-db486d87ee6d None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:18.716459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cd0b9a7d-d10a-44c0-8bbf-db486d87ee6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:18.742385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:18.781987 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 584/1155] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:57:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:57:18.805672 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ce552-0287-4e3a-84d6-c7af34f5cfe4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:18.913270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ce552-0287-4e3a-84d6-c7af34f5cfe4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:18.945775 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3768f59-3f4d-4a7d-9ff4-52415f4b6f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:18.946529 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3768f59-3f4d-4a7d-9ff4-52415f4b6f88 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:18.946813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3768f59-3f4d-4a7d-9ff4-52415f4b6f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:18.947088 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3768f59-3f4d-4a7d-9ff4-52415f4b6f88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:18.956821 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3768f59-3f4d-4a7d-9ff4-52415f4b6f88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:18.964318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b3768f59-3f4d-4a7d-9ff4-52415f4b6f88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:18.964318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:18.964318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:18.964318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:18.964318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:18.964318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:18.964318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:18.964318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:18.964318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:18.964318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:18.964318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:18.964318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:18.964318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:18.964318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:18.964318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:18.964318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:18.965375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:18.965375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:18.965375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:18.965375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:18.965375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:18.965375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:18.965375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:18.965375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:18.965375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:18.965375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:18.965375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:18.965375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:57:18.965375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:18.965375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:18.965375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:18.965375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:18.966252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:18.966252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:18.966252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:18.966252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:18.966252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:18.966252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:18.966252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:18.966252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:18.966252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:18.966252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:18.966252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:18.966252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:57:18.966252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 572/1156] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:57:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:18.971997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b9a7d-d10a-44c0-8bbf-db486d87ee6d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:19.066900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b9a7d-d10a-44c0-8bbf-db486d87ee6d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:19.099165 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c385e82-04ec-4bab-8ead-4956f75fa325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:19.099818 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c385e82-04ec-4bab-8ead-4956f75fa325 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.100128 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c385e82-04ec-4bab-8ead-4956f75fa325 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.100409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c385e82-04ec-4bab-8ead-4956f75fa325 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:19.101151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c385e82-04ec-4bab-8ead-4956f75fa325 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:19.101461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c385e82-04ec-4bab-8ead-4956f75fa325 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:19.102809 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c385e82-04ec-4bab-8ead-4956f75fa325 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:19.111089 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 585/1157] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:57:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:19.116803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3768f59-3f4d-4a7d-9ff4-52415f4b6f88 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:19.173798 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:19.219325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3768f59-3f4d-4a7d-9ff4-52415f4b6f88 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:19.250823 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0434-4215-4399-aea4-a8037919d0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:19.251688 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0434-4215-4399-aea4-a8037919d0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.252001 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0434-4215-4399-aea4-a8037919d0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.252277 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b0434-4215-4399-aea4-a8037919d0e6 None admin] PATH_INFO: `/v3/users/1b2ce1f4c3f94a5bb185272dc4cedb1b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:19.253451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b0434-4215-4399-aea4-a8037919d0e6 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2ce1f4c3f94a5bb185272dc4cedb1b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:19.254871 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b0434-4215-4399-aea4-a8037919d0e6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:19.256509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 573/1158] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:57:19 2022] GET /identity/v3/users/1b2ce1f4c3f94a5bb185272dc4cedb1b => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:19.267060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c385e82-04ec-4bab-8ead-4956f75fa325 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:19.298955 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:19.367837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c385e82-04ec-4bab-8ead-4956f75fa325 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:19.409793 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b061d85-5687-48fd-91eb-bcc3642307a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:19.410918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b061d85-5687-48fd-91eb-bcc3642307a8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.411435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b061d85-5687-48fd-91eb-bcc3642307a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.411981 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b061d85-5687-48fd-91eb-bcc3642307a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:19.477700 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b061d85-5687-48fd-91eb-bcc3642307a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:19.479076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b061d85-5687-48fd-91eb-bcc3642307a8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:19.503452 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:19.573504 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 586/1159] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:57:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 11:57:19.579933 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0434-4215-4399-aea4-a8037919d0e6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:19.675386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b0434-4215-4399-aea4-a8037919d0e6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:19.696752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:19.708494 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745f925-18a9-4d2e-a599-ab77a6c303f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:19.709341 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745f925-18a9-4d2e-a599-ab77a6c303f7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.709620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745f925-18a9-4d2e-a599-ab77a6c303f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.709893 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745f925-18a9-4d2e-a599-ab77a6c303f7 None admin] PATH_INFO: `/v3/projects/59d103467dc24ce1b79fcad27b5fae09` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:19.711048 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745f925-18a9-4d2e-a599-ab77a6c303f7 None admin] RBAC: Authorizing `identity:get_project(project_id=59d103467dc24ce1b79fcad27b5fae09)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:19.712496 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745f925-18a9-4d2e-a599-ab77a6c303f7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:19.714160 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 574/1160] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:57:19 2022] GET /identity/v3/projects/59d103467dc24ce1b79fcad27b5fae09 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:19.720097 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b061d85-5687-48fd-91eb-bcc3642307a8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:19.815450 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b061d85-5687-48fd-91eb-bcc3642307a8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:19.840060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:19.848875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dac55-ea98-498f-b9be-41e0a600c1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:19.849519 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dac55-ea98-498f-b9be-41e0a600c1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:19.849804 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dac55-ea98-498f-b9be-41e0a600c1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:19.850084 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dac55-ea98-498f-b9be-41e0a600c1d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:19.850907 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dac55-ea98-498f-b9be-41e0a600c1d3 None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=59d103467dc24ce1b79fcad27b5fae09, user.id=1b2ce1f4c3f94a5bb185272dc4cedb1b) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:19.851221 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dac55-ea98-498f-b9be-41e0a600c1d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:19.852654 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dac55-ea98-498f-b9be-41e0a600c1d3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:19.858306 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 587/1161] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:57:19 2022] GET /identity/v3/role_assignments?user.id=1b2ce1f4c3f94a5bb185272dc4cedb1b&scope.project.id=59d103467dc24ce1b79fcad27b5fae09&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:22.057817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b33ebe-d586-45cc-b6a4-cadae3682a99 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:22.058398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b33ebe-d586-45cc-b6a4-cadae3682a99 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:22.058398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b33ebe-d586-45cc-b6a4-cadae3682a99 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:22.059722 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 575/1162] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:22.065004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce666f-dc2e-48f2-a58a-bafbefe92a6a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:22.065451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce666f-dc2e-48f2-a58a-bafbefe92a6a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:22.065570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce666f-dc2e-48f2-a58a-bafbefe92a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:22.081872 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-26ce666f-dc2e-48f2-a58a-bafbefe92a6a None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:22.083043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-26ce666f-dc2e-48f2-a58a-bafbefe92a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:22.146777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 588/1163] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:57:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:57:22.168532 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b33ebe-d586-45cc-b6a4-cadae3682a99 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:22.267045 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b33ebe-d586-45cc-b6a4-cadae3682a99 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:22.299761 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898b215-0bca-4267-b5df-4bb9e109d59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:22.300423 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898b215-0bca-4267-b5df-4bb9e109d59a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:22.300710 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898b215-0bca-4267-b5df-4bb9e109d59a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:22.300990 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898b215-0bca-4267-b5df-4bb9e109d59a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:22.356236 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:22.366913 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898b215-0bca-4267-b5df-4bb9e109d59a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:22.368404 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898b215-0bca-4267-b5df-4bb9e109d59a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:22.462853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 576/1164] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:57:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:57:22.468889 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce666f-dc2e-48f2-a58a-bafbefe92a6a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:22.566352 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce666f-dc2e-48f2-a58a-bafbefe92a6a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:22.585334 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:22.599268 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714512d8-81a9-42e7-a954-61eaf82dab9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:22.600102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714512d8-81a9-42e7-a954-61eaf82dab9d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:22.600388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714512d8-81a9-42e7-a954-61eaf82dab9d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:22.600662 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714512d8-81a9-42e7-a954-61eaf82dab9d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:22.607905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714512d8-81a9-42e7-a954-61eaf82dab9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:22.609308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714512d8-81a9-42e7-a954-61eaf82dab9d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:22.623105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-714512d8-81a9-42e7-a954-61eaf82dab9d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 11:57:22.623105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:22.623105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 11:57:22.623105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 11:57:22.623105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:57:22.623105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:57:22.623105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:57:22.623105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:57:22.623105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 11:57:22.623105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:57:22.623105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:57:22.623105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:57:22.623105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:22.623105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:22.623105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:22.623105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:22.623105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:22.624354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:22.624354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:22.624354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:22.624354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:22.624354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:22.624354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:22.624354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:57:22.624354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:57:22.624354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:57:22.624354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:57:22.624354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:22.624354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:22.624354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:22.624354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:22.624354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:22.624354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:22.625611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:22.625611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:57:22.625611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:22.625611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:22.625611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:22.625611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:22.625611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:22.625611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:22.625611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:22.625611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:22.625611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 11:57:22.625611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:57:22.625611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 11:57:22.625611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:57:22.625611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 589/1165] 10.222.0.73 () {56 vars in 1117 bytes} [Thu May 19 11:57:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:22.630200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898b215-0bca-4267-b5df-4bb9e109d59a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:22.714900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:22.724774 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898b215-0bca-4267-b5df-4bb9e109d59a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:22.757017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2410bd0-f0bd-4e55-aecc-8ece8ef2d682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:22.757660 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2410bd0-f0bd-4e55-aecc-8ece8ef2d682 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:22.757940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2410bd0-f0bd-4e55-aecc-8ece8ef2d682 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:22.758214 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2410bd0-f0bd-4e55-aecc-8ece8ef2d682 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:22.758921 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2410bd0-f0bd-4e55-aecc-8ece8ef2d682 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:22.759222 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2410bd0-f0bd-4e55-aecc-8ece8ef2d682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:22.760596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2410bd0-f0bd-4e55-aecc-8ece8ef2d682 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:22.767434 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 577/1166] 10.222.0.73 () {56 vars in 1115 bytes} [Thu May 19 11:57:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:24.953540 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9153e-d4e0-4950-9e2f-186c25154043 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:24.954082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9153e-d4e0-4950-9e2f-186c25154043 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:24.954082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9153e-d4e0-4950-9e2f-186c25154043 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:24.955470 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 590/1167] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:24.960612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f52d0d-1034-4142-88a2-b108424bf4c5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:24.961001 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f52d0d-1034-4142-88a2-b108424bf4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:24.961168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f52d0d-1034-4142-88a2-b108424bf4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:24.977430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d2f52d0d-1034-4142-88a2-b108424bf4c5 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:24.978596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d2f52d0d-1034-4142-88a2-b108424bf4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:25.041825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 578/1168] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:57:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:57:25.064999 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9153e-d4e0-4950-9e2f-186c25154043 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:25.163196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9153e-d4e0-4950-9e2f-186c25154043 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:25.196389 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d87be8-bc9c-4867-99dd-d94f3590ee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:25.197036 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d87be8-bc9c-4867-99dd-d94f3590ee3c None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:25.197321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d87be8-bc9c-4867-99dd-d94f3590ee3c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:25.197595 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d87be8-bc9c-4867-99dd-d94f3590ee3c None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:25.198327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d87be8-bc9c-4867-99dd-d94f3590ee3c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:25.199687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d87be8-bc9c-4867-99dd-d94f3590ee3c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:25.213576 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 591/1169] 10.222.0.73 () {60 vars in 1138 bytes} [Thu May 19 11:57:25 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:57:27.421566 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b42d3-581d-4917-89d6-4a1da86c8180 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:27.422012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b42d3-581d-4917-89d6-4a1da86c8180 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:27.422119 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b42d3-581d-4917-89d6-4a1da86c8180 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:27.423512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 579/1170] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:27.428632 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95925063-a97e-4109-b633-9aef8d7c1dcc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:27.429006 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95925063-a97e-4109-b633-9aef8d7c1dcc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:27.429197 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95925063-a97e-4109-b633-9aef8d7c1dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:27.445501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-95925063-a97e-4109-b633-9aef8d7c1dcc None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:27.446668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-95925063-a97e-4109-b633-9aef8d7c1dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:27.480397 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:27.523228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 592/1171] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:57:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:57:27.546486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b42d3-581d-4917-89d6-4a1da86c8180 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:27.628689 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:27.645502 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b42d3-581d-4917-89d6-4a1da86c8180 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:27.678163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5d1f6-dca4-47ce-ba58-7b13bf351054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:27.679011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5d1f6-dca4-47ce-ba58-7b13bf351054 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:27.679291 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5d1f6-dca4-47ce-ba58-7b13bf351054 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:27.679567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5d1f6-dca4-47ce-ba58-7b13bf351054 None admin] PATH_INFO: `/v3/domains/e078e314bc854370be23c9318a66093b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:27.689627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5d1f6-dca4-47ce-ba58-7b13bf351054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e078e314bc854370be23c9318a66093b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:27.691053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5d1f6-dca4-47ce-ba58-7b13bf351054 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:27.692697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 580/1172] 10.222.0.73 () {56 vars in 1183 bytes} [Thu May 19 11:57:27 2022] GET /identity/v3/domains/e078e314bc854370be23c9318a66093b => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:27.698505 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95925063-a97e-4109-b633-9aef8d7c1dcc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:27.794279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95925063-a97e-4109-b633-9aef8d7c1dcc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:27.827698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0a8b3-bed1-4c66-aa4f-5d26fce41f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:27.828366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0a8b3-bed1-4c66-aa4f-5d26fce41f2f None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:27.828653 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0a8b3-bed1-4c66-aa4f-5d26fce41f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:27.828933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0a8b3-bed1-4c66-aa4f-5d26fce41f2f None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:27.829631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0a8b3-bed1-4c66-aa4f-5d26fce41f2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:27.831044 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0a8b3-bed1-4c66-aa4f-5d26fce41f2f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:27.854566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 593/1173] 10.222.0.73 () {60 vars in 1141 bytes} [Thu May 19 11:57:27 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:57:30.079773 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb92ce-cb74-4ef1-90a6-794dca31d65c None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:30.080378 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb92ce-cb74-4ef1-90a6-794dca31d65c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:30.080378 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb92ce-cb74-4ef1-90a6-794dca31d65c None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:30.081748 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 581/1174] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:30.087007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58abdd-3844-4c05-a18a-7fe9a4c56275 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:30.087394 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58abdd-3844-4c05-a18a-7fe9a4c56275 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:30.087580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58abdd-3844-4c05-a18a-7fe9a4c56275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:30.105122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0e58abdd-3844-4c05-a18a-7fe9a4c56275 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:30.106293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0e58abdd-3844-4c05-a18a-7fe9a4c56275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:30.122948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:30.173425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 594/1175] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:57:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:57:30.197652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb92ce-cb74-4ef1-90a6-794dca31d65c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:30.295635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb92ce-cb74-4ef1-90a6-794dca31d65c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:30.327791 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4afbc-d67c-4773-934f-e346c2fb4baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:30.328659 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4afbc-d67c-4773-934f-e346c2fb4baa None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:30.328947 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4afbc-d67c-4773-934f-e346c2fb4baa None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:30.329225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4afbc-d67c-4773-934f-e346c2fb4baa None admin] PATH_INFO: `/v3/domains/e078e314bc854370be23c9318a66093b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:30.330449 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4afbc-d67c-4773-934f-e346c2fb4baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=e078e314bc854370be23c9318a66093b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:30.331821 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4afbc-d67c-4773-934f-e346c2fb4baa None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:30.333423 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 582/1176] 10.222.0.73 () {56 vars in 1183 bytes} [Thu May 19 11:57:30 2022] GET /identity/v3/domains/e078e314bc854370be23c9318a66093b => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:30.338745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58abdd-3844-4c05-a18a-7fe9a4c56275 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:30.434485 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58abdd-3844-4c05-a18a-7fe9a4c56275 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:30.466745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e9ffd-817b-4027-9e31-9df7861dbeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:30.467412 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e9ffd-817b-4027-9e31-9df7861dbeb5 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:30.467695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e9ffd-817b-4027-9e31-9df7861dbeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:30.467991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e9ffd-817b-4027-9e31-9df7861dbeb5 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:30.468724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e9ffd-817b-4027-9e31-9df7861dbeb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:30.470151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e9ffd-817b-4027-9e31-9df7861dbeb5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:30.489574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 595/1177] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:57:30 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:57:32.690580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0c6a9-0b0b-460c-bc5d-0306bc4ab268 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:32.691103 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0c6a9-0b0b-460c-bc5d-0306bc4ab268 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:32.691103 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0c6a9-0b0b-460c-bc5d-0306bc4ab268 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:32.692449 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 583/1178] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:32.697571 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327acb60-7e8c-4bdb-ac9a-acff84071ae8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:32.697986 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327acb60-7e8c-4bdb-ac9a-acff84071ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:32.698142 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327acb60-7e8c-4bdb-ac9a-acff84071ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:32.714644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-327acb60-7e8c-4bdb-ac9a-acff84071ae8 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:32.715830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-327acb60-7e8c-4bdb-ac9a-acff84071ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:32.718273 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:32.783733 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 596/1179] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:57:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:57:32.807284 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0c6a9-0b0b-460c-bc5d-0306bc4ab268 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:32.822348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:32.908130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0c6a9-0b0b-460c-bc5d-0306bc4ab268 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:32.940960 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b68d7-2d93-4922-8a4c-4d228154684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:32.941677 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b68d7-2d93-4922-8a4c-4d228154684a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:32.941962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b68d7-2d93-4922-8a4c-4d228154684a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:32.942234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b68d7-2d93-4922-8a4c-4d228154684a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:32.952544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b68d7-2d93-4922-8a4c-4d228154684a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:32.960334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-be1b68d7-2d93-4922-8a4c-4d228154684a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:32.960334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:32.960334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:32.960334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:32.960334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:32.960334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:32.960334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:32.960334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:32.960334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:32.960334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:32.960334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:32.960334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:32.960334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:32.960334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:32.960334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:32.960334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:32.961419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:32.961419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:32.961419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:32.961419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:32.961419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:32.961419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:32.961419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:32.961419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:32.961419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:32.961419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:32.961419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:32.961419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:57:32.961419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:32.961419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:32.961419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:32.961419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:32.962323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:32.962323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:32.962323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:32.962323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:32.962323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:32.962323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:32.962323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:32.962323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:32.962323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:32.962323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:32.962323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:32.962323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:57:32.962323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 584/1180] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:57:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:32.967499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327acb60-7e8c-4bdb-ac9a-acff84071ae8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:33.061864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327acb60-7e8c-4bdb-ac9a-acff84071ae8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:33.093991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8c824-8563-4ab9-9b70-04dc110c61a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:33.094635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8c824-8563-4ab9-9b70-04dc110c61a8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:33.094916 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8c824-8563-4ab9-9b70-04dc110c61a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:33.095191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8c824-8563-4ab9-9b70-04dc110c61a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:33.095941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8c824-8563-4ab9-9b70-04dc110c61a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:33.096254 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8c824-8563-4ab9-9b70-04dc110c61a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:33.097595 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8c824-8563-4ab9-9b70-04dc110c61a8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:33.102357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:33.105848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 597/1181] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:57:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:57:33.111750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b68d7-2d93-4922-8a4c-4d228154684a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:33.182310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:33.213175 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b68d7-2d93-4922-8a4c-4d228154684a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:33.245262 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5240de9-b827-4d8f-8e97-399059c8718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:33.246119 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5240de9-b827-4d8f-8e97-399059c8718d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:33.246398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5240de9-b827-4d8f-8e97-399059c8718d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:33.246667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5240de9-b827-4d8f-8e97-399059c8718d None admin] PATH_INFO: `/v3/users/3ef708d007b54168b1d59577be7f5d5d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:33.259906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5240de9-b827-4d8f-8e97-399059c8718d None admin] RBAC: Authorizing `identity:get_user(user_id=3ef708d007b54168b1d59577be7f5d5d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:33.261362 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5240de9-b827-4d8f-8e97-399059c8718d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:33.263008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 585/1182] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:57:33 2022] GET /identity/v3/users/3ef708d007b54168b1d59577be7f5d5d => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:33.268679 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8c824-8563-4ab9-9b70-04dc110c61a8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:33.364322 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8c824-8563-4ab9-9b70-04dc110c61a8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:33.397008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaa794-3f99-4e27-a254-e121512da6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:33.397644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaa794-3f99-4e27-a254-e121512da6cb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:33.397928 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaa794-3f99-4e27-a254-e121512da6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:33.398206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaa794-3f99-4e27-a254-e121512da6cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:33.461607 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:33.464209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efaa794-3f99-4e27-a254-e121512da6cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:33.465996 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efaa794-3f99-4e27-a254-e121512da6cb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:33.560957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 598/1183] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:57:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:57:33.566765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5240de9-b827-4d8f-8e97-399059c8718d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:33.665378 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5240de9-b827-4d8f-8e97-399059c8718d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:33.693174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:33.699140 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6503c6-33ec-4ac4-8290-d4973f4c61e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:33.700022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6503c6-33ec-4ac4-8290-d4973f4c61e5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:33.700310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6503c6-33ec-4ac4-8290-d4973f4c61e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:33.700615 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6503c6-33ec-4ac4-8290-d4973f4c61e5 None admin] PATH_INFO: `/v3/projects/b4716052bfba4e0fbce2ee32e4979f90` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:33.701792 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6503c6-33ec-4ac4-8290-d4973f4c61e5 None admin] RBAC: Authorizing `identity:get_project(project_id=b4716052bfba4e0fbce2ee32e4979f90)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:33.703224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6503c6-33ec-4ac4-8290-d4973f4c61e5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:33.704933 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 586/1184] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:57:33 2022] GET /identity/v3/projects/b4716052bfba4e0fbce2ee32e4979f90 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:33.710945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaa794-3f99-4e27-a254-e121512da6cb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:33.804365 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:33.807279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaa794-3f99-4e27-a254-e121512da6cb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:33.840694 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d4e04-da63-4455-88bf-408350730f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:33.841899 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d4e04-da63-4455-88bf-408350730f89 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:33.842183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d4e04-da63-4455-88bf-408350730f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:33.842460 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d4e04-da63-4455-88bf-408350730f89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:33.843277 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d4e04-da63-4455-88bf-408350730f89 None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=b4716052bfba4e0fbce2ee32e4979f90, user.id=3ef708d007b54168b1d59577be7f5d5d) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:33.843586 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d4e04-da63-4455-88bf-408350730f89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:33.845035 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d4e04-da63-4455-88bf-408350730f89 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:33.850848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 599/1185] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:57:33 2022] GET /identity/v3/role_assignments?user.id=3ef708d007b54168b1d59577be7f5d5d&scope.project.id=b4716052bfba4e0fbce2ee32e4979f90&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:36.005596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f310bf3-32bc-4fa8-8588-5a8ad95468fa None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.006129 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f310bf3-32bc-4fa8-8588-5a8ad95468fa None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.006129 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f310bf3-32bc-4fa8-8588-5a8ad95468fa None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.007496 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 587/1186] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:36.012758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d20e7-6fb1-46d8-a854-e10cc69841bc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.013183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d20e7-6fb1-46d8-a854-e10cc69841bc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.013406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d20e7-6fb1-46d8-a854-e10cc69841bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.030182 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-034d20e7-6fb1-46d8-a854-e10cc69841bc None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:36.031357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-034d20e7-6fb1-46d8-a854-e10cc69841bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:36.095260 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 600/1187] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:57:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:57:36.117168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f310bf3-32bc-4fa8-8588-5a8ad95468fa None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:36.214718 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f310bf3-32bc-4fa8-8588-5a8ad95468fa None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:36.246899 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a4401-a0ad-4a32-8c99-e89c005f0450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:36.247671 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a4401-a0ad-4a32-8c99-e89c005f0450 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.247973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a4401-a0ad-4a32-8c99-e89c005f0450 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.248246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a4401-a0ad-4a32-8c99-e89c005f0450 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.257947 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a4401-a0ad-4a32-8c99-e89c005f0450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:36.265903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f06a4401-a0ad-4a32-8c99-e89c005f0450 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:36.265903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:36.265903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:36.265903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:36.265903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:36.265903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:36.265903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:36.265903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:36.265903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:36.265903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:36.265903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:36.265903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:36.265903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:36.265903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:36.265903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:36.265903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:36.266900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:36.266900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:36.266900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:36.266900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:36.266900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:36.266900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:36.266900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:36.266900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:36.266900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:36.266900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:36.266900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:36.266900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:57:36.266900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:36.266900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:36.266900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:36.266900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:36.267815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:36.267815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:36.267815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:36.267815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:36.267815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:36.267815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:36.267815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:36.267815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:36.267815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:36.267815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:36.267815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:36.267815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:57:36.267815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 588/1188] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:57:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:36.272922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d20e7-6fb1-46d8-a854-e10cc69841bc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:36.362242 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:36.369259 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d20e7-6fb1-46d8-a854-e10cc69841bc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:36.402347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5dbd1-ab67-4425-97f1-136215d7ff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:36.403012 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5dbd1-ab67-4425-97f1-136215d7ff80 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.403294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5dbd1-ab67-4425-97f1-136215d7ff80 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.403572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5dbd1-ab67-4425-97f1-136215d7ff80 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.404941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5dbd1-ab67-4425-97f1-136215d7ff80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:36.405247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5dbd1-ab67-4425-97f1-136215d7ff80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:36.406595 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5dbd1-ab67-4425-97f1-136215d7ff80 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:36.414308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 601/1189] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:57:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:36.420417 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a4401-a0ad-4a32-8c99-e89c005f0450 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:36.477931 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:36.519467 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a4401-a0ad-4a32-8c99-e89c005f0450 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:36.551464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29272641-70cf-43e4-b510-9a9574ff4340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:36.552354 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29272641-70cf-43e4-b510-9a9574ff4340 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.552642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29272641-70cf-43e4-b510-9a9574ff4340 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.552921 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29272641-70cf-43e4-b510-9a9574ff4340 None admin] PATH_INFO: `/v3/users/3ef708d007b54168b1d59577be7f5d5d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.554105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29272641-70cf-43e4-b510-9a9574ff4340 None admin] RBAC: Authorizing `identity:get_user(user_id=3ef708d007b54168b1d59577be7f5d5d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:36.555531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29272641-70cf-43e4-b510-9a9574ff4340 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:36.557176 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 589/1190] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:57:36 2022] GET /identity/v3/users/3ef708d007b54168b1d59577be7f5d5d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:36.563433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5dbd1-ab67-4425-97f1-136215d7ff80 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:36.660784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5dbd1-ab67-4425-97f1-136215d7ff80 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:36.693674 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc961c4-da6e-43e5-a599-225193c73ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:36.694525 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc961c4-da6e-43e5-a599-225193c73ddc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.694808 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc961c4-da6e-43e5-a599-225193c73ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.695084 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc961c4-da6e-43e5-a599-225193c73ddc None admin] PATH_INFO: `/v3/projects/b4716052bfba4e0fbce2ee32e4979f90` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.696270 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc961c4-da6e-43e5-a599-225193c73ddc None admin] RBAC: Authorizing `identity:get_project(project_id=b4716052bfba4e0fbce2ee32e4979f90)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:36.697683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc961c4-da6e-43e5-a599-225193c73ddc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:36.699336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 602/1191] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:57:36 2022] GET /identity/v3/projects/b4716052bfba4e0fbce2ee32e4979f90 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:36.705609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29272641-70cf-43e4-b510-9a9574ff4340 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:36.802800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29272641-70cf-43e4-b510-9a9574ff4340 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:36.828060 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:36.836794 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e79e3-a841-4c67-a45c-5bf9076ef97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:36.837669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e79e3-a841-4c67-a45c-5bf9076ef97d None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:36.837952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e79e3-a841-4c67-a45c-5bf9076ef97d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:36.838227 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e79e3-a841-4c67-a45c-5bf9076ef97d None admin] PATH_INFO: `/v3/projects/b4716052bfba4e0fbce2ee32e4979f90/users/3ef708d007b54168b1d59577be7f5d5d/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:36.840213 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e79e3-a841-4c67-a45c-5bf9076ef97d None admin] RBAC: Authorizing `identity:create_grant(project_id=b4716052bfba4e0fbce2ee32e4979f90, user_id=3ef708d007b54168b1d59577be7f5d5d, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:36.841660 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e79e3-a841-4c67-a45c-5bf9076ef97d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:36.853951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 590/1192] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:57:36 2022] PUT /identity/v3/projects/b4716052bfba4e0fbce2ee32e4979f90/users/3ef708d007b54168b1d59577be7f5d5d/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:57:39.032173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213db329-625c-4095-9ddc-4f2795f2f416 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:39.032740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213db329-625c-4095-9ddc-4f2795f2f416 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:39.032740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213db329-625c-4095-9ddc-4f2795f2f416 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:39.034116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 603/1193] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:57:39.039358 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e13b01-ec1b-45ef-8dc1-d36bed1508e7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:39.039746 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e13b01-ec1b-45ef-8dc1-d36bed1508e7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:39.039938 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e13b01-ec1b-45ef-8dc1-d36bed1508e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:39.056690 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f8e13b01-ec1b-45ef-8dc1-d36bed1508e7 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:57:39.057887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f8e13b01-ec1b-45ef-8dc1-d36bed1508e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:57:39.127718 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 591/1194] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:57:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:57:39.151397 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213db329-625c-4095-9ddc-4f2795f2f416 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:39.176507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:39.250467 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213db329-625c-4095-9ddc-4f2795f2f416 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:39.288404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ff581-f66e-4c70-acad-4546cc3c2026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:39.289119 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ff581-f66e-4c70-acad-4546cc3c2026 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:39.289407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ff581-f66e-4c70-acad-4546cc3c2026 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:39.289688 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ff581-f66e-4c70-acad-4546cc3c2026 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:39.300259 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ff581-f66e-4c70-acad-4546cc3c2026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:57:39.307830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-696ff581-f66e-4c70-acad-4546cc3c2026 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:39.307830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:57:39.307830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:57:39.307830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:57:39.307830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:57:39.307830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:57:39.307830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:57:39.307830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:57:39.307830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:57:39.307830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:57:39.307830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:57:39.307830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:57:39.307830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:57:39.307830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:57:39.307830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:57:39.307830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:57:39.308918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:57:39.308918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:57:39.308918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:57:39.308918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:57:39.308918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:57:39.308918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:57:39.308918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:57:39.308918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:57:39.308918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:57:39.308918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:57:39.308918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:57:39.308918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:57:39.308918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:57:39.308918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:57:39.308918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:57:39.308918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:57:39.310652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:57:39.310652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:57:39.310652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:57:39.310652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:57:39.310652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:57:39.310652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:57:39.310652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:57:39.310652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:57:39.310652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:57:39.310652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:57:39.310652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:57:39.310652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:57:39.310652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 604/1195] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:57:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:57:39.315502 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e13b01-ec1b-45ef-8dc1-d36bed1508e7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:39.412595 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e13b01-ec1b-45ef-8dc1-d36bed1508e7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:39.428953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:39.446940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096546f-9ce0-477b-88d7-8d4cfdddee4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:39.447602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096546f-9ce0-477b-88d7-8d4cfdddee4f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:39.447890 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096546f-9ce0-477b-88d7-8d4cfdddee4f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:39.448201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096546f-9ce0-477b-88d7-8d4cfdddee4f None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:39.448947 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096546f-9ce0-477b-88d7-8d4cfdddee4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:39.449255 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096546f-9ce0-477b-88d7-8d4cfdddee4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:39.450650 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096546f-9ce0-477b-88d7-8d4cfdddee4f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:39.458511 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 592/1196] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:57:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:39.464244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ff581-f66e-4c70-acad-4546cc3c2026 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:39.548202 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:39.563894 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ff581-f66e-4c70-acad-4546cc3c2026 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:39.597701 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b21c7e-6d55-4f6d-a5d9-2517e3627b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:39.598564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b21c7e-6d55-4f6d-a5d9-2517e3627b36 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:39.598852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b21c7e-6d55-4f6d-a5d9-2517e3627b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:39.599131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b21c7e-6d55-4f6d-a5d9-2517e3627b36 None admin] PATH_INFO: `/v3/users/3ef708d007b54168b1d59577be7f5d5d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:39.600336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b21c7e-6d55-4f6d-a5d9-2517e3627b36 None admin] RBAC: Authorizing `identity:get_user(user_id=3ef708d007b54168b1d59577be7f5d5d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:39.601774 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b21c7e-6d55-4f6d-a5d9-2517e3627b36 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:39.603404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 605/1197] 10.222.0.73 () {56 vars in 1177 bytes} [Thu May 19 11:57:39 2022] GET /identity/v3/users/3ef708d007b54168b1d59577be7f5d5d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:39.609152 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096546f-9ce0-477b-88d7-8d4cfdddee4f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:39.706394 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096546f-9ce0-477b-88d7-8d4cfdddee4f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:39.738171 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd3045-f79c-4ed9-b693-f4bd60867e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:39.738808 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd3045-f79c-4ed9-b693-f4bd60867e8f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:39.739087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd3045-f79c-4ed9-b693-f4bd60867e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:39.739360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd3045-f79c-4ed9-b693-f4bd60867e8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:39.782854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:39.803898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd3045-f79c-4ed9-b693-f4bd60867e8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:39.805296 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd3045-f79c-4ed9-b693-f4bd60867e8f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:39.898671 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 593/1198] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:57:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:57:39.904758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b21c7e-6d55-4f6d-a5d9-2517e3627b36 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:40.002850 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b21c7e-6d55-4f6d-a5d9-2517e3627b36 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:40.035447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba4b72-f66a-4ac9-a86a-2c91497a488f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:40.036328 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba4b72-f66a-4ac9-a86a-2c91497a488f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.036608 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba4b72-f66a-4ac9-a86a-2c91497a488f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.036881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba4b72-f66a-4ac9-a86a-2c91497a488f None admin] PATH_INFO: `/v3/projects/b4716052bfba4e0fbce2ee32e4979f90` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.038029 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba4b72-f66a-4ac9-a86a-2c91497a488f None admin] RBAC: Authorizing `identity:get_project(project_id=b4716052bfba4e0fbce2ee32e4979f90)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:40.039434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba4b72-f66a-4ac9-a86a-2c91497a488f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:40.041155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 606/1199] 10.222.0.73 () {56 vars in 1186 bytes} [Thu May 19 11:57:39 2022] GET /identity/v3/projects/b4716052bfba4e0fbce2ee32e4979f90 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:40.047404 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd3045-f79c-4ed9-b693-f4bd60867e8f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:57:40.123209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:40.145727 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd3045-f79c-4ed9-b693-f4bd60867e8f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:57:40.177841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c10d3a-4f07-4b56-b046-b44cd6cc97ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:57:40.178478 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c10d3a-4f07-4b56-b046-b44cd6cc97ee None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:57:40.178760 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c10d3a-4f07-4b56-b046-b44cd6cc97ee None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:57:40.179037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c10d3a-4f07-4b56-b046-b44cd6cc97ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:57:40.179855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c10d3a-4f07-4b56-b046-b44cd6cc97ee None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=b4716052bfba4e0fbce2ee32e4979f90, user.id=3ef708d007b54168b1d59577be7f5d5d) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:57:40.180194 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c10d3a-4f07-4b56-b046-b44cd6cc97ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:57:40.181610 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c10d3a-4f07-4b56-b046-b44cd6cc97ee None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:57:40.187740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 594/1200] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:57:40 2022] GET /identity/v3/role_assignments?user.id=3ef708d007b54168b1d59577be7f5d5d&scope.project.id=b4716052bfba4e0fbce2ee32e4979f90&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:57:50.031821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:57:50.184672 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=29 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:40.300706 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd294329-ba11-48c9-99cd-84c668ad711b None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:40.301447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd294329-ba11-48c9-99cd-84c668ad711b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:40.301447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd294329-ba11-48c9-99cd-84c668ad711b None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:40.302891 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 607/1201] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:40.309781 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fd666-63bd-4829-b055-811d5e01aa08 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:40.310664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fd666-63bd-4829-b055-811d5e01aa08 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:40.310978 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fd666-63bd-4829-b055-811d5e01aa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:40.330086 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-169fd666-63bd-4829-b055-811d5e01aa08 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:40.331342 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-169fd666-63bd-4829-b055-811d5e01aa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:40.421871 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 595/1202] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:58:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:40.448389 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd294329-ba11-48c9-99cd-84c668ad711b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:40.588471 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd294329-ba11-48c9-99cd-84c668ad711b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:40.631736 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b5924-5b5d-4799-823d-126b1cda3326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:40.632708 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b5924-5b5d-4799-823d-126b1cda3326 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:40.633046 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b5924-5b5d-4799-823d-126b1cda3326 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:40.633330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b5924-5b5d-4799-823d-126b1cda3326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:40.644755 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b5924-5b5d-4799-823d-126b1cda3326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:40.646254 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b5924-5b5d-4799-823d-126b1cda3326 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:40.668018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-a39b5924-5b5d-4799-823d-126b1cda3326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:40.668018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:40.668018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:40.668018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:40.668018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:40.668018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:40.668018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:40.668018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:40.668018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:40.668018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:40.668018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:40.668018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:40.668018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:40.668018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:40.668018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:40.669415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:40.669415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:40.669415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:40.669415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:40.669415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:40.669415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:40.669415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:40.669415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:40.669415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:58:40.669415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:40.669415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:40.669415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:40.669415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:40.669415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:40.669415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:40.669415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:40.669415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:40.670381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:40.670381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:40.670381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:40.670381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:58:40.674547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 608/1203] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:40.675446 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fd666-63bd-4829-b055-811d5e01aa08 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:40.825839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fd666-63bd-4829-b055-811d5e01aa08 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:40.868058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:40.875569 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deb638-3cf0-486c-8b84-8ec6331b69a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:40.876428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deb638-3cf0-486c-8b84-8ec6331b69a9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:40.876757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deb638-3cf0-486c-8b84-8ec6331b69a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:40.877057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deb638-3cf0-486c-8b84-8ec6331b69a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:40.877881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29deb638-3cf0-486c-8b84-8ec6331b69a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:40.878254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29deb638-3cf0-486c-8b84-8ec6331b69a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:40.879874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29deb638-3cf0-486c-8b84-8ec6331b69a9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:40.892587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 596/1204] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:40.902325 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b5924-5b5d-4799-823d-126b1cda3326 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:40.971736 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:41.037653 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b5924-5b5d-4799-823d-126b1cda3326 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:41.080501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a4d43-3c7e-4507-af28-8f05db9b78ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:41.081261 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a4d43-3c7e-4507-af28-8f05db9b78ed None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:41.081460 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a4d43-3c7e-4507-af28-8f05db9b78ed None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:41.081886 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a4d43-3c7e-4507-af28-8f05db9b78ed None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:41.082750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a4d43-3c7e-4507-af28-8f05db9b78ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:41.084469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a4d43-3c7e-4507-af28-8f05db9b78ed None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:41.109807 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 609/1205] 10.222.0.73 () {60 vars in 1132 bytes} [Thu May 19 11:58:40 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:58:43.570160 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc7cc-81c3-43f8-a905-001a956840aa None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:43.570738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc7cc-81c3-43f8-a905-001a956840aa None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:43.570738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc7cc-81c3-43f8-a905-001a956840aa None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:43.572622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 597/1206] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:58:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:43.579484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f9d90-14f4-4287-aad3-1964431f4f8f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:43.580097 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f9d90-14f4-4287-aad3-1964431f4f8f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:43.580187 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f9d90-14f4-4287-aad3-1964431f4f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:43.599831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e68f9d90-14f4-4287-aad3-1964431f4f8f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:43.601349 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e68f9d90-14f4-4287-aad3-1964431f4f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:43.688786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 610/1207] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:58:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:43.715665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dc7cc-81c3-43f8-a905-001a956840aa None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:43.842503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dc7cc-81c3-43f8-a905-001a956840aa None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:43.884137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b5d78-c1ea-49c8-bb91-d5b4d20ff8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:43.885308 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b5d78-c1ea-49c8-bb91-d5b4d20ff8fe None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:43.885601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b5d78-c1ea-49c8-bb91-d5b4d20ff8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:43.885932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b5d78-c1ea-49c8-bb91-d5b4d20ff8fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:43.898217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b5d78-c1ea-49c8-bb91-d5b4d20ff8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:43.907038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f94b5d78-c1ea-49c8-bb91-d5b4d20ff8fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:58:43.907038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:43.907038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:43.907038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:43.907038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:43.907038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:43.907038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:43.907038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:43.907038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:43.907038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:43.907038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:43.907038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:43.907038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:43.907038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:43.907038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:43.907038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:43.908067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:43.908067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:43.908067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:43.908067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:43.908067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:43.908067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:43.908067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:43.908067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:43.908067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:43.908067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:43.908067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:43.908067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:58:43.908067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:43.908067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:43.908067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:43.908067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:43.908911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:43.908911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:43.908911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:43.908911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:43.908911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:43.908911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:43.908911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:43.908911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:43.908911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:43.908911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:43.908911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:58:43.908911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:58:43.908911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 598/1208] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:58:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:43.914714 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f9d90-14f4-4287-aad3-1964431f4f8f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:43.967996 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:44.039840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f9d90-14f4-4287-aad3-1964431f4f8f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:44.087879 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb122e22-f18f-450f-8191-7f5706c87615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:44.088452 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122e22-f18f-450f-8191-7f5706c87615 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:44.088797 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122e22-f18f-450f-8191-7f5706c87615 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:44.089583 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122e22-f18f-450f-8191-7f5706c87615 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:44.090340 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb122e22-f18f-450f-8191-7f5706c87615 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:44.090649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb122e22-f18f-450f-8191-7f5706c87615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:44.092046 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb122e22-f18f-450f-8191-7f5706c87615 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:44.101827 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 611/1209] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:58:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:44.107058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b5d78-c1ea-49c8-bb91-d5b4d20ff8fe None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:44.172814 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:44.235441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b5d78-c1ea-49c8-bb91-d5b4d20ff8fe None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:44.283355 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dceba-2eb3-49b6-8e38-960818ce6684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:44.284188 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dceba-2eb3-49b6-8e38-960818ce6684 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:44.284472 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dceba-2eb3-49b6-8e38-960818ce6684 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:44.284742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dceba-2eb3-49b6-8e38-960818ce6684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:44.298462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dceba-2eb3-49b6-8e38-960818ce6684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:44.300365 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dceba-2eb3-49b6-8e38-960818ce6684 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:44.321348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-790dceba-2eb3-49b6-8e38-960818ce6684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:44.321348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:44.321348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:44.321348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:44.321348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:44.321348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:44.321348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:44.321348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:44.321348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:44.321348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:44.321348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:44.321348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:44.321348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:44.321348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:44.321348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:44.322319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:44.322319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:44.322319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:44.322319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:44.322319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:44.322319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:44.322319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:44.322319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:44.322319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:58:44.322319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:44.322319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:44.322319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:44.322319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:44.322319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:44.322319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:44.322319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:44.322319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:44.323741 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:44.323741 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:44.323741 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:44.323741 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:58:44.327809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 599/1210] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:44.329011 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb122e22-f18f-450f-8191-7f5706c87615 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:44.434389 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:44.440179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb122e22-f18f-450f-8191-7f5706c87615 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:44.480904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f97f2-3a94-4463-980d-090b10fb960b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:44.481610 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f97f2-3a94-4463-980d-090b10fb960b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:44.481919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f97f2-3a94-4463-980d-090b10fb960b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:44.482182 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f97f2-3a94-4463-980d-090b10fb960b None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:44.482907 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f97f2-3a94-4463-980d-090b10fb960b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:44.483339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f97f2-3a94-4463-980d-090b10fb960b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:44.484608 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f97f2-3a94-4463-980d-090b10fb960b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:44.497844 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 612/1211] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:44.503609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dceba-2eb3-49b6-8e38-960818ce6684 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:44.613746 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dceba-2eb3-49b6-8e38-960818ce6684 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:44.615535 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:44.654471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a55a5-923e-437c-ab73-9e595436a2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:44.655667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a55a5-923e-437c-ab73-9e595436a2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:44.656180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a55a5-923e-437c-ab73-9e595436a2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:44.656502 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a55a5-923e-437c-ab73-9e595436a2e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:44.666831 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a55a5-923e-437c-ab73-9e595436a2e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:44.669359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a55a5-923e-437c-ab73-9e595436a2e0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:44.685439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-333a55a5-923e-437c-ab73-9e595436a2e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 11:58:44.685439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:44.685439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:44.685439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:44.685439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:44.685439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:44.685439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:44.685439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:44.685439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:44.685439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:44.685439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:44.685439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:44.685439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:44.685439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:44.685439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:44.685439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:44.686619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:44.687883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:44.687883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:44.687883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:44.687883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:44.687883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:44.687883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:44.687883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:44.687883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:44.687883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 11:58:44.687883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:58:44.687883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 600/1212] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:58:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:44.692757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f97f2-3a94-4463-980d-090b10fb960b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:44.808781 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f97f2-3a94-4463-980d-090b10fb960b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:44.848352 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562be9b4-706c-46ec-9014-31573d48af1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:44.849190 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562be9b4-706c-46ec-9014-31573d48af1b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:44.849567 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562be9b4-706c-46ec-9014-31573d48af1b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:44.849939 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562be9b4-706c-46ec-9014-31573d48af1b None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:44.850880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562be9b4-706c-46ec-9014-31573d48af1b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:44.851352 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562be9b4-706c-46ec-9014-31573d48af1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:44.854905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562be9b4-706c-46ec-9014-31573d48af1b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:44.876121 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 613/1213] 10.222.0.73 () {56 vars in 1143 bytes} [Thu May 19 11:58:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:44.880410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a55a5-923e-437c-ab73-9e595436a2e0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:45.004612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a55a5-923e-437c-ab73-9e595436a2e0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:45.045753 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462b092-abcd-4986-8cd7-170e7ef07800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:45.046814 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462b092-abcd-4986-8cd7-170e7ef07800 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:45.047107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462b092-abcd-4986-8cd7-170e7ef07800 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:45.047388 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462b092-abcd-4986-8cd7-170e7ef07800 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:45.079715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:45.130785 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462b092-abcd-4986-8cd7-170e7ef07800 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:45.132261 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462b092-abcd-4986-8cd7-170e7ef07800 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:45.252939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 601/1214] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:58:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:58:45.254212 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562be9b4-706c-46ec-9014-31573d48af1b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:45.276489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:45.378824 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562be9b4-706c-46ec-9014-31573d48af1b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:45.422185 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4eda2-28d2-40ef-8c69-ef145b3daed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:45.423031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4eda2-28d2-40ef-8c69-ef145b3daed8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:45.423337 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4eda2-28d2-40ef-8c69-ef145b3daed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:45.423638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4eda2-28d2-40ef-8c69-ef145b3daed8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:45.438803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4eda2-28d2-40ef-8c69-ef145b3daed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:45.440375 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4eda2-28d2-40ef-8c69-ef145b3daed8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:45.463488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-76c4eda2-28d2-40ef-8c69-ef145b3daed8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:45.463488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:45.463488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:45.463488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:45.463488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:45.463488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:45.463488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:45.463488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:45.463488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:45.463488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:45.463488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:45.463488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:45.463488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:45.463488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:45.463488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:45.464693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:45.464693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:45.464693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:45.464693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:45.464693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:45.464693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:45.464693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:45.464693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:45.464693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:58:45.464693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:45.464693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:45.464693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:45.464693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:45.464693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:45.464693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:45.464693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:45.464693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:45.465612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:45.465612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:45.465612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:45.465612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:58:45.465612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 614/1215] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:45.470670 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462b092-abcd-4986-8cd7-170e7ef07800 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:45.533769 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:45.575703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462b092-abcd-4986-8cd7-170e7ef07800 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:45.611051 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6f66c-a73e-4c3f-82a9-5b1c6d0415ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:45.611719 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6f66c-a73e-4c3f-82a9-5b1c6d0415ee None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:45.612027 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6f66c-a73e-4c3f-82a9-5b1c6d0415ee None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:45.612307 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6f66c-a73e-4c3f-82a9-5b1c6d0415ee None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:45.613026 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6f66c-a73e-4c3f-82a9-5b1c6d0415ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:45.613335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6f66c-a73e-4c3f-82a9-5b1c6d0415ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:45.615872 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6f66c-a73e-4c3f-82a9-5b1c6d0415ee None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:45.634889 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 602/1216] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:45.635071 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4eda2-28d2-40ef-8c69-ef145b3daed8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:45.710053 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:45.745588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4eda2-28d2-40ef-8c69-ef145b3daed8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:45.783503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450cfe8-d292-4cd0-a70f-8fb1e8a895da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:45.784554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450cfe8-d292-4cd0-a70f-8fb1e8a895da None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:45.784901 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450cfe8-d292-4cd0-a70f-8fb1e8a895da None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:45.785361 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450cfe8-d292-4cd0-a70f-8fb1e8a895da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:45.794334 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450cfe8-d292-4cd0-a70f-8fb1e8a895da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:45.795776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450cfe8-d292-4cd0-a70f-8fb1e8a895da None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:45.812454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-c450cfe8-d292-4cd0-a70f-8fb1e8a895da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:45.812454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:45.812454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:45.812454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:45.812454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:45.812454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:45.812454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:45.812454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:45.812454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:45.812454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:45.812454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:45.812454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:45.812454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:45.812454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:45.812454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:45.813622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:45.813622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:45.813622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:45.813622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:45.813622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:45.813622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:45.813622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:45.813622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:45.813622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:58:45.813622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:45.813622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:45.813622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:45.813622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:45.813622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:45.813622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:45.813622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:45.813622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:45.814507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:45.814507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:45.814507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:45.814507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:45.814507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:45.814507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:45.814507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:45.814507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:58:45.814507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 615/1217] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:58:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:45.819658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6f66c-a73e-4c3f-82a9-5b1c6d0415ee None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:45.936987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6f66c-a73e-4c3f-82a9-5b1c6d0415ee None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:45.965017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:45.980796 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc279e06-be24-47a2-9760-8b97afa8461d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:45.981464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc279e06-be24-47a2-9760-8b97afa8461d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:45.981746 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc279e06-be24-47a2-9760-8b97afa8461d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:45.982024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc279e06-be24-47a2-9760-8b97afa8461d None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:45.982818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc279e06-be24-47a2-9760-8b97afa8461d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:45.983131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc279e06-be24-47a2-9760-8b97afa8461d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:45.984614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc279e06-be24-47a2-9760-8b97afa8461d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:46.002192 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 603/1218] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:58:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:46.003509 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450cfe8-d292-4cd0-a70f-8fb1e8a895da None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:46.114534 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450cfe8-d292-4cd0-a70f-8fb1e8a895da None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:46.155034 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:46.164200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce00e10-2fd4-4a23-8492-cf03a620dcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:46.164948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce00e10-2fd4-4a23-8492-cf03a620dcea None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:46.165308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce00e10-2fd4-4a23-8492-cf03a620dcea None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:46.165682 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce00e10-2fd4-4a23-8492-cf03a620dcea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:46.166597 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce00e10-2fd4-4a23-8492-cf03a620dcea None admin] RBAC: Adding query filter params (role.id=d21329f1cd364fba8b79529896e00f81, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=e9cccb366fc6429e9a30d4f9de64e8f8) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:46.167552 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce00e10-2fd4-4a23-8492-cf03a620dcea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:46.169321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce00e10-2fd4-4a23-8492-cf03a620dcea None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:46.179979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 616/1219] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:58:46 2022] GET /identity/v3/role_assignments?user.id=e9cccb366fc6429e9a30d4f9de64e8f8&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=d21329f1cd364fba8b79529896e00f81 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:48.552541 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223787a-594c-4805-ae6b-55d441f02dca None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:48.553387 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223787a-594c-4805-ae6b-55d441f02dca None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:48.553746 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223787a-594c-4805-ae6b-55d441f02dca None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:48.555364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 604/1220] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:58:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:48.565594 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6075d83-7b12-4098-a714-50da690ebb1c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:48.566152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6075d83-7b12-4098-a714-50da690ebb1c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:48.566505 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6075d83-7b12-4098-a714-50da690ebb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:48.592172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b6075d83-7b12-4098-a714-50da690ebb1c None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:48.594132 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b6075d83-7b12-4098-a714-50da690ebb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:48.705686 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 617/1221] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:58:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:48.730541 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223787a-594c-4805-ae6b-55d441f02dca None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:48.861790 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223787a-594c-4805-ae6b-55d441f02dca None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:48.899844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f2146-5d08-43ec-9935-2a7f760af68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:48.900887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f2146-5d08-43ec-9935-2a7f760af68a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:48.901799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f2146-5d08-43ec-9935-2a7f760af68a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:48.902190 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f2146-5d08-43ec-9935-2a7f760af68a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:48.914920 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f2146-5d08-43ec-9935-2a7f760af68a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:48.924836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-178f2146-5d08-43ec-9935-2a7f760af68a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:58:48.924836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:48.924836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:48.924836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:48.924836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:48.924836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:48.924836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:48.924836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:48.924836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:48.924836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:48.924836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:48.924836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:48.924836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:48.924836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:48.924836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:48.924836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:48.925918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:48.925918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:48.925918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:48.925918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:48.925918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:48.925918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:48.925918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:48.925918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:48.925918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:48.925918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:48.925918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:48.925918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:58:48.925918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:48.925918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:48.925918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:48.925918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:48.926825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:48.926825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:48.926825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:48.926825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:48.926825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:48.926825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:48.926825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:48.926825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:48.926825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:48.926825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:48.926825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:58:48.926825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:58:48.926825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 605/1222] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:58:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:48.932533 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6075d83-7b12-4098-a714-50da690ebb1c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:49.056012 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6075d83-7b12-4098-a714-50da690ebb1c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:49.089311 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:49.102192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ac3a6-e581-4e68-967b-0e8b9a899969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:49.102933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ac3a6-e581-4e68-967b-0e8b9a899969 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:49.103233 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ac3a6-e581-4e68-967b-0e8b9a899969 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:49.103528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ac3a6-e581-4e68-967b-0e8b9a899969 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:49.104938 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ac3a6-e581-4e68-967b-0e8b9a899969 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:49.105930 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ac3a6-e581-4e68-967b-0e8b9a899969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:49.106947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ac3a6-e581-4e68-967b-0e8b9a899969 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:49.119969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 618/1223] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:58:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:49.122363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f2146-5d08-43ec-9935-2a7f760af68a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:49.188378 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:49.252238 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f2146-5d08-43ec-9935-2a7f760af68a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:49.287988 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a4bc7-c9ad-4c38-8b4a-015085089d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:49.288833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a4bc7-c9ad-4c38-8b4a-015085089d45 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:49.289122 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a4bc7-c9ad-4c38-8b4a-015085089d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:49.289468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a4bc7-c9ad-4c38-8b4a-015085089d45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:49.301296 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a4bc7-c9ad-4c38-8b4a-015085089d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:49.302740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a4bc7-c9ad-4c38-8b4a-015085089d45 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:49.320113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-1e8a4bc7-c9ad-4c38-8b4a-015085089d45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:49.320113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:49.320113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:49.320113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:49.320113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:49.320113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:49.320113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:49.320113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:49.320113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:49.320113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:49.320113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:49.320113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:49.320113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:49.320113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:49.320113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:49.321372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:49.321372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:49.321372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:49.321372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:49.321372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:49.321372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:49.321372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:49.321372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:49.321372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:58:49.321372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:49.321372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:49.321372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:49.321372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:49.321372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:49.321372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:49.321372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:49.321372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:49.322562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:49.322562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:49.322562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:49.322562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:58:49.322562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 606/1224] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:49.327846 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ac3a6-e581-4e68-967b-0e8b9a899969 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:49.442306 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ac3a6-e581-4e68-967b-0e8b9a899969 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:49.479174 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e5b20-a6a1-48af-8ee7-21024ee39d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:49.480027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e5b20-a6a1-48af-8ee7-21024ee39d16 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:49.480320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e5b20-a6a1-48af-8ee7-21024ee39d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:49.480607 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e5b20-a6a1-48af-8ee7-21024ee39d16 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:49.481455 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e5b20-a6a1-48af-8ee7-21024ee39d16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:49.481893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e5b20-a6a1-48af-8ee7-21024ee39d16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:49.483524 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e5b20-a6a1-48af-8ee7-21024ee39d16 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:49.497052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 619/1225] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:49.502717 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a4bc7-c9ad-4c38-8b4a-015085089d45 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:49.610908 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:49.618900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a4bc7-c9ad-4c38-8b4a-015085089d45 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:49.658899 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11eda60-681a-4b8e-8d49-0a2972d0a139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:49.659699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eda60-681a-4b8e-8d49-0a2972d0a139 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:49.660014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eda60-681a-4b8e-8d49-0a2972d0a139 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:49.660293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eda60-681a-4b8e-8d49-0a2972d0a139 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:49.667895 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11eda60-681a-4b8e-8d49-0a2972d0a139 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:49.669794 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11eda60-681a-4b8e-8d49-0a2972d0a139 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:49.687289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e11eda60-681a-4b8e-8d49-0a2972d0a139 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 11:58:49.687289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:49.687289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:49.687289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:49.687289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:49.687289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:49.687289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:49.687289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:49.687289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:49.687289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:49.687289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:49.687289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:49.687289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:49.687289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:49.687289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:49.687289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:49.688547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:49.689697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:49.689697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:49.689697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:49.689697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:49.689697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:49.689697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:49.689697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:49.689697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:49.689697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 11:58:49.689697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:58:49.689697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 607/1226] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:58:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:49.694596 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e5b20-a6a1-48af-8ee7-21024ee39d16 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:49.745977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:49.811431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e5b20-a6a1-48af-8ee7-21024ee39d16 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:49.858828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515c4d1-dd71-4773-89a7-2cf442cfad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:49.859510 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c4d1-dd71-4773-89a7-2cf442cfad3c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:49.859803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c4d1-dd71-4773-89a7-2cf442cfad3c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:49.860127 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c4d1-dd71-4773-89a7-2cf442cfad3c None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:49.861024 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515c4d1-dd71-4773-89a7-2cf442cfad3c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:49.866989 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515c4d1-dd71-4773-89a7-2cf442cfad3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:49.870683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515c4d1-dd71-4773-89a7-2cf442cfad3c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:49.891662 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 620/1227] 10.222.0.73 () {56 vars in 1143 bytes} [Thu May 19 11:58:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:49.897508 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11eda60-681a-4b8e-8d49-0a2972d0a139 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:50.017957 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11eda60-681a-4b8e-8d49-0a2972d0a139 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:50.066184 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81533db3-f24b-44fc-bfe4-bd82efd97a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:50.067343 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81533db3-f24b-44fc-bfe4-bd82efd97a54 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:50.067793 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81533db3-f24b-44fc-bfe4-bd82efd97a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:50.068282 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81533db3-f24b-44fc-bfe4-bd82efd97a54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:50.087168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81533db3-f24b-44fc-bfe4-bd82efd97a54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:50.087168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81533db3-f24b-44fc-bfe4-bd82efd97a54 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:50.109767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-81533db3-f24b-44fc-bfe4-bd82efd97a54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:50.109767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:50.109767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:50.109767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:50.109767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:50.109767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:50.109767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:50.109767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:50.109767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:50.109767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:50.109767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:50.109767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:50.109767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:50.109767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:50.109767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:50.110953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:50.110953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:50.110953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:50.110953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:50.110953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:50.110953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:50.110953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:50.110953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:50.110953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:58:50.110953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:50.110953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:50.110953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:50.110953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:50.110953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:50.110953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:50.110953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:50.110953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:50.111896 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:50.111896 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:50.111896 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:50.111896 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:58:50.111896 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 608/1228] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:50.117549 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515c4d1-dd71-4773-89a7-2cf442cfad3c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:50.228512 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515c4d1-dd71-4773-89a7-2cf442cfad3c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:50.231390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:50.267368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bc270-08f4-4d05-93db-3fa3ff560d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:50.268154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc270-08f4-4d05-93db-3fa3ff560d34 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:50.268506 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc270-08f4-4d05-93db-3fa3ff560d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:50.268849 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc270-08f4-4d05-93db-3fa3ff560d34 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:50.269785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bc270-08f4-4d05-93db-3fa3ff560d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:50.270253 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bc270-08f4-4d05-93db-3fa3ff560d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:50.271878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bc270-08f4-4d05-93db-3fa3ff560d34 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:50.286244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 621/1229] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:58:50.293811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81533db3-f24b-44fc-bfe4-bd82efd97a54 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:50.304225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:50.415978 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81533db3-f24b-44fc-bfe4-bd82efd97a54 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:50.456947 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c36b78-31d6-4def-9fd0-3e6efbc2d3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:50.458220 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c36b78-31d6-4def-9fd0-3e6efbc2d3bf None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:50.458728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c36b78-31d6-4def-9fd0-3e6efbc2d3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:50.459356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c36b78-31d6-4def-9fd0-3e6efbc2d3bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:50.470028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c36b78-31d6-4def-9fd0-3e6efbc2d3bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:50.472019 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c36b78-31d6-4def-9fd0-3e6efbc2d3bf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:50.496384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f1c36b78-31d6-4def-9fd0-3e6efbc2d3bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:50.496384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:50.496384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:50.496384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:50.496384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:50.496384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:50.496384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:50.496384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:50.496384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:50.496384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:50.496384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:50.496384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:50.496384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:50.496384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:50.496384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:50.497521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:50.497521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:50.497521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:50.497521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:50.497521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:50.497521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:50.497521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:50.497521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:50.497521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:58:50.497521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:50.497521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:50.497521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:50.497521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:50.497521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:50.497521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:50.497521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:50.497521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:50.498652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:50.498652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:50.498652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:50.498652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:50.498652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:50.498652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:50.498652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:50.498652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:58:50.498652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 609/1230] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:58:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:50.508808 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bc270-08f4-4d05-93db-3fa3ff560d34 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:50.626609 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bc270-08f4-4d05-93db-3fa3ff560d34 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:50.664263 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e959a-4348-4cf6-a733-588145fecc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:50.664855 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e959a-4348-4cf6-a733-588145fecc58 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:50.665151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e959a-4348-4cf6-a733-588145fecc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:50.665423 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e959a-4348-4cf6-a733-588145fecc58 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:50.666377 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e959a-4348-4cf6-a733-588145fecc58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:50.667247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e959a-4348-4cf6-a733-588145fecc58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:50.668862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e959a-4348-4cf6-a733-588145fecc58 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:50.682926 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 622/1231] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:58:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:50.688953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c36b78-31d6-4def-9fd0-3e6efbc2d3bf None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:50.760902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:50.797883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c36b78-31d6-4def-9fd0-3e6efbc2d3bf None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:50.836596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4e4da-f91d-430e-b5e5-f7eda3815b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:50.837563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4e4da-f91d-430e-b5e5-f7eda3815b39 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:50.837882 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4e4da-f91d-430e-b5e5-f7eda3815b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:50.838144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4e4da-f91d-430e-b5e5-f7eda3815b39 None admin] PATH_INFO: `/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/e9cccb366fc6429e9a30d4f9de64e8f8/roles/d21329f1cd364fba8b79529896e00f81` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:50.855754 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4e4da-f91d-430e-b5e5-f7eda3815b39 None admin] RBAC: Authorizing `identity:create_grant(project_id=d90551d9446e4f2cbd14312d2af9f7c9, user_id=e9cccb366fc6429e9a30d4f9de64e8f8, role_id=d21329f1cd364fba8b79529896e00f81)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:50.857493 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4e4da-f91d-430e-b5e5-f7eda3815b39 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:50.870448 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 610/1232] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:58:50 2022] PUT /identity/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/e9cccb366fc6429e9a30d4f9de64e8f8/roles/d21329f1cd364fba8b79529896e00f81 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:58:53.089819 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc1829-c5c0-4abc-957f-d80c83053f6c None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:53.090478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc1829-c5c0-4abc-957f-d80c83053f6c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:53.090478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc1829-c5c0-4abc-957f-d80c83053f6c None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:53.091750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 623/1233] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:58:53.097166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800708f-ea4c-4eb3-ac17-f16762278225 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:53.097591 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800708f-ea4c-4eb3-ac17-f16762278225 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:53.097771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800708f-ea4c-4eb3-ac17-f16762278225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:53.115520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1800708f-ea4c-4eb3-ac17-f16762278225 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:53.116824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1800708f-ea4c-4eb3-ac17-f16762278225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:53.200060 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 611/1234] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:58:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:58:53.223731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc1829-c5c0-4abc-957f-d80c83053f6c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:53.253123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:53.339815 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc1829-c5c0-4abc-957f-d80c83053f6c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:53.377334 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2b964-56eb-4e07-b569-df0c8eed0cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:53.377535 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2b964-56eb-4e07-b569-df0c8eed0cce None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:53.377821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2b964-56eb-4e07-b569-df0c8eed0cce None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:53.378100 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2b964-56eb-4e07-b569-df0c8eed0cce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:53.389408 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2b964-56eb-4e07-b569-df0c8eed0cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:53.397851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-77e2b964-56eb-4e07-b569-df0c8eed0cce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 11:58:53.397851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:53.397851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:53.397851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:53.397851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:53.397851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:53.397851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:53.397851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:53.397851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:53.397851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:53.397851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:53.397851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:53.397851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:53.397851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:53.397851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:53.397851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:53.399031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:53.399031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:53.399031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:53.399031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:53.399031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:53.399031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:53.399031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:53.399031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:53.399031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:53.399031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:53.399031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:53.399031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:58:53.399031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:53.399031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:53.399031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:53.399031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:53.399965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:53.399965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:53.399965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:53.399965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:53.399965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:53.399965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:53.399965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:53.399965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:53.399965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:53.399965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:53.399965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 11:58:53.399965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:58:53.407300 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 624/1235] 10.222.0.73 () {56 vars in 1102 bytes} [Thu May 19 11:58:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:53.407460 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800708f-ea4c-4eb3-ac17-f16762278225 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:53.455818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:53.513640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800708f-ea4c-4eb3-ac17-f16762278225 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:53.548901 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666a879-8e85-4f3d-861f-5e626e9dd5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:53.549571 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666a879-8e85-4f3d-861f-5e626e9dd5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:53.549853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666a879-8e85-4f3d-861f-5e626e9dd5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:53.550127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666a879-8e85-4f3d-861f-5e626e9dd5e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:53.550903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666a879-8e85-4f3d-861f-5e626e9dd5e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:53.551210 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666a879-8e85-4f3d-861f-5e626e9dd5e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:53.552613 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666a879-8e85-4f3d-861f-5e626e9dd5e4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:53.563982 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 612/1236] 10.222.0.73 () {56 vars in 1103 bytes} [Thu May 19 11:58:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:53.569387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2b964-56eb-4e07-b569-df0c8eed0cce None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:53.664206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:53.682882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2b964-56eb-4e07-b569-df0c8eed0cce None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:53.723826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646855d-8e22-4454-b340-83f4b7099058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:53.724639 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646855d-8e22-4454-b340-83f4b7099058 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:53.724934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646855d-8e22-4454-b340-83f4b7099058 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:53.725217 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646855d-8e22-4454-b340-83f4b7099058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:53.737400 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646855d-8e22-4454-b340-83f4b7099058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:53.738957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646855d-8e22-4454-b340-83f4b7099058 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:53.757560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-e646855d-8e22-4454-b340-83f4b7099058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:53.757560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:53.757560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:53.757560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:53.757560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:53.757560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:53.757560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:53.757560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:53.757560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:53.757560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:53.757560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:53.757560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:53.757560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:53.757560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:53.757560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:53.758536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:53.758536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:53.758536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:53.758536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:53.758536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:53.758536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:53.758536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:53.758536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:53.758536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:58:53.758536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:53.758536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:53.758536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:53.758536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:53.758536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:53.758536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:53.758536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:53.758536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:53.759439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:53.759439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:53.759439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:53.759439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:58:53.759439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 625/1237] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:53.764758 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666a879-8e85-4f3d-861f-5e626e9dd5e4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:53.879412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666a879-8e85-4f3d-861f-5e626e9dd5e4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:53.888735 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:53.915477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08e971-2926-488e-8c6c-d0f167cf930c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:53.916114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08e971-2926-488e-8c6c-d0f167cf930c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:53.916918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08e971-2926-488e-8c6c-d0f167cf930c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:53.917200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08e971-2926-488e-8c6c-d0f167cf930c None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:53.917919 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08e971-2926-488e-8c6c-d0f167cf930c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:53.918229 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08e971-2926-488e-8c6c-d0f167cf930c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:53.919846 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08e971-2926-488e-8c6c-d0f167cf930c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:53.931542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 613/1238] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:53.937947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646855d-8e22-4454-b340-83f4b7099058 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:54.045807 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646855d-8e22-4454-b340-83f4b7099058 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:54.088047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601ed3f-5182-4dd5-9d9a-705dc98da2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:54.089399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601ed3f-5182-4dd5-9d9a-705dc98da2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:54.089688 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601ed3f-5182-4dd5-9d9a-705dc98da2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:54.089971 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601ed3f-5182-4dd5-9d9a-705dc98da2b5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:54.093293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:54.099908 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601ed3f-5182-4dd5-9d9a-705dc98da2b5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:54.101808 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601ed3f-5182-4dd5-9d9a-705dc98da2b5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:54.117892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-8601ed3f-5182-4dd5-9d9a-705dc98da2b5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 11:58:54.117892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:54.117892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:54.117892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:54.117892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:54.117892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:54.117892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:54.117892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:54.117892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:54.117892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:54.117892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:54.117892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:54.117892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:54.117892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:54.117892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:54.117892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:54.118902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:54.119873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:54.119873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:54.119873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:54.119873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:54.119873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:54.119873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:54.119873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:54.119873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:54.119873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 11:58:54.119873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:58:54.119873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 626/1239] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:58:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:54.125861 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08e971-2926-488e-8c6c-d0f167cf930c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:54.250370 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08e971-2926-488e-8c6c-d0f167cf930c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:54.290186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e8ced-0c74-4bee-a225-f188a13e0ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:54.290884 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e8ced-0c74-4bee-a225-f188a13e0ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:54.291191 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e8ced-0c74-4bee-a225-f188a13e0ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:54.291551 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e8ced-0c74-4bee-a225-f188a13e0ad4 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:54.292918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e8ced-0c74-4bee-a225-f188a13e0ad4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:54.293225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e8ced-0c74-4bee-a225-f188a13e0ad4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:54.294947 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e8ced-0c74-4bee-a225-f188a13e0ad4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:54.312597 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 614/1240] 10.222.0.73 () {56 vars in 1143 bytes} [Thu May 19 11:58:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:54.318979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601ed3f-5182-4dd5-9d9a-705dc98da2b5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:54.431487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601ed3f-5182-4dd5-9d9a-705dc98da2b5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:54.471228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ef10b-8444-4ec3-aa80-e95d2522375a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:54.471882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ef10b-8444-4ec3-aa80-e95d2522375a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:54.472206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ef10b-8444-4ec3-aa80-e95d2522375a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:54.472482 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ef10b-8444-4ec3-aa80-e95d2522375a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:54.539334 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:54.546797 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ef10b-8444-4ec3-aa80-e95d2522375a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:54.548310 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ef10b-8444-4ec3-aa80-e95d2522375a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:54.657022 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 627/1241] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:58:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:58:54.662840 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e8ced-0c74-4bee-a225-f188a13e0ad4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:54.689829 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:54.774193 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e8ced-0c74-4bee-a225-f188a13e0ad4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:54.815395 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995532f-f7b3-4351-bb3a-aa3c94c76a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:54.816299 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995532f-f7b3-4351-bb3a-aa3c94c76a69 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:54.816589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995532f-f7b3-4351-bb3a-aa3c94c76a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:54.816869 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995532f-f7b3-4351-bb3a-aa3c94c76a69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:54.828816 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995532f-f7b3-4351-bb3a-aa3c94c76a69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:54.830392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995532f-f7b3-4351-bb3a-aa3c94c76a69 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:54.850536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-5995532f-f7b3-4351-bb3a-aa3c94c76a69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:54.850536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:54.850536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:54.850536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:54.850536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:54.850536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:54.850536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:54.850536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:54.850536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:54.850536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:54.850536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:54.850536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:54.850536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:54.850536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:54.850536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:54.851577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:54.851577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:54.851577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:54.851577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:54.851577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:54.851577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:54.851577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:54.851577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:54.851577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:58:54.851577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:54.851577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:54.851577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:54.851577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:54.851577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:54.851577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:54.851577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:54.851577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:54.853198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:54.853198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:54.853198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:54.853198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:58:54.853198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 615/1242] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:54.858303 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ef10b-8444-4ec3-aa80-e95d2522375a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:54.961965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:54.968882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ef10b-8444-4ec3-aa80-e95d2522375a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:55.006964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbd6c9-faf0-49ed-8399-31933cf9e5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:55.007763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbd6c9-faf0-49ed-8399-31933cf9e5fe None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:55.008085 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbd6c9-faf0-49ed-8399-31933cf9e5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:55.008385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbd6c9-faf0-49ed-8399-31933cf9e5fe None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:55.009124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbd6c9-faf0-49ed-8399-31933cf9e5fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:55.009430 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbd6c9-faf0-49ed-8399-31933cf9e5fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:55.011389 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbd6c9-faf0-49ed-8399-31933cf9e5fe None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:55.024125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 628/1243] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:55.029806 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995532f-f7b3-4351-bb3a-aa3c94c76a69 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:55.113252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:55.139951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995532f-f7b3-4351-bb3a-aa3c94c76a69 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:55.182611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c916bd-1522-4d76-96bc-46421f459462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:55.183500 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c916bd-1522-4d76-96bc-46421f459462 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:55.184067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c916bd-1522-4d76-96bc-46421f459462 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:55.184334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c916bd-1522-4d76-96bc-46421f459462 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:55.192246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c916bd-1522-4d76-96bc-46421f459462 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:55.193856 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c916bd-1522-4d76-96bc-46421f459462 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:55.211136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-c5c916bd-1522-4d76-96bc-46421f459462 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:55.211136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:55.211136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:55.211136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:55.211136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:55.211136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:55.211136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:55.211136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:55.211136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:55.211136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:55.211136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:55.211136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:55.211136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:58:55.211136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:58:55.211136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:58:55.212463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:58:55.212463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:55.212463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:55.212463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:55.212463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:55.212463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:55.212463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:55.212463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:55.212463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:58:55.212463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:55.212463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:55.212463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:55.212463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:55.212463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:55.212463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:55.212463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:55.212463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:55.213937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:58:55.213937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:58:55.213937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:58:55.213937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:58:55.213937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:58:55.213937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:58:55.213937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:58:55.213937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:58:55.213937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 616/1244] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:58:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:55.218183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbd6c9-faf0-49ed-8399-31933cf9e5fe None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:55.333206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbd6c9-faf0-49ed-8399-31933cf9e5fe None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:55.373469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb772c-7253-41b1-b620-00874a31b2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:55.374191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb772c-7253-41b1-b620-00874a31b2fe None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:55.374477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb772c-7253-41b1-b620-00874a31b2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:55.374773 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb772c-7253-41b1-b620-00874a31b2fe None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:55.375681 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb772c-7253-41b1-b620-00874a31b2fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:55.377013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb772c-7253-41b1-b620-00874a31b2fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:55.377643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb772c-7253-41b1-b620-00874a31b2fe None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:55.390554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 629/1245] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:58:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:55.396939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c916bd-1522-4d76-96bc-46421f459462 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:55.507208 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c916bd-1522-4d76-96bc-46421f459462 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:55.542743 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bd380-a4ad-4859-bce9-7cef59a724be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:55.543399 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bd380-a4ad-4859-bce9-7cef59a724be None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:55.543682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bd380-a4ad-4859-bce9-7cef59a724be None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:55.544237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bd380-a4ad-4859-bce9-7cef59a724be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:55.545071 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03bd380-a4ad-4859-bce9-7cef59a724be None admin] RBAC: Adding query filter params (role.id=d21329f1cd364fba8b79529896e00f81, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=e9cccb366fc6429e9a30d4f9de64e8f8) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:55.545383 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03bd380-a4ad-4859-bce9-7cef59a724be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:55.547071 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03bd380-a4ad-4859-bce9-7cef59a724be None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:55.567951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 617/1246] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:58:55 2022] GET /identity/v3/role_assignments?user.id=e9cccb366fc6429e9a30d4f9de64e8f8&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=d21329f1cd364fba8b79529896e00f81 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:57.915472 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec118c6-5cd4-4a34-868b-d0b5715be4b5 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:57.916035 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec118c6-5cd4-4a34-868b-d0b5715be4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:57.916035 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec118c6-5cd4-4a34-868b-d0b5715be4b5 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:57.917455 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 630/1247] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:58:57.923073 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330a12c-5df7-41eb-b81f-9bc998de50be None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:57.923511 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330a12c-5df7-41eb-b81f-9bc998de50be None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:57.923641 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330a12c-5df7-41eb-b81f-9bc998de50be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:57.928944 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:57.943173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-7330a12c-5df7-41eb-b81f-9bc998de50be None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:58:57.944429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7330a12c-5df7-41eb-b81f-9bc998de50be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:58:58.025728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 618/1248] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:58:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:58:58.052453 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec118c6-5cd4-4a34-868b-d0b5715be4b5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:58.072145 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:58.171815 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec118c6-5cd4-4a34-868b-d0b5715be4b5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:58.212330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36799a-0ced-42fd-bf7e-1393134a9108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:58.213168 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36799a-0ced-42fd-bf7e-1393134a9108 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:58.213452 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36799a-0ced-42fd-bf7e-1393134a9108 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:58.213730 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36799a-0ced-42fd-bf7e-1393134a9108 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:58.225502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36799a-0ced-42fd-bf7e-1393134a9108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:58:58.234333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-3d36799a-0ced-42fd-bf7e-1393134a9108 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:58.234333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:58.234333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:58.234333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:58.234333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:58.234333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:58.234333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:58.234333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:58.234333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:58.234333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:58.234333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:58.234333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:58.234333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:58:58.234333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:58:58.234333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:58:58.234333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:58:58.235486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:58:58.235486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:58:58.235486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:58:58.235486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:58:58.235486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:58.235486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:58.235486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:58.235486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:58.235486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:58.235486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:58.235486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:58.235486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:58:58.235486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:58.235486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:58.235486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:58.235486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:58.236550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:58.236550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:58.236550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:58.236550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:58.236550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:58:58.236550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:58:58.236550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:58:58.236550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:58:58.236550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:58:58.236550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:58:58.236550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:58:58.236550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:58:58.236550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 631/1249] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:58:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:58.242197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330a12c-5df7-41eb-b81f-9bc998de50be None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:58.354603 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330a12c-5df7-41eb-b81f-9bc998de50be None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:58.386670 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:58.393107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d911d-2945-45f4-8ee8-d9dd7da5e4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:58.394224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d911d-2945-45f4-8ee8-d9dd7da5e4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:58.394515 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d911d-2945-45f4-8ee8-d9dd7da5e4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:58.394834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d911d-2945-45f4-8ee8-d9dd7da5e4b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:58.395888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d911d-2945-45f4-8ee8-d9dd7da5e4b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:58.396398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d911d-2945-45f4-8ee8-d9dd7da5e4b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:58.398340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d911d-2945-45f4-8ee8-d9dd7da5e4b4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:58.407168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 619/1250] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:58.412927 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36799a-0ced-42fd-bf7e-1393134a9108 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:58.507209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:58.533354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36799a-0ced-42fd-bf7e-1393134a9108 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:58.571302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55392e25-bd60-4730-ba3d-e256be420e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:58.572134 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55392e25-bd60-4730-ba3d-e256be420e81 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:58.572457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55392e25-bd60-4730-ba3d-e256be420e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:58.572824 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55392e25-bd60-4730-ba3d-e256be420e81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:58.584168 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55392e25-bd60-4730-ba3d-e256be420e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:58.585762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55392e25-bd60-4730-ba3d-e256be420e81 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:58.604537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-55392e25-bd60-4730-ba3d-e256be420e81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:58.604537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:58.604537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:58.604537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:58.604537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:58.604537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:58.604537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:58.604537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:58.604537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:58.604537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:58.604537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:58.604537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:58.604537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:58.604537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:58.604537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:58.605624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:58.605624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:58.605624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:58.605624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:58.605624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:58.605624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:58.605624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:58.605624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:58.605624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:58:58.605624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:58.605624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:58.605624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:58.605624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:58.605624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:58.605624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:58.605624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:58.605624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:58.606739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:58.606739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:58.606739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:58.606739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:58:58.606739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 632/1251] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:58.612126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d911d-2945-45f4-8ee8-d9dd7da5e4b4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:58.725061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d911d-2945-45f4-8ee8-d9dd7da5e4b4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:58.770823 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ede15c-d621-4836-8859-00d1a6c5f253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:58.771489 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ede15c-d621-4836-8859-00d1a6c5f253 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:58.771778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ede15c-d621-4836-8859-00d1a6c5f253 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:58.772090 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ede15c-d621-4836-8859-00d1a6c5f253 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:58.772825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ede15c-d621-4836-8859-00d1a6c5f253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:58.773134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ede15c-d621-4836-8859-00d1a6c5f253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:58.774504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ede15c-d621-4836-8859-00d1a6c5f253 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:58.788506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 620/1252] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:58.794987 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55392e25-bd60-4730-ba3d-e256be420e81 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:58.903859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55392e25-bd60-4730-ba3d-e256be420e81 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:58.933421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:58.941618 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49c31-41f9-4955-b5bc-cec6d85ca709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:58.942438 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49c31-41f9-4955-b5bc-cec6d85ca709 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:58.942782 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49c31-41f9-4955-b5bc-cec6d85ca709 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:58.943143 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49c31-41f9-4955-b5bc-cec6d85ca709 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:58.953047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad49c31-41f9-4955-b5bc-cec6d85ca709 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:58.954490 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad49c31-41f9-4955-b5bc-cec6d85ca709 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:58.972882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-5ad49c31-41f9-4955-b5bc-cec6d85ca709 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 11:58:58.972882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:58.972882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:58.972882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:58.972882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:58.972882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:58.972882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:58.972882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:58.972882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:58.972882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:58.972882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:58.972882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:58.972882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:58:58.972882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:58:58.972882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:58:58.972882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:58.974017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:58.975153 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:58.975153 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:58.975153 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:58:58.975153 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:58:58.975153 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:58:58.975153 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:58:58.975153 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:58:58.975153 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:58:58.975153 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 11:58:58.975153 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:58:58.975153 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 633/1253] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:58:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:58:58.981827 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ede15c-d621-4836-8859-00d1a6c5f253 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:59.040107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:59.087363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ede15c-d621-4836-8859-00d1a6c5f253 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:59.126156 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29a7d7-0889-42b5-8f51-2149ee430081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:59.126821 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29a7d7-0889-42b5-8f51-2149ee430081 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:59.127100 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29a7d7-0889-42b5-8f51-2149ee430081 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:59.127371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29a7d7-0889-42b5-8f51-2149ee430081 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:59.128363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29a7d7-0889-42b5-8f51-2149ee430081 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:59.128662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29a7d7-0889-42b5-8f51-2149ee430081 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:59.130234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29a7d7-0889-42b5-8f51-2149ee430081 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:59.156738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 621/1254] 10.222.0.73 () {56 vars in 1143 bytes} [Thu May 19 11:58:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:59.157863 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49c31-41f9-4955-b5bc-cec6d85ca709 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:59.280093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49c31-41f9-4955-b5bc-cec6d85ca709 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:59.317979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c86fe-1547-465c-ac8c-a2292a094b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:59.318651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c86fe-1547-465c-ac8c-a2292a094b9e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:59.318935 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c86fe-1547-465c-ac8c-a2292a094b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:59.319241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c86fe-1547-465c-ac8c-a2292a094b9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:59.399048 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:59.416136 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c86fe-1547-465c-ac8c-a2292a094b9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:59.418064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c86fe-1547-465c-ac8c-a2292a094b9e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:59.546059 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 634/1255] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:58:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:58:59.553100 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29a7d7-0889-42b5-8f51-2149ee430081 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:59.667261 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29a7d7-0889-42b5-8f51-2149ee430081 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:59.684920 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:59.709517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bfed8-42d1-4296-93a7-f748643c4711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:59.710322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bfed8-42d1-4296-93a7-f748643c4711 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:59.710613 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bfed8-42d1-4296-93a7-f748643c4711 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:59.710889 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bfed8-42d1-4296-93a7-f748643c4711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:59.722347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bfed8-42d1-4296-93a7-f748643c4711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:59.725106 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bfed8-42d1-4296-93a7-f748643c4711 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:59.746452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-823bfed8-42d1-4296-93a7-f748643c4711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:59.746452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:58:59.746452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:58:59.746452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:58:59.746452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:58:59.746452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:58:59.746452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:58:59.746452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:58:59.746452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:58:59.746452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:58:59.746452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:58:59.746452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:58:59.746452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:58:59.746452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:58:59.746452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:58:59.747847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:58:59.747847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:58:59.747847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:58:59.747847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:58:59.747847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:58:59.747847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:58:59.747847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:58:59.747847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:58:59.747847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:58:59.747847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:58:59.747847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:58:59.747847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:58:59.747847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:58:59.747847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:58:59.747847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:58:59.747847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:58:59.747847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:58:59.748915 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:58:59.748915 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:58:59.748915 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:58:59.748915 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:58:59.748915 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 622/1256] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 11:58:59.754331 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c86fe-1547-465c-ac8c-a2292a094b9e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:58:59.850214 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:58:59.864220 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c86fe-1547-465c-ac8c-a2292a094b9e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:58:59.902139 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03589128-34e0-4cd9-a5a9-f6d3dd2d0ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:58:59.902816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03589128-34e0-4cd9-a5a9-f6d3dd2d0ddb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:58:59.903256 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03589128-34e0-4cd9-a5a9-f6d3dd2d0ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:58:59.903755 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03589128-34e0-4cd9-a5a9-f6d3dd2d0ddb None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:58:59.905132 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03589128-34e0-4cd9-a5a9-f6d3dd2d0ddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:58:59.905652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03589128-34e0-4cd9-a5a9-f6d3dd2d0ddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:58:59.907502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03589128-34e0-4cd9-a5a9-f6d3dd2d0ddb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:58:59.921131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 635/1257] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:58:59.926872 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bfed8-42d1-4296-93a7-f748643c4711 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:00.036127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bfed8-42d1-4296-93a7-f748643c4711 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:00.073454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0836b-58dd-46cb-86ae-0342f3b3ca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:00.074239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0836b-58dd-46cb-86ae-0342f3b3ca2d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:00.074519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0836b-58dd-46cb-86ae-0342f3b3ca2d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:00.074794 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0836b-58dd-46cb-86ae-0342f3b3ca2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:00.081757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0836b-58dd-46cb-86ae-0342f3b3ca2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:00.083857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0836b-58dd-46cb-86ae-0342f3b3ca2d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:00.098599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-8fe0836b-58dd-46cb-86ae-0342f3b3ca2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:59:00.098599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:00.098599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:00.098599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:00.098599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:00.098599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:00.098599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:00.098599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:00.098599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:00.098599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:00.098599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:00.098599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:00.098599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:59:00.098599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:59:00.098599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:59:00.099698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:59:00.099698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:00.099698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:00.099698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:00.099698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:00.099698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:00.099698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:00.099698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:00.099698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:59:00.099698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:00.099698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:00.099698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:00.099698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:00.099698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:00.099698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:00.099698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:00.099698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:00.100836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:59:00.100836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:59:00.100836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:59:00.100836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:59:00.100836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:59:00.100836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:59:00.100836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:59:00.100836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:59:00.100836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 623/1258] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:58:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:00.106660 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03589128-34e0-4cd9-a5a9-f6d3dd2d0ddb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:00.216057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03589128-34e0-4cd9-a5a9-f6d3dd2d0ddb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:00.248302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7bbac-71d8-4646-9b99-07e80ef67801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:00.248965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7bbac-71d8-4646-9b99-07e80ef67801 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:00.249251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7bbac-71d8-4646-9b99-07e80ef67801 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:00.249532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7bbac-71d8-4646-9b99-07e80ef67801 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:00.250316 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7bbac-71d8-4646-9b99-07e80ef67801 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:00.250631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7bbac-71d8-4646-9b99-07e80ef67801 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:00.252075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7bbac-71d8-4646-9b99-07e80ef67801 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:00.263657 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 636/1259] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:59:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:00.270064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0836b-58dd-46cb-86ae-0342f3b3ca2d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:00.297135 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:00.368612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0836b-58dd-46cb-86ae-0342f3b3ca2d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:00.401362 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd5195-a711-4858-a0bf-6bfbb6d6570a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:00.402007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd5195-a711-4858-a0bf-6bfbb6d6570a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:00.402289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd5195-a711-4858-a0bf-6bfbb6d6570a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:00.402563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd5195-a711-4858-a0bf-6bfbb6d6570a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:00.403388 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd5195-a711-4858-a0bf-6bfbb6d6570a None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=e9cccb366fc6429e9a30d4f9de64e8f8) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:00.403699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd5195-a711-4858-a0bf-6bfbb6d6570a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:00.405165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd5195-a711-4858-a0bf-6bfbb6d6570a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:00.410463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 624/1260] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:59:00 2022] GET /identity/v3/role_assignments?user.id=e9cccb366fc6429e9a30d4f9de64e8f8&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:02.603449 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152dde3-c84a-4d71-aeec-92c6f0ad740e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:02.604043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152dde3-c84a-4d71-aeec-92c6f0ad740e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:02.604043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152dde3-c84a-4d71-aeec-92c6f0ad740e None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:02.605396 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 637/1261] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:02.610466 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12160b-80bd-4458-8ae4-083f20ccf30f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:02.610885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12160b-80bd-4458-8ae4-083f20ccf30f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:02.611029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12160b-80bd-4458-8ae4-083f20ccf30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:02.628080 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5a12160b-80bd-4458-8ae4-083f20ccf30f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:02.629201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5a12160b-80bd-4458-8ae4-083f20ccf30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:02.693236 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 625/1262] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:59:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:02.715376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152dde3-c84a-4d71-aeec-92c6f0ad740e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:02.725940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:02.815546 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152dde3-c84a-4d71-aeec-92c6f0ad740e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:02.852431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ed86c-529c-4ad2-89e4-27e99b6e9506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:02.853232 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ed86c-529c-4ad2-89e4-27e99b6e9506 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:02.853514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ed86c-529c-4ad2-89e4-27e99b6e9506 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:02.854318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ed86c-529c-4ad2-89e4-27e99b6e9506 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:02.864575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ed86c-529c-4ad2-89e4-27e99b6e9506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:59:02.873155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-fb0ed86c-529c-4ad2-89e4-27e99b6e9506 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:59:02.873155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:02.873155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:02.873155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:02.873155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:02.873155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:02.873155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:02.873155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:02.873155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:02.873155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:02.873155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:02.873155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:02.873155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:59:02.873155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:59:02.873155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:59:02.873155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:59:02.874243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:59:02.874243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:59:02.874243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:59:02.874243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:59:02.874243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:02.874243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:02.874243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:02.874243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:02.874243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:02.874243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:02.874243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:02.874243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:59:02.874243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:02.874243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:02.874243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:02.874243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:02.875276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:02.875276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:02.875276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:02.875276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:02.875276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:59:02.875276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:59:02.875276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:59:02.875276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:59:02.875276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:59:02.875276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:59:02.875276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:59:02.875276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:59:02.875276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 638/1263] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:59:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:02.882438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12160b-80bd-4458-8ae4-083f20ccf30f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:02.900152 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:02.977271 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12160b-80bd-4458-8ae4-083f20ccf30f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:03.010239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbf5ae-78de-43d2-9a78-4989a4283bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:03.010891 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbf5ae-78de-43d2-9a78-4989a4283bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:03.011175 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbf5ae-78de-43d2-9a78-4989a4283bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:03.011450 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbf5ae-78de-43d2-9a78-4989a4283bd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:03.012221 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbf5ae-78de-43d2-9a78-4989a4283bd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:03.012528 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbf5ae-78de-43d2-9a78-4989a4283bd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:03.013892 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbf5ae-78de-43d2-9a78-4989a4283bd0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:03.021613 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 626/1264] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:59:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:03.027225 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ed86c-529c-4ad2-89e4-27e99b6e9506 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:03.092248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:03.125209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ed86c-529c-4ad2-89e4-27e99b6e9506 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:03.159668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b86a2d-b4b8-4dca-bbad-1b510789366a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:03.160711 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b86a2d-b4b8-4dca-bbad-1b510789366a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:03.161000 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b86a2d-b4b8-4dca-bbad-1b510789366a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:03.161278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b86a2d-b4b8-4dca-bbad-1b510789366a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:03.174455 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b86a2d-b4b8-4dca-bbad-1b510789366a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:03.175906 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b86a2d-b4b8-4dca-bbad-1b510789366a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:03.193063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-45b86a2d-b4b8-4dca-bbad-1b510789366a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:59:03.193063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:03.193063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:03.193063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:03.193063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:03.193063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:03.193063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:03.193063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:03.193063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:03.193063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:03.193063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:03.193063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:03.193063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:59:03.193063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:59:03.193063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:59:03.194161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:59:03.194161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:03.194161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:03.194161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:03.194161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:03.194161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:03.194161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:03.194161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:03.194161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:59:03.194161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:03.194161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:03.194161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:03.194161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:03.194161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:03.194161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:03.194161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:03.194161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:03.195239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:59:03.195239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:59:03.195239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:59:03.195239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:59:03.195239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 639/1265] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:03.200063 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbf5ae-78de-43d2-9a78-4989a4283bd0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:03.280092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:03.299640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbf5ae-78de-43d2-9a78-4989a4283bd0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:03.330945 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e09dc-fc3b-475d-ab42-c9fe5258d960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:03.331586 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e09dc-fc3b-475d-ab42-c9fe5258d960 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:03.331865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e09dc-fc3b-475d-ab42-c9fe5258d960 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:03.332166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e09dc-fc3b-475d-ab42-c9fe5258d960 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:03.332875 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e09dc-fc3b-475d-ab42-c9fe5258d960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:03.333179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e09dc-fc3b-475d-ab42-c9fe5258d960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:03.334520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e09dc-fc3b-475d-ab42-c9fe5258d960 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:03.346269 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 627/1266] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:03.351826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b86a2d-b4b8-4dca-bbad-1b510789366a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:03.452166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b86a2d-b4b8-4dca-bbad-1b510789366a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:03.471563 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:03.486010 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a31bcd-8eaa-4e4d-85b6-4bc9c55d0fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:03.486808 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a31bcd-8eaa-4e4d-85b6-4bc9c55d0fcc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:03.487103 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a31bcd-8eaa-4e4d-85b6-4bc9c55d0fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:03.487385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a31bcd-8eaa-4e4d-85b6-4bc9c55d0fcc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:03.495531 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a31bcd-8eaa-4e4d-85b6-4bc9c55d0fcc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:03.497023 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a31bcd-8eaa-4e4d-85b6-4bc9c55d0fcc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:03.511483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-85a31bcd-8eaa-4e4d-85b6-4bc9c55d0fcc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 11:59:03.511483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:03.511483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:03.511483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:03.511483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:03.511483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:03.511483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:03.511483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:03.511483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:03.511483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:03.511483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:03.511483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:03.511483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:59:03.511483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:59:03.511483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:59:03.511483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:03.512623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:03.518152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:03.518152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:03.518152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:59:03.518152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:59:03.518152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:59:03.518152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:59:03.518152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:59:03.518152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:59:03.518152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 11:59:03.518152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:59:03.518152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 640/1267] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:59:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:03.518759 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e09dc-fc3b-475d-ab42-c9fe5258d960 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:03.614981 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e09dc-fc3b-475d-ab42-c9fe5258d960 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:03.647404 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0243d4-1ea7-4f3f-a386-984c28ad9dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:03.648092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0243d4-1ea7-4f3f-a386-984c28ad9dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:03.648377 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0243d4-1ea7-4f3f-a386-984c28ad9dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:03.648653 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0243d4-1ea7-4f3f-a386-984c28ad9dd8 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:03.649477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0243d4-1ea7-4f3f-a386-984c28ad9dd8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:03.649787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0243d4-1ea7-4f3f-a386-984c28ad9dd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:03.651742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0243d4-1ea7-4f3f-a386-984c28ad9dd8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:03.660011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:03.668575 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 628/1268] 10.222.0.73 () {56 vars in 1143 bytes} [Thu May 19 11:59:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:03.674254 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a31bcd-8eaa-4e4d-85b6-4bc9c55d0fcc None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:03.770985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a31bcd-8eaa-4e4d-85b6-4bc9c55d0fcc None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:03.804070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2692faa-59a8-4e31-be07-c018da61e366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:03.804857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2692faa-59a8-4e31-be07-c018da61e366 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:03.805142 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2692faa-59a8-4e31-be07-c018da61e366 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:03.805421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2692faa-59a8-4e31-be07-c018da61e366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:03.815763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2692faa-59a8-4e31-be07-c018da61e366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:03.817240 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2692faa-59a8-4e31-be07-c018da61e366 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:03.834090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-f2692faa-59a8-4e31-be07-c018da61e366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:59:03.834090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:03.834090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:03.834090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:03.834090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:03.834090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:03.834090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:03.834090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:03.834090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:03.834090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:03.834090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:03.834090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:03.834090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:59:03.834090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:59:03.834090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:59:03.835116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:59:03.835116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:03.835116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:03.835116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:03.835116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:03.835116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:03.835116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:03.835116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:03.835116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:59:03.835116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:03.835116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:03.835116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:03.835116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:03.835116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:03.835116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:03.835116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:03.835116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:03.836388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:59:03.836388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:59:03.836388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:59:03.836388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:59:03.836388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 641/1269] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:03.841485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0243d4-1ea7-4f3f-a386-984c28ad9dd8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:03.937821 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0243d4-1ea7-4f3f-a386-984c28ad9dd8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:03.970425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f0644-b534-4840-85b6-65b52d16f64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:03.971073 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f0644-b534-4840-85b6-65b52d16f64c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:03.971360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f0644-b534-4840-85b6-65b52d16f64c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:03.971639 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f0644-b534-4840-85b6-65b52d16f64c None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:03.972387 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f0644-b534-4840-85b6-65b52d16f64c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:03.972696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f0644-b534-4840-85b6-65b52d16f64c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:03.974063 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f0644-b534-4840-85b6-65b52d16f64c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:03.984849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 629/1270] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:03.990196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2692faa-59a8-4e31-be07-c018da61e366 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:04.021906 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:04.088018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2692faa-59a8-4e31-be07-c018da61e366 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:04.120211 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bd194-45ec-4c8a-8625-9042359e8c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:04.120979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd194-45ec-4c8a-8625-9042359e8c95 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:04.121262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd194-45ec-4c8a-8625-9042359e8c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:04.121538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd194-45ec-4c8a-8625-9042359e8c95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:04.128366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bd194-45ec-4c8a-8625-9042359e8c95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:04.129818 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bd194-45ec-4c8a-8625-9042359e8c95 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:04.146162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b29bd194-45ec-4c8a-8625-9042359e8c95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:59:04.146162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:04.146162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:04.146162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:04.146162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:04.146162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:04.146162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:04.146162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:04.146162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:04.146162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:04.146162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:04.146162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:04.146162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:59:04.146162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:59:04.146162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:59:04.147480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:59:04.147480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:04.147480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:04.147480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:04.147480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:04.147480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:04.147480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:04.147480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:04.147480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:59:04.147480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:04.147480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:04.147480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:04.147480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:04.147480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:04.147480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:04.147480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:04.147480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:04.149074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:59:04.149074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:59:04.149074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:59:04.149074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:59:04.149074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:59:04.149074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:59:04.149074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:59:04.149074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:59:04.149074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 642/1271] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:59:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:04.153553 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f0644-b534-4840-85b6-65b52d16f64c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:04.220772 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:04.261889 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f0644-b534-4840-85b6-65b52d16f64c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:04.294229 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90322ca9-a8a6-4125-9e1b-a54cede3eef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:04.294830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90322ca9-a8a6-4125-9e1b-a54cede3eef0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:04.295117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90322ca9-a8a6-4125-9e1b-a54cede3eef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:04.295395 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90322ca9-a8a6-4125-9e1b-a54cede3eef0 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:04.296205 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90322ca9-a8a6-4125-9e1b-a54cede3eef0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:04.296516 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90322ca9-a8a6-4125-9e1b-a54cede3eef0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:04.297940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90322ca9-a8a6-4125-9e1b-a54cede3eef0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:04.309973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 630/1272] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:59:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:59:04.315851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bd194-45ec-4c8a-8625-9042359e8c95 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:04.404627 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:04.413184 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bd194-45ec-4c8a-8625-9042359e8c95 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:04.446595 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b73f9-2a96-4d25-a850-2d4874d8c341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:04.447541 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b73f9-2a96-4d25-a850-2d4874d8c341 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:04.447836 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b73f9-2a96-4d25-a850-2d4874d8c341 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:04.448202 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b73f9-2a96-4d25-a850-2d4874d8c341 None admin] PATH_INFO: `/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/e9cccb366fc6429e9a30d4f9de64e8f8/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:04.450247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b73f9-2a96-4d25-a850-2d4874d8c341 None admin] RBAC: Authorizing `identity:create_grant(project_id=d90551d9446e4f2cbd14312d2af9f7c9, user_id=e9cccb366fc6429e9a30d4f9de64e8f8, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:04.451677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b73f9-2a96-4d25-a850-2d4874d8c341 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:04.463606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 643/1273] 10.222.0.73 () {58 vars in 1439 bytes} [Thu May 19 11:59:04 2022] PUT /identity/v3/projects/d90551d9446e4f2cbd14312d2af9f7c9/users/e9cccb366fc6429e9a30d4f9de64e8f8/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 11:59:06.647306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59dfe-cf2b-4852-9976-4997c1bdb5c6 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:06.647833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59dfe-cf2b-4852-9976-4997c1bdb5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:06.647833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59dfe-cf2b-4852-9976-4997c1bdb5c6 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:06.649181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 631/1274] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:06.655028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc204e-3348-4a8a-8153-4543ed8c11a1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:06.655411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc204e-3348-4a8a-8153-4543ed8c11a1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:06.655598 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc204e-3348-4a8a-8153-4543ed8c11a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:06.672355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-41cc204e-3348-4a8a-8153-4543ed8c11a1 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:06.673550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-41cc204e-3348-4a8a-8153-4543ed8c11a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:06.738418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 644/1275] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:59:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:06.761699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba59dfe-cf2b-4852-9976-4997c1bdb5c6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:06.866523 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba59dfe-cf2b-4852-9976-4997c1bdb5c6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:06.883971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:06.901578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d01b0e-48ba-4c81-86cc-5bc6779c5e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:06.902295 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d01b0e-48ba-4c81-86cc-5bc6779c5e86 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:06.902575 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d01b0e-48ba-4c81-86cc-5bc6779c5e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:06.902848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d01b0e-48ba-4c81-86cc-5bc6779c5e86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:06.912527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d01b0e-48ba-4c81-86cc-5bc6779c5e86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 11:59:06.920335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-38d01b0e-48ba-4c81-86cc-5bc6779c5e86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:59:06.920335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:06.920335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:06.920335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:06.920335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:06.920335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:06.920335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:06.920335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:06.920335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:06.920335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:06.920335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:06.920335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:06.920335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 11:59:06.920335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 11:59:06.920335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 11:59:06.920335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 11:59:06.921256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 11:59:06.921256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 11:59:06.921256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 11:59:06.921256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 11:59:06.921256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:06.921256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:06.921256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:06.921256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:06.921256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:06.921256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:06.921256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:06.921256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:59:06.921256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:06.921256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:06.921256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:06.921256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:06.922099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:06.922099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:06.922099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:06.922099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:06.922099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 11:59:06.922099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 11:59:06.922099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 11:59:06.922099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 11:59:06.922099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 11:59:06.922099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 11:59:06.922099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 11:59:06.922099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:59:06.922099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 632/1276] 10.222.0.73 () {56 vars in 1096 bytes} [Thu May 19 11:59:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:06.927575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc204e-3348-4a8a-8153-4543ed8c11a1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:07.005424 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:07.024914 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc204e-3348-4a8a-8153-4543ed8c11a1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:07.058661 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f865dcd-c678-4df9-9abb-e77d0f77a596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:07.059320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f865dcd-c678-4df9-9abb-e77d0f77a596 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:07.059606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f865dcd-c678-4df9-9abb-e77d0f77a596 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:07.059887 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f865dcd-c678-4df9-9abb-e77d0f77a596 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:07.060668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f865dcd-c678-4df9-9abb-e77d0f77a596 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:07.060981 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f865dcd-c678-4df9-9abb-e77d0f77a596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:07.062336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f865dcd-c678-4df9-9abb-e77d0f77a596 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:07.070193 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 645/1277] 10.222.0.73 () {56 vars in 1099 bytes} [Thu May 19 11:59:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:07.076410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d01b0e-48ba-4c81-86cc-5bc6779c5e86 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:07.179749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d01b0e-48ba-4c81-86cc-5bc6779c5e86 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:07.219064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad1539-6c66-4601-a85e-30c2f5abeeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:07.219866 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad1539-6c66-4601-a85e-30c2f5abeeba None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:07.220183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad1539-6c66-4601-a85e-30c2f5abeeba None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:07.220464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad1539-6c66-4601-a85e-30c2f5abeeba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:07.231276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad1539-6c66-4601-a85e-30c2f5abeeba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:07.232747 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad1539-6c66-4601-a85e-30c2f5abeeba None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:07.249940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b3ad1539-6c66-4601-a85e-30c2f5abeeba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:59:07.249940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:07.249940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:07.249940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:07.249940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:07.249940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:07.249940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:07.249940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:07.249940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:07.249940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:07.249940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:07.249940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:07.249940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:59:07.249940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:59:07.249940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:59:07.250974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:59:07.250974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:07.250974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:07.250974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:07.250974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:07.250974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:07.250974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:07.250974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:07.250974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:59:07.250974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:07.250974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:07.250974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:07.250974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:07.250974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:07.250974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:07.250974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:07.250974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:07.256664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:59:07.256664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:59:07.256664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:59:07.256664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:59:07.256664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 633/1278] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:07.257024 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f865dcd-c678-4df9-9abb-e77d0f77a596 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:07.352730 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f865dcd-c678-4df9-9abb-e77d0f77a596 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:07.386190 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e3ec1-6590-4303-b372-cabd975f5bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:07.386851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e3ec1-6590-4303-b372-cabd975f5bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:07.387138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e3ec1-6590-4303-b372-cabd975f5bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:07.387418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e3ec1-6590-4303-b372-cabd975f5bf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:07.388159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e3ec1-6590-4303-b372-cabd975f5bf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:07.388468 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e3ec1-6590-4303-b372-cabd975f5bf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:07.389840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e3ec1-6590-4303-b372-cabd975f5bf6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:07.401211 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 646/1279] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 11:59:07.406684 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad1539-6c66-4601-a85e-30c2f5abeeba None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:07.437442 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:07.504787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad1539-6c66-4601-a85e-30c2f5abeeba None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:07.536177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb3111-1157-4f90-9305-3484ccd5a450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:07.536956 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb3111-1157-4f90-9305-3484ccd5a450 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:07.537239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb3111-1157-4f90-9305-3484ccd5a450 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:07.537509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb3111-1157-4f90-9305-3484ccd5a450 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:07.546222 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb3111-1157-4f90-9305-3484ccd5a450 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:07.547639 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb3111-1157-4f90-9305-3484ccd5a450 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:07.562113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-31fb3111-1157-4f90-9305-3484ccd5a450 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 11:59:07.562113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:07.562113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:07.562113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:07.562113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:07.562113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:07.562113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:07.562113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:07.562113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:07.562113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:07.562113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:07.562113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:07.562113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 11:59:07.562113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 11:59:07.562113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 11:59:07.562113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:07.563065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:07.564179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:07.564179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:07.564179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 11:59:07.564179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 11:59:07.564179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 11:59:07.564179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 11:59:07.564179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 11:59:07.564179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 11:59:07.564179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 11:59:07.564179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:59:07.564179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 634/1280] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:59:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:07.568933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e3ec1-6590-4303-b372-cabd975f5bf6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:07.572680 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:07.664434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e3ec1-6590-4303-b372-cabd975f5bf6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:07.697103 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e499bc-4005-4d38-8b38-78cc2d9f1873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:07.697725 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e499bc-4005-4d38-8b38-78cc2d9f1873 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:07.698011 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e499bc-4005-4d38-8b38-78cc2d9f1873 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:07.698290 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e499bc-4005-4d38-8b38-78cc2d9f1873 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:07.699122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e499bc-4005-4d38-8b38-78cc2d9f1873 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:07.699430 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e499bc-4005-4d38-8b38-78cc2d9f1873 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:07.700871 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e499bc-4005-4d38-8b38-78cc2d9f1873 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:07.717636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 647/1281] 10.222.0.73 () {56 vars in 1143 bytes} [Thu May 19 11:59:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:07.723152 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb3111-1157-4f90-9305-3484ccd5a450 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:07.810404 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:07.819861 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb3111-1157-4f90-9305-3484ccd5a450 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:07.851706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c53ee-3b1f-4f3a-8796-6ee0c999fe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:07.852368 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c53ee-3b1f-4f3a-8796-6ee0c999fe43 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:07.852649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c53ee-3b1f-4f3a-8796-6ee0c999fe43 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:07.852922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c53ee-3b1f-4f3a-8796-6ee0c999fe43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:07.917820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c53ee-3b1f-4f3a-8796-6ee0c999fe43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:07.919508 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c53ee-3b1f-4f3a-8796-6ee0c999fe43 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:08.003168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:08.013757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 635/1282] 10.222.0.73 () {58 vars in 1282 bytes} [Thu May 19 11:59:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 11:59:08.019376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e499bc-4005-4d38-8b38-78cc2d9f1873 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:08.078645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:08.115642 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e499bc-4005-4d38-8b38-78cc2d9f1873 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:08.151039 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead428f1-ba07-4469-9095-9e6b24fe8410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:08.151828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead428f1-ba07-4469-9095-9e6b24fe8410 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:08.152135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead428f1-ba07-4469-9095-9e6b24fe8410 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:08.152413 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead428f1-ba07-4469-9095-9e6b24fe8410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:08.162229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead428f1-ba07-4469-9095-9e6b24fe8410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:08.163656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead428f1-ba07-4469-9095-9e6b24fe8410 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:08.180841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-ead428f1-ba07-4469-9095-9e6b24fe8410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:59:08.180841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:08.180841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:08.180841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:08.180841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:08.180841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:08.180841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:08.180841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:08.180841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:08.180841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:08.180841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:08.180841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:08.180841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 11:59:08.180841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 11:59:08.180841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 11:59:08.181874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 11:59:08.181874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:08.181874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:08.181874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:08.181874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:08.181874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:08.181874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:08.181874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:08.181874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:59:08.181874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:08.181874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:08.181874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:08.181874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:08.181874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:08.181874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:08.181874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:08.181874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:08.182997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 11:59:08.182997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 11:59:08.182997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 11:59:08.182997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:59:08.182997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 648/1283] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 11:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:08.187608 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c53ee-3b1f-4f3a-8796-6ee0c999fe43 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:08.283649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c53ee-3b1f-4f3a-8796-6ee0c999fe43 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:08.316143 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4de84-04cc-47c4-b828-a4a9809bbdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:08.316790 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4de84-04cc-47c4-b828-a4a9809bbdba None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:08.317073 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4de84-04cc-47c4-b828-a4a9809bbdba None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:08.317348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4de84-04cc-47c4-b828-a4a9809bbdba None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:08.318057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4de84-04cc-47c4-b828-a4a9809bbdba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:08.318359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4de84-04cc-47c4-b828-a4a9809bbdba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:08.319709 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4de84-04cc-47c4-b828-a4a9809bbdba None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:08.331333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 636/1284] 10.222.0.73 () {56 vars in 1109 bytes} [Thu May 19 11:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:08.336958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead428f1-ba07-4469-9095-9e6b24fe8410 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:08.435877 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead428f1-ba07-4469-9095-9e6b24fe8410 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:08.449828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:08.469226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbb048-2c09-4f21-a5d3-f86e42c9a7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:08.470010 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbb048-2c09-4f21-a5d3-f86e42c9a7eb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:08.470294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbb048-2c09-4f21-a5d3-f86e42c9a7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:08.470574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbb048-2c09-4f21-a5d3-f86e42c9a7eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:08.477061 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbb048-2c09-4f21-a5d3-f86e42c9a7eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:08.478522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbb048-2c09-4f21-a5d3-f86e42c9a7eb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:08.491820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-3dfbb048-2c09-4f21-a5d3-f86e42c9a7eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:59:08.491820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:08.491820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:08.491820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:08.491820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:08.491820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:08.491820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:08.491820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:08.491820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:08.491820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:08.491820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:08.491820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:08.491820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 11:59:08.491820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 11:59:08.491820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 11:59:08.492898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 11:59:08.492898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:08.492898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:08.492898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:08.492898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:08.492898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:08.492898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:08.492898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:08.492898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( May 19 11:59:08.492898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:08.492898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:08.492898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:08.492898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:08.492898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:08.492898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:08.492898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:08.492898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:08.494513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 11:59:08.494513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 11:59:08.494513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 11:59:08.494513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 11:59:08.494513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 11:59:08.494513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 11:59:08.494513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 11:59:08.494513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: ERROR keystone.server.flask.application May 19 11:59:08.494513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 649/1285] 10.222.0.73 () {56 vars in 1111 bytes} [Thu May 19 11:59:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:08.499361 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4de84-04cc-47c4-b828-a4a9809bbdba None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:08.547859 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:08.596051 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4de84-04cc-47c4-b828-a4a9809bbdba None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:08.630717 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c1ac6-ac4e-4cd9-a9b0-1aef4714e865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:08.631906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c1ac6-ac4e-4cd9-a9b0-1aef4714e865 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:08.632462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c1ac6-ac4e-4cd9-a9b0-1aef4714e865 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:08.632968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c1ac6-ac4e-4cd9-a9b0-1aef4714e865 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:08.634502 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c1ac6-ac4e-4cd9-a9b0-1aef4714e865 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:08.635150 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c1ac6-ac4e-4cd9-a9b0-1aef4714e865 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:08.638412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c1ac6-ac4e-4cd9-a9b0-1aef4714e865 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:08.653076 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 637/1286] 10.222.0.73 () {56 vars in 1148 bytes} [Thu May 19 11:59:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:08.659135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbb048-2c09-4f21-a5d3-f86e42c9a7eb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:08.757585 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbb048-2c09-4f21-a5d3-f86e42c9a7eb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:08.788902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5aaae-6047-42ee-bace-8dd580c6d729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:08.789530 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5aaae-6047-42ee-bace-8dd580c6d729 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:08.789810 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5aaae-6047-42ee-bace-8dd580c6d729 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:08.790084 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5aaae-6047-42ee-bace-8dd580c6d729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:08.791392 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5aaae-6047-42ee-bace-8dd580c6d729 None admin] RBAC: Adding query filter params (role.id=489aaa5486d84d4a917a0a4208a7dbe6, scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9, user.id=e9cccb366fc6429e9a30d4f9de64e8f8) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:08.791701 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5aaae-6047-42ee-bace-8dd580c6d729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:08.793159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5aaae-6047-42ee-bace-8dd580c6d729 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:08.799034 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 650/1287] 10.222.0.73 () {56 vars in 1374 bytes} [Thu May 19 11:59:08 2022] GET /identity/v3/role_assignments?user.id=e9cccb366fc6429e9a30d4f9de64e8f8&scope.project.id=d90551d9446e4f2cbd14312d2af9f7c9&role.id=489aaa5486d84d4a917a0a4208a7dbe6 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:10.985061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fadca-a0ba-4b34-b9bc-34bcd4863558 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:10.985632 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fadca-a0ba-4b34-b9bc-34bcd4863558 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:10.985632 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fadca-a0ba-4b34-b9bc-34bcd4863558 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:10.986977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 638/1288] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:10.992066 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa544ae9-1d49-4a09-b2a6-02eceeda5890 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:10.992482 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa544ae9-1d49-4a09-b2a6-02eceeda5890 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:10.992629 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa544ae9-1d49-4a09-b2a6-02eceeda5890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:11.008899 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fa544ae9-1d49-4a09-b2a6-02eceeda5890 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:11.010545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fa544ae9-1d49-4a09-b2a6-02eceeda5890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:11.039192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:11.075030 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 651/1289] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:59:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:59:11.097009 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fadca-a0ba-4b34-b9bc-34bcd4863558 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:11.210410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fadca-a0ba-4b34-b9bc-34bcd4863558 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:11.224544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:11.247358 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5cc28-1d60-4a93-ad25-3ebce68c6583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:11.248110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5cc28-1d60-4a93-ad25-3ebce68c6583 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:11.248394 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5cc28-1d60-4a93-ad25-3ebce68c6583 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:11.248667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5cc28-1d60-4a93-ad25-3ebce68c6583 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:11.249311 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5cc28-1d60-4a93-ad25-3ebce68c6583 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:11.250664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5cc28-1d60-4a93-ad25-3ebce68c6583 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:11.262977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-7eb5cc28-1d60-4a93-ad25-3ebce68c6583 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:59:11.262977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:11.262977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:59:11.262977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:59:11.262977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:59:11.262977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:59:11.262977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:59:11.262977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:59:11.262977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:59:11.262977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:59:11.262977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:59:11.262977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:59:11.262977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:11.262977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:11.262977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:11.262977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:11.262977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:11.264318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:11.264318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:11.264318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:11.264318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:11.264318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:11.264318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:11.264318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:59:11.264318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:59:11.264318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:59:11.264318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:59:11.264318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:11.264318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:11.264318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:11.264318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:11.264318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:11.264318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:11.265174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:11.265174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:59:11.265174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:11.265174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:11.265174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:11.265174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:11.265174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:11.265174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:11.265174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:11.265174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:11.265174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:59:11.265174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:59:11.265174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:59:11.265174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:59:11.265174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 639/1290] 10.222.0.73 () {56 vars in 1117 bytes} [Thu May 19 11:59:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:11.270320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa544ae9-1d49-4a09-b2a6-02eceeda5890 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:11.366723 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa544ae9-1d49-4a09-b2a6-02eceeda5890 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:11.401108 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251225a-d9e7-439b-8b5e-9e55bdba5701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:11.401767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251225a-d9e7-439b-8b5e-9e55bdba5701 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:11.402056 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251225a-d9e7-439b-8b5e-9e55bdba5701 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:11.402336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251225a-d9e7-439b-8b5e-9e55bdba5701 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:11.403039 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251225a-d9e7-439b-8b5e-9e55bdba5701 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:11.403346 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251225a-d9e7-439b-8b5e-9e55bdba5701 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:11.404731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251225a-d9e7-439b-8b5e-9e55bdba5701 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:11.409511 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 652/1291] 10.222.0.73 () {56 vars in 1116 bytes} [Thu May 19 11:59:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:11.415068 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5cc28-1d60-4a93-ad25-3ebce68c6583 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:11.511504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5cc28-1d60-4a93-ad25-3ebce68c6583 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:11.549091 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83684e4d-c45b-4e20-bcff-0edef4a842ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:11.549743 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83684e4d-c45b-4e20-bcff-0edef4a842ab None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:11.550030 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83684e4d-c45b-4e20-bcff-0edef4a842ab None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:11.550304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83684e4d-c45b-4e20-bcff-0edef4a842ab None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:11.551000 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83684e4d-c45b-4e20-bcff-0edef4a842ab None admin] RBAC: Adding query filter params (type=placement) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:11.551306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83684e4d-c45b-4e20-bcff-0edef4a842ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:11.552680 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83684e4d-c45b-4e20-bcff-0edef4a842ab None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:11.557727 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 640/1292] 10.222.0.73 () {56 vars in 1116 bytes} [Thu May 19 11:59:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:13.715562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a093-5bf2-438d-ada5-c4d641290c8b None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:13.716126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a093-5bf2-438d-ada5-c4d641290c8b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:13.716126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a093-5bf2-438d-ada5-c4d641290c8b None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:13.717440 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 653/1293] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:13.722464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a52a09-db8c-41d6-9cb4-a4373390b503 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:13.722830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a52a09-db8c-41d6-9cb4-a4373390b503 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:13.723018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a52a09-db8c-41d6-9cb4-a4373390b503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:13.740010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-21a52a09-db8c-41d6-9cb4-a4373390b503 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:13.741169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-21a52a09-db8c-41d6-9cb4-a4373390b503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:13.768613 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:13.805294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 641/1294] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:59:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:13.827776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107a093-5bf2-438d-ada5-c4d641290c8b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:13.858874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:13.926530 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107a093-5bf2-438d-ada5-c4d641290c8b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:13.958681 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72820b-8575-40e0-9514-05fa3f14f3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:13.959330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72820b-8575-40e0-9514-05fa3f14f3bb None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:13.959621 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72820b-8575-40e0-9514-05fa3f14f3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:13.959905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72820b-8575-40e0-9514-05fa3f14f3bb None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:13.960649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72820b-8575-40e0-9514-05fa3f14f3bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:13.962002 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72820b-8575-40e0-9514-05fa3f14f3bb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:13.975016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 654/1295] 10.222.0.73 () {60 vars in 1141 bytes} [Thu May 19 11:59:13 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 11:59:16.163355 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca2697-60cc-4957-a5cc-6aeb58a94fd5 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:16.163942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca2697-60cc-4957-a5cc-6aeb58a94fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:16.164049 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca2697-60cc-4957-a5cc-6aeb58a94fd5 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:16.165599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 642/1296] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 11:59:16.171340 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895c3d-fdc6-4580-aa9f-336136592d86 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:16.171839 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895c3d-fdc6-4580-aa9f-336136592d86 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:16.172086 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895c3d-fdc6-4580-aa9f-336136592d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:16.189813 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4e895c3d-fdc6-4580-aa9f-336136592d86 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:16.191006 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4e895c3d-fdc6-4580-aa9f-336136592d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:16.261801 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 655/1297] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:59:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 11:59:16.283324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca2697-60cc-4957-a5cc-6aeb58a94fd5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:16.384562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca2697-60cc-4957-a5cc-6aeb58a94fd5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:16.417790 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1496457-5bd3-4d75-85b5-2102349e8e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:16.418532 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1496457-5bd3-4d75-85b5-2102349e8e89 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:16.418817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1496457-5bd3-4d75-85b5-2102349e8e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:16.419354 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1496457-5bd3-4d75-85b5-2102349e8e89 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:16.420035 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1496457-5bd3-4d75-85b5-2102349e8e89 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:16.421402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1496457-5bd3-4d75-85b5-2102349e8e89 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:16.433645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e1496457-5bd3-4d75-85b5-2102349e8e89 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:59:16.433645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:16.433645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:59:16.433645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:59:16.433645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:59:16.433645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:59:16.433645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:59:16.433645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:59:16.433645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:59:16.433645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:59:16.433645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:59:16.433645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:59:16.433645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:16.433645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:16.433645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:16.433645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:16.433645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:16.434799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:16.434799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:16.434799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:16.434799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:16.434799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:16.434799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:16.434799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:59:16.434799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:59:16.434799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:59:16.434799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:59:16.434799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:16.434799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:16.434799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:16.434799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:16.434799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:16.434799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:16.435833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:16.435833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:59:16.435833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:16.435833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:16.435833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:16.435833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:16.435833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:16.435833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:16.435833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:16.435833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:16.435833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:59:16.435833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:59:16.435833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:59:16.435833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:59:16.435833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 643/1298] 10.222.0.73 () {56 vars in 1117 bytes} [Thu May 19 11:59:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:16.440867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e895c3d-fdc6-4580-aa9f-336136592d86 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:16.458642 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:16.537621 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e895c3d-fdc6-4580-aa9f-336136592d86 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:16.571200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6703b-0e44-4027-8f3a-ba57f5202df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:16.571875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6703b-0e44-4027-8f3a-ba57f5202df0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:16.572193 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6703b-0e44-4027-8f3a-ba57f5202df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:16.572475 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6703b-0e44-4027-8f3a-ba57f5202df0 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:16.573183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6703b-0e44-4027-8f3a-ba57f5202df0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:16.573497 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6703b-0e44-4027-8f3a-ba57f5202df0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:16.574857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6703b-0e44-4027-8f3a-ba57f5202df0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:16.579891 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 656/1299] 10.222.0.73 () {56 vars in 1116 bytes} [Thu May 19 11:59:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:16.585516 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1496457-5bd3-4d75-85b5-2102349e8e89 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:16.616545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:16.683741 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1496457-5bd3-4d75-85b5-2102349e8e89 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:16.718911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ba510-c7f0-44d4-bcc7-4ebeae64737e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:16.719559 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ba510-c7f0-44d4-bcc7-4ebeae64737e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:16.719838 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ba510-c7f0-44d4-bcc7-4ebeae64737e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:16.720141 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ba510-c7f0-44d4-bcc7-4ebeae64737e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:16.720922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ba510-c7f0-44d4-bcc7-4ebeae64737e None admin] RBAC: Adding query filter params (interface=public, service_id=0d57314927344c079eb8a8d00265a564, region_id=RegionOne) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:16.721233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ba510-c7f0-44d4-bcc7-4ebeae64737e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:16.722586 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ba510-c7f0-44d4-bcc7-4ebeae64737e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:16.727527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 644/1300] 10.222.0.73 () {56 vars in 1251 bytes} [Thu May 19 11:59:16 2022] GET /identity/v3/endpoints?service_id=0d57314927344c079eb8a8d00265a564&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:16.733691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6703b-0e44-4027-8f3a-ba57f5202df0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:16.812864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:16.830545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6703b-0e44-4027-8f3a-ba57f5202df0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:16.863353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1dadc-0acb-4595-9a01-d3b0a13d94a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:16.864028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1dadc-0acb-4595-9a01-d3b0a13d94a1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:16.864311 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1dadc-0acb-4595-9a01-d3b0a13d94a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:16.864588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1dadc-0acb-4595-9a01-d3b0a13d94a1 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:16.865261 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1dadc-0acb-4595-9a01-d3b0a13d94a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:16.866613 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1dadc-0acb-4595-9a01-d3b0a13d94a1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:16.873295 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 657/1301] 10.222.0.73 () {56 vars in 1087 bytes} [Thu May 19 11:59:16 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 11:59:19.026742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7438fe-dd4b-4c5d-bcf6-917b08ffb9d1 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:19.027306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7438fe-dd4b-4c5d-bcf6-917b08ffb9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:19.027306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7438fe-dd4b-4c5d-bcf6-917b08ffb9d1 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:19.028701 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 645/1302] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 11:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 11:59:19.033862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a819442-1f8e-47cb-ab79-badb5679b44a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:19.034278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a819442-1f8e-47cb-ab79-badb5679b44a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:19.034424 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a819442-1f8e-47cb-ab79-badb5679b44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:19.050912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6a819442-1f8e-47cb-ab79-badb5679b44a None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 11:59:19.052123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6a819442-1f8e-47cb-ab79-badb5679b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 11:59:19.117086 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 658/1303] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 11:59:19 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 11:59:19.139854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7438fe-dd4b-4c5d-bcf6-917b08ffb9d1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:19.231322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:19.238077 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7438fe-dd4b-4c5d-bcf6-917b08ffb9d1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:19.270342 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71baa19d-75dd-4807-8721-62eafabd35b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:19.271118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baa19d-75dd-4807-8721-62eafabd35b9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:19.271400 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baa19d-75dd-4807-8721-62eafabd35b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:19.271673 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baa19d-75dd-4807-8721-62eafabd35b9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:19.272337 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71baa19d-75dd-4807-8721-62eafabd35b9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:19.273688 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71baa19d-75dd-4807-8721-62eafabd35b9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:19.285197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-71baa19d-75dd-4807-8721-62eafabd35b9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:59:19.285197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:19.285197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 11:59:19.285197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 11:59:19.285197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 11:59:19.285197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 11:59:19.285197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 11:59:19.285197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:59:19.285197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:59:19.285197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:59:19.285197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 11:59:19.285197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:59:19.285197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 11:59:19.285197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 11:59:19.285197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 11:59:19.285197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 11:59:19.285197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 11:59:19.286346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 11:59:19.286346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 11:59:19.286346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 11:59:19.286346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 11:59:19.286346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 11:59:19.286346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 11:59:19.286346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 11:59:19.286346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 11:59:19.286346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 11:59:19.286346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 11:59:19.286346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 11:59:19.286346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 11:59:19.286346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 11:59:19.286346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 11:59:19.286346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 11:59:19.286346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( May 19 11:59:19.287534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 11:59:19.287534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( May 19 11:59:19.287534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 11:59:19.287534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() May 19 11:59:19.287534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 11:59:19.287534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 11:59:19.287534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 11:59:19.287534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() May 19 11:59:19.287534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 11:59:19.287534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( May 19 11:59:19.287534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 11:59:19.287534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 11:59:19.287534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 11:59:19.287534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application May 19 11:59:19.287534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 646/1304] 10.222.0.73 () {56 vars in 1117 bytes} [Thu May 19 11:59:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 11:59:19.292703 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a819442-1f8e-47cb-ab79-badb5679b44a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:19.364759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:19.387840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a819442-1f8e-47cb-ab79-badb5679b44a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:19.420457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6044541-af50-44a4-b457-d39e11d6c850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:19.421109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6044541-af50-44a4-b457-d39e11d6c850 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:19.421390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6044541-af50-44a4-b457-d39e11d6c850 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:19.421666 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6044541-af50-44a4-b457-d39e11d6c850 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:19.422360 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6044541-af50-44a4-b457-d39e11d6c850 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 11:59:19.422663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6044541-af50-44a4-b457-d39e11d6c850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:19.424029 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6044541-af50-44a4-b457-d39e11d6c850 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:19.428998 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 659/1305] 10.222.0.73 () {56 vars in 1116 bytes} [Thu May 19 11:59:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 11:59:19.435223 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71baa19d-75dd-4807-8721-62eafabd35b9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 11:59:19.530971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71baa19d-75dd-4807-8721-62eafabd35b9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 11:59:19.563894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d9666-22d7-4942-a493-72773056ba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 11:59:19.564549 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d9666-22d7-4942-a493-72773056ba16 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 11:59:19.564829 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d9666-22d7-4942-a493-72773056ba16 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 11:59:19.565102 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d9666-22d7-4942-a493-72773056ba16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 11:59:19.565836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d9666-22d7-4942-a493-72773056ba16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 11:59:19.567172 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d9666-22d7-4942-a493-72773056ba16 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 11:59:19.584369 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 647/1306] 10.222.0.73 () {60 vars in 1144 bytes} [Thu May 19 11:59:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 11:59:29.426000 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=30 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 11:59:29.580229 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:23.181622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cb9b7-d5f1-45b9-90c4-95b0f5fc96f2 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:23.182200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cb9b7-d5f1-45b9-90c4-95b0f5fc96f2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:23.182200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cb9b7-d5f1-45b9-90c4-95b0f5fc96f2 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:23.183719 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 660/1307] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:00:23.189012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93294583-79a0-4021-8fcd-097dd69df343 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:23.189470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93294583-79a0-4021-8fcd-097dd69df343 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:23.189575 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93294583-79a0-4021-8fcd-097dd69df343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:23.289167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-93294583-79a0-4021-8fcd-097dd69df343 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:00:23.290377 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-93294583-79a0-4021-8fcd-097dd69df343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:23.447405 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 648/1308] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:00:23.538452 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e5a8e-17fe-4c7e-bb7f-d1438e503ed0 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:23.538776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e5a8e-17fe-4c7e-bb7f-d1438e503ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:23.539082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e5a8e-17fe-4c7e-bb7f-d1438e503ed0 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:23.541127 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 661/1309] 10.222.0.73 () {54 vars in 964 bytes} [Thu May 19 12:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:00:23.548170 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a8386-61bd-49fa-b837-5cfc8ec3c632 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:23.548522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a8386-61bd-49fa-b837-5cfc8ec3c632 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:23.548922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a8386-61bd-49fa-b837-5cfc8ec3c632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:23.686738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-767a8386-61bd-49fa-b837-5cfc8ec3c632 None None] MFA Rules not processed for user `4897919923a64881ac5540cc5d58df1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:00:23.687899 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-767a8386-61bd-49fa-b837-5cfc8ec3c632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:23.730857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:23.884916 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 649/1310] 10.222.0.73 () {58 vars in 1061 bytes} [Thu May 19 12:00:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:00:23.899512 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e5a8e-17fe-4c7e-bb7f-d1438e503ed0 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:00:23.901295 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cc6e5a8e-17fe-4c7e-bb7f-d1438e503ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:24.056568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e5a8e-17fe-4c7e-bb7f-d1438e503ed0 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:00:24.140154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bb97b-ed1b-4ae2-9db7-7a1fec0d5c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:00:24.140865 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bb97b-ed1b-4ae2-9db7-7a1fec0d5c60 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:24.141155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bb97b-ed1b-4ae2-9db7-7a1fec0d5c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:24.141434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bb97b-ed1b-4ae2-9db7-7a1fec0d5c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:24.143566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-785bb97b-ed1b-4ae2-9db7-7a1fec0d5c60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:24.201350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:24.263826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bb97b-ed1b-4ae2-9db7-7a1fec0d5c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:00:24.265296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bb97b-ed1b-4ae2-9db7-7a1fec0d5c60 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:00:24.297245 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 662/1311] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:00:26.822842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445a0bd-3f20-4fb9-9f18-84cedd008e3f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:26.823438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445a0bd-3f20-4fb9-9f18-84cedd008e3f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:26.823438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445a0bd-3f20-4fb9-9f18-84cedd008e3f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:26.824810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 650/1312] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:00:26.830014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d3cdd-cb01-49d9-b322-f0bb962b154e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:26.830432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d3cdd-cb01-49d9-b322-f0bb962b154e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:26.830580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d3cdd-cb01-49d9-b322-f0bb962b154e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:26.914270 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-dd2d3cdd-cb01-49d9-b322-f0bb962b154e None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:00:26.915397 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-dd2d3cdd-cb01-49d9-b322-f0bb962b154e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:27.011637 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 663/1313] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:00:27.050066 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445a0bd-3f20-4fb9-9f18-84cedd008e3f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:00:27.051607 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c445a0bd-3f20-4fb9-9f18-84cedd008e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:27.158150 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445a0bd-3f20-4fb9-9f18-84cedd008e3f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:00:27.228513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:27.231274 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4d53e-53af-4ff9-8244-c351e69e8102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:00:27.232110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4d53e-53af-4ff9-8244-c351e69e8102 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:27.232639 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4d53e-53af-4ff9-8244-c351e69e8102 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:27.232919 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4d53e-53af-4ff9-8244-c351e69e8102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:27.234547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-62d4d53e-53af-4ff9-8244-c351e69e8102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:27.343193 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4d53e-53af-4ff9-8244-c351e69e8102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:00:27.344653 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4d53e-53af-4ff9-8244-c351e69e8102 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:00:27.362116 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 651/1314] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:00:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:00:29.881580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a5761-bde4-4ddf-ab1a-c83699952204 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:29.882642 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a5761-bde4-4ddf-ab1a-c83699952204 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:29.882751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a5761-bde4-4ddf-ab1a-c83699952204 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:29.884168 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 664/1315] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:00:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:00:29.889271 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265b1e5-007f-407a-aaa2-747ecb7d6297 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:29.889701 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265b1e5-007f-407a-aaa2-747ecb7d6297 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:29.889822 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265b1e5-007f-407a-aaa2-747ecb7d6297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:29.952906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9265b1e5-007f-407a-aaa2-747ecb7d6297 None None] MFA Rules not processed for user `52e108f3ae264b08870ed1dfcfa54cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:00:29.954100 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9265b1e5-007f-407a-aaa2-747ecb7d6297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:30.004075 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:30.048228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 652/1316] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:00:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:00:30.087348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a5761-bde4-4ddf-ab1a-c83699952204 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:00:30.088903 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-822a5761-bde4-4ddf-ab1a-c83699952204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:30.098443 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:30.190977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a5761-bde4-4ddf-ab1a-c83699952204 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:00:30.262862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b5b35-bac7-4f6e-87ac-e52677b3ada0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:00:30.263508 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b5b35-bac7-4f6e-87ac-e52677b3ada0 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:30.263790 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b5b35-bac7-4f6e-87ac-e52677b3ada0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:30.264091 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b5b35-bac7-4f6e-87ac-e52677b3ada0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:30.265725 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e64b5b35-bac7-4f6e-87ac-e52677b3ada0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:30.330192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:30.376095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b5b35-bac7-4f6e-87ac-e52677b3ada0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:00:30.377543 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b5b35-bac7-4f6e-87ac-e52677b3ada0 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:00:30.396588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 665/1317] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:00:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:00:33.145556 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10401c7b-9ec5-4c71-8de1-0faad1ecaa46 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:33.146126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10401c7b-9ec5-4c71-8de1-0faad1ecaa46 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:33.146126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10401c7b-9ec5-4c71-8de1-0faad1ecaa46 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:33.147479 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 653/1318] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:00:33.153219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014d8f-b16e-4657-9b83-d2c6f560d94c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:33.153662 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014d8f-b16e-4657-9b83-d2c6f560d94c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:33.153795 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014d8f-b16e-4657-9b83-d2c6f560d94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:33.217571 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b0014d8f-b16e-4657-9b83-d2c6f560d94c None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:00:33.218802 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b0014d8f-b16e-4657-9b83-d2c6f560d94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:33.313168 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 666/1319] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:00:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:00:33.371534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253af5-ef65-42a4-9d7d-32dd18f6566d None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:33.371910 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253af5-ef65-42a4-9d7d-32dd18f6566d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:33.372267 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253af5-ef65-42a4-9d7d-32dd18f6566d None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:33.373653 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 654/1320] 10.222.0.73 () {54 vars in 964 bytes} [Thu May 19 12:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:00:33.379931 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edc758-acc7-4398-8bbf-c53ef79c6205 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:33.380230 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edc758-acc7-4398-8bbf-c53ef79c6205 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:33.380509 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edc758-acc7-4398-8bbf-c53ef79c6205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:33.401085 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:33.453516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a0edc758-acc7-4398-8bbf-c53ef79c6205 None None] MFA Rules not processed for user `4897919923a64881ac5540cc5d58df1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:00:33.454695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a0edc758-acc7-4398-8bbf-c53ef79c6205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:33.529329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 667/1321] 10.222.0.73 () {58 vars in 1061 bytes} [Thu May 19 12:00:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:00:33.538295 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68253af5-ef65-42a4-9d7d-32dd18f6566d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:00:33.539787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-68253af5-ef65-42a4-9d7d-32dd18f6566d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:33.651201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68253af5-ef65-42a4-9d7d-32dd18f6566d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:00:33.731334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfd563-6026-46ed-b6cc-d14ea1d26e04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:00:33.732008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfd563-6026-46ed-b6cc-d14ea1d26e04 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:33.732293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfd563-6026-46ed-b6cc-d14ea1d26e04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:33.732565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfd563-6026-46ed-b6cc-d14ea1d26e04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:33.734198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ccdfd563-6026-46ed-b6cc-d14ea1d26e04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:33.740916 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:33.840651 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfd563-6026-46ed-b6cc-d14ea1d26e04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:00:33.842082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfd563-6026-46ed-b6cc-d14ea1d26e04 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:00:33.859289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 655/1322] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:00:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:00:37.180061 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890a435-e0c1-474d-93e3-a99b25f73dad None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:37.180603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890a435-e0c1-474d-93e3-a99b25f73dad None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:37.180715 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890a435-e0c1-474d-93e3-a99b25f73dad None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:37.182012 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 668/1323] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:00:37.187138 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882daa7-0fca-4c7a-bb24-de6dad65b081 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:37.187570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882daa7-0fca-4c7a-bb24-de6dad65b081 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:37.187702 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882daa7-0fca-4c7a-bb24-de6dad65b081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:37.251451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c882daa7-0fca-4c7a-bb24-de6dad65b081 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:00:37.252729 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c882daa7-0fca-4c7a-bb24-de6dad65b081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:37.308973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:37.350123 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 656/1324] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:00:37.385812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890a435-e0c1-474d-93e3-a99b25f73dad None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:00:37.387394 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6890a435-e0c1-474d-93e3-a99b25f73dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:37.490675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890a435-e0c1-474d-93e3-a99b25f73dad None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:00:37.503185 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:37.565948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb88158-c00e-4b69-bf2e-1786ba92fd03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:00:37.566607 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb88158-c00e-4b69-bf2e-1786ba92fd03 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:37.566905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb88158-c00e-4b69-bf2e-1786ba92fd03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:37.567161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb88158-c00e-4b69-bf2e-1786ba92fd03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:37.568849 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9cb88158-c00e-4b69-bf2e-1786ba92fd03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:37.675425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb88158-c00e-4b69-bf2e-1786ba92fd03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:00:37.676933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb88158-c00e-4b69-bf2e-1786ba92fd03 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:00:37.697488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 669/1325] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:00:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:00:39.980937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb57c0a-0ad9-4acf-a41d-f30699bb1462 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:39.981486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb57c0a-0ad9-4acf-a41d-f30699bb1462 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:39.981486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb57c0a-0ad9-4acf-a41d-f30699bb1462 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:39.982885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 657/1326] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:00:39.988366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ae0e9-18bc-4091-ab9d-bc7c506809af None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:39.988808 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ae0e9-18bc-4091-ab9d-bc7c506809af None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:39.988970 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ae0e9-18bc-4091-ab9d-bc7c506809af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:40.036075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:40.055541 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-456ae0e9-18bc-4091-ab9d-bc7c506809af None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:00:40.056781 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-456ae0e9-18bc-4091-ab9d-bc7c506809af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:40.153126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 670/1327] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:00:40.188914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb57c0a-0ad9-4acf-a41d-f30699bb1462 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:00:40.190566 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3cb57c0a-0ad9-4acf-a41d-f30699bb1462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:40.297185 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb57c0a-0ad9-4acf-a41d-f30699bb1462 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:00:40.369537 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f23f3-977a-4633-974c-b728a9b5f4a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:00:40.370508 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f23f3-977a-4633-974c-b728a9b5f4a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:40.370946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f23f3-977a-4633-974c-b728a9b5f4a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:40.371391 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f23f3-977a-4633-974c-b728a9b5f4a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:40.373635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-050f23f3-977a-4633-974c-b728a9b5f4a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:40.390707 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:40.483280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f23f3-977a-4633-974c-b728a9b5f4a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:00:40.484813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f23f3-977a-4633-974c-b728a9b5f4a8 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:00:40.503340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 658/1328] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:00:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:00:42.763522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2efeb8-d899-4911-8686-dc755875335f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:42.764077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2efeb8-d899-4911-8686-dc755875335f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:42.764077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2efeb8-d899-4911-8686-dc755875335f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:42.765431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 671/1329] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:00:42.770575 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cd388-23bf-45ad-a1f8-9dde749f39c3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:42.770988 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cd388-23bf-45ad-a1f8-9dde749f39c3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:42.771258 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cd388-23bf-45ad-a1f8-9dde749f39c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:42.835879 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-cd6cd388-23bf-45ad-a1f8-9dde749f39c3 None None] MFA Rules not processed for user `52e108f3ae264b08870ed1dfcfa54cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:00:42.837098 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cd6cd388-23bf-45ad-a1f8-9dde749f39c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:42.900844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:42.933374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 659/1330] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:00:42 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:00:42.970590 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2efeb8-d899-4911-8686-dc755875335f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:00:42.972130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bd2efeb8-d899-4911-8686-dc755875335f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:43.074828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2efeb8-d899-4911-8686-dc755875335f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:00:43.094193 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:43.147741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38f87f-b456-41cf-9156-e60571f04370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:00:43.148412 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38f87f-b456-41cf-9156-e60571f04370 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:43.148697 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38f87f-b456-41cf-9156-e60571f04370 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:43.148973 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38f87f-b456-41cf-9156-e60571f04370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:43.150588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1a38f87f-b456-41cf-9156-e60571f04370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:43.258024 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38f87f-b456-41cf-9156-e60571f04370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:00:43.259454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38f87f-b456-41cf-9156-e60571f04370 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:00:43.277248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 672/1331] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:00:42 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:00:45.739837 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b6385-88f9-4236-9883-f1a479f51d0c None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:45.740379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b6385-88f9-4236-9883-f1a479f51d0c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:45.740464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b6385-88f9-4236-9883-f1a479f51d0c None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:45.741850 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 660/1332] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:00:45.747148 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b2d74-d36b-496d-9633-8ea1efef2889 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:45.747606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b2d74-d36b-496d-9633-8ea1efef2889 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:45.747689 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b2d74-d36b-496d-9633-8ea1efef2889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:45.808620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:45.811370 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-845b2d74-d36b-496d-9633-8ea1efef2889 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:00:45.813220 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-845b2d74-d36b-496d-9633-8ea1efef2889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:45.912745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 673/1333] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:00:45.948622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b6385-88f9-4236-9883-f1a479f51d0c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:00:45.950164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ab7b6385-88f9-4236-9883-f1a479f51d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:46.058541 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b6385-88f9-4236-9883-f1a479f51d0c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:00:46.130542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811e823-a003-441d-b4b6-2240cf2e0d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:00:46.131191 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811e823-a003-441d-b4b6-2240cf2e0d6a service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:46.132129 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811e823-a003-441d-b4b6-2240cf2e0d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:46.132469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811e823-a003-441d-b4b6-2240cf2e0d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:46.134090 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0811e823-a003-441d-b4b6-2240cf2e0d6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:46.161094 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:46.248237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811e823-a003-441d-b4b6-2240cf2e0d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:00:46.249691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811e823-a003-441d-b4b6-2240cf2e0d6a service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:00:46.272263 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 661/1334] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:00:48.535376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a5080-ad12-4f40-be1b-c7a9af5a4ef3 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:48.535880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a5080-ad12-4f40-be1b-c7a9af5a4ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:48.536092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a5080-ad12-4f40-be1b-c7a9af5a4ef3 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:48.537363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 674/1335] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:00:48.543080 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6052d-6d68-4cd7-906a-3ebd6515ed94 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:48.543734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6052d-6d68-4cd7-906a-3ebd6515ed94 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:48.543901 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6052d-6d68-4cd7-906a-3ebd6515ed94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:48.607351 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-79d6052d-6d68-4cd7-906a-3ebd6515ed94 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:00:48.608575 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-79d6052d-6d68-4cd7-906a-3ebd6515ed94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:48.683078 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:48.705167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 662/1336] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:00:48.749799 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a5080-ad12-4f40-be1b-c7a9af5a4ef3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:00:48.751318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-690a5080-ad12-4f40-be1b-c7a9af5a4ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:48.853001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a5080-ad12-4f40-be1b-c7a9af5a4ef3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:00:48.880745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:48.925817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3afef-0bcf-44c7-8e90-33e8ad28e526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:00:48.926473 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3afef-0bcf-44c7-8e90-33e8ad28e526 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:48.926757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3afef-0bcf-44c7-8e90-33e8ad28e526 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:48.927034 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3afef-0bcf-44c7-8e90-33e8ad28e526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:48.928886 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d8c3afef-0bcf-44c7-8e90-33e8ad28e526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:49.036338 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3afef-0bcf-44c7-8e90-33e8ad28e526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:00:49.038367 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3afef-0bcf-44c7-8e90-33e8ad28e526 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:00:49.056515 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 675/1337] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:00:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:00:51.670868 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e88b26-ee6d-4772-9fdc-c31bc4e443ac None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:51.671400 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e88b26-ee6d-4772-9fdc-c31bc4e443ac None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:51.671400 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e88b26-ee6d-4772-9fdc-c31bc4e443ac None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:51.672752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 663/1338] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:00:51.677734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d25ed5-6905-4c1b-a554-d12b2b3c39ff None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:51.678126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d25ed5-6905-4c1b-a554-d12b2b3c39ff None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:51.678850 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d25ed5-6905-4c1b-a554-d12b2b3c39ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:51.745677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a4d25ed5-6905-4c1b-a554-d12b2b3c39ff None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:00:51.746905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a4d25ed5-6905-4c1b-a554-d12b2b3c39ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:51.755017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:51.841817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 676/1339] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:00:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:00:51.876923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e88b26-ee6d-4772-9fdc-c31bc4e443ac None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:00:51.878456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-51e88b26-ee6d-4772-9fdc-c31bc4e443ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:51.983939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e88b26-ee6d-4772-9fdc-c31bc4e443ac None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:00:52.056200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538cb5c-09a6-49ac-9f49-ce320865083c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:00:52.056849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538cb5c-09a6-49ac-9f49-ce320865083c service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:52.057139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538cb5c-09a6-49ac-9f49-ce320865083c service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:52.057414 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538cb5c-09a6-49ac-9f49-ce320865083c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:52.059043 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b538cb5c-09a6-49ac-9f49-ce320865083c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:52.093200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:52.165243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538cb5c-09a6-49ac-9f49-ce320865083c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:00:52.166678 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538cb5c-09a6-49ac-9f49-ce320865083c service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:00:52.185015 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 664/1340] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:00:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:00:56.354115 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1ac09-bd76-4013-a443-58c8347c711d None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:56.354680 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1ac09-bd76-4013-a443-58c8347c711d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:56.354680 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1ac09-bd76-4013-a443-58c8347c711d None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:56.357284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 677/1341] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:00:56.362619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd595c-41c4-4c1d-94da-7b93564e40de None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:56.363107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd595c-41c4-4c1d-94da-7b93564e40de None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:56.363224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd595c-41c4-4c1d-94da-7b93564e40de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:56.437259 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a3dd595c-41c4-4c1d-94da-7b93564e40de None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:00:56.438483 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a3dd595c-41c4-4c1d-94da-7b93564e40de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:56.527998 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:56.541386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 665/1342] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:00:56.579869 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1ac09-bd76-4013-a443-58c8347c711d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:00:56.581989 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c8f1ac09-bd76-4013-a443-58c8347c711d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:56.676519 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1ac09-bd76-4013-a443-58c8347c711d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:00:56.680667 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3df00-c202-461a-a3a7-2ca1ba1a765f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:00:56.681318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3df00-c202-461a-a3a7-2ca1ba1a765f service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:56.681607 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3df00-c202-461a-a3a7-2ca1ba1a765f service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:56.681887 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3df00-c202-461a-a3a7-2ca1ba1a765f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:56.691009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3df00-c202-461a-a3a7-2ca1ba1a765f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:00:56.692492 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3df00-c202-461a-a3a7-2ca1ba1a765f service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:00:56.702500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 678/1343] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:00:59.479279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc115d-e062-48b8-ae9e-f3b5fc63031c None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:59.479819 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc115d-e062-48b8-ae9e-f3b5fc63031c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:59.479819 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc115d-e062-48b8-ae9e-f3b5fc63031c None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:59.481139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 666/1344] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:00:59.486299 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3696ad-8239-43b4-bbda-e1b519335f91 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:59.486701 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3696ad-8239-43b4-bbda-e1b519335f91 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:59.486874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3696ad-8239-43b4-bbda-e1b519335f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:59.517261 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4c3696ad-8239-43b4-bbda-e1b519335f91 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:00:59.518467 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4c3696ad-8239-43b4-bbda-e1b519335f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:00:59.547659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:00:59.600355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 679/1345] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:00:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:00:59.638055 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc115d-e062-48b8-ae9e-f3b5fc63031c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:00:59.648658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc115d-e062-48b8-ae9e-f3b5fc63031c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:00:59.652313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8bedd-9fe4-4bce-94e5-adfeb0201f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:00:59.653162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8bedd-9fe4-4bce-94e5-adfeb0201f1d service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:00:59.653553 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8bedd-9fe4-4bce-94e5-adfeb0201f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:00:59.653833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8bedd-9fe4-4bce-94e5-adfeb0201f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:00:59.663143 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8bedd-9fe4-4bce-94e5-adfeb0201f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:00:59.664620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8bedd-9fe4-4bce-94e5-adfeb0201f1d service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:00:59.674386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 667/1346] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:00:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:01:03.870391 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5df4e-706b-431a-9219-907de38b5e01 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:03.870927 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5df4e-706b-431a-9219-907de38b5e01 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:03.871020 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5df4e-706b-431a-9219-907de38b5e01 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:03.872418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 680/1347] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:03.877745 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc307686-00e2-40e6-bf34-1b67091b0ef0 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:03.878155 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc307686-00e2-40e6-bf34-1b67091b0ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:03.878327 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc307686-00e2-40e6-bf34-1b67091b0ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:03.896833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-cc307686-00e2-40e6-bf34-1b67091b0ef0 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:03.898019 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cc307686-00e2-40e6-bf34-1b67091b0ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:03.905917 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 668/1348] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:03.944038 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5df4e-706b-431a-9219-907de38b5e01 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:03.954926 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5df4e-706b-431a-9219-907de38b5e01 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:03.958448 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75401d-f5b6-44aa-9cd9-b054f5256461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:03.959113 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75401d-f5b6-44aa-9cd9-b054f5256461 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:03.959395 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75401d-f5b6-44aa-9cd9-b054f5256461 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:03.959669 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75401d-f5b6-44aa-9cd9-b054f5256461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:03.969120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75401d-f5b6-44aa-9cd9-b054f5256461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:03.970594 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75401d-f5b6-44aa-9cd9-b054f5256461 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:03.980381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 681/1349] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:01:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:01:09.388895 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671593c0-23da-4d34-8f31-d038f187e2e1 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:09.389977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671593c0-23da-4d34-8f31-d038f187e2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:09.390459 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671593c0-23da-4d34-8f31-d038f187e2e1 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:09.392364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 669/1350] 10.222.0.73 () {54 vars in 921 bytes} [Thu May 19 12:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:09.397607 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006055e-c057-4cf6-9469-b1650d330c10 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:09.398456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006055e-c057-4cf6-9469-b1650d330c10 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:09.398939 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006055e-c057-4cf6-9469-b1650d330c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:09.529003 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2006055e-c057-4cf6-9469-b1650d330c10 None None] MFA Rules not processed for user `e9cccb366fc6429e9a30d4f9de64e8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:09.530220 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2006055e-c057-4cf6-9469-b1650d330c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:09.698907 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 682/1351] 10.222.0.73 () {58 vars in 1018 bytes} [Thu May 19 12:01:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:13.869370 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7a6a4-f037-4703-bcbe-20ac5292b228 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:13.870207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7a6a4-f037-4703-bcbe-20ac5292b228 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:13.870667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7a6a4-f037-4703-bcbe-20ac5292b228 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:13.872559 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 670/1352] 10.222.0.73 () {54 vars in 921 bytes} [Thu May 19 12:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:13.877910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46533c-e70c-4f38-b077-52fbebe3a440 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:13.878355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46533c-e70c-4f38-b077-52fbebe3a440 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:13.878474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46533c-e70c-4f38-b077-52fbebe3a440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:13.891431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=13 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:13.900109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ff46533c-e70c-4f38-b077-52fbebe3a440 None None] MFA Rules not processed for user `e9cccb366fc6429e9a30d4f9de64e8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:13.901537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ff46533c-e70c-4f38-b077-52fbebe3a440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:13.910683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 683/1353] 10.222.0.73 () {58 vars in 1018 bytes} [Thu May 19 12:01:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:15.422930 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a9466-3c06-46dd-a428-505871bd9171 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:15.423433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a9466-3c06-46dd-a428-505871bd9171 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:15.423545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a9466-3c06-46dd-a428-505871bd9171 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:15.424885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 671/1354] 10.222.0.73 () {54 vars in 921 bytes} [Thu May 19 12:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:15.429930 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe1a10-2af1-4ced-83d0-35aa61961a52 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:15.430361 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe1a10-2af1-4ced-83d0-35aa61961a52 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:15.430497 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe1a10-2af1-4ced-83d0-35aa61961a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:15.450608 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0fbe1a10-2af1-4ced-83d0-35aa61961a52 None None] MFA Rules not processed for user `e9cccb366fc6429e9a30d4f9de64e8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:15.451837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0fbe1a10-2af1-4ced-83d0-35aa61961a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:15.461572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 684/1355] 10.222.0.73 () {58 vars in 1018 bytes} [Thu May 19 12:01:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:19.234605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fdc79-5f44-4062-a2d4-45e63939dc57 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:19.235110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fdc79-5f44-4062-a2d4-45e63939dc57 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:19.235110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fdc79-5f44-4062-a2d4-45e63939dc57 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:19.236427 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 672/1356] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:19.242064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727eca09-8433-4035-8532-ab197c032559 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:19.242487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727eca09-8433-4035-8532-ab197c032559 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:19.242615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727eca09-8433-4035-8532-ab197c032559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:19.260216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-727eca09-8433-4035-8532-ab197c032559 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:19.261385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-727eca09-8433-4035-8532-ab197c032559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:19.269097 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 685/1357] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:19.321460 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a281a-9a68-4131-ae86-1bdbfc455696 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:19.321991 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a281a-9a68-4131-ae86-1bdbfc455696 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:19.322617 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a281a-9a68-4131-ae86-1bdbfc455696 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:19.324937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 673/1358] 10.222.0.73 () {54 vars in 961 bytes} [Thu May 19 12:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:19.337383 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ebc35-700e-4987-a652-8dd48643f678 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:19.337734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ebc35-700e-4987-a652-8dd48643f678 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:19.338090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ebc35-700e-4987-a652-8dd48643f678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:19.388111 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:19.396436 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0a6ebc35-700e-4987-a652-8dd48643f678 None None] MFA Rules not processed for user `bd0c1f0710f3447d94e67048a508781e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:19.397692 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0a6ebc35-700e-4987-a652-8dd48643f678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:19.482146 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 686/1359] 10.222.0.73 () {58 vars in 1058 bytes} [Thu May 19 12:01:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:19.490870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a281a-9a68-4131-ae86-1bdbfc455696 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:19.505335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a281a-9a68-4131-ae86-1bdbfc455696 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:19.512283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46acbb0-85a3-4121-9532-37d13dfbfb21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:19.513240 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46acbb0-85a3-4121-9532-37d13dfbfb21 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:19.513781 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46acbb0-85a3-4121-9532-37d13dfbfb21 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:19.514230 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46acbb0-85a3-4121-9532-37d13dfbfb21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:19.523372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46acbb0-85a3-4121-9532-37d13dfbfb21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:19.525252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46acbb0-85a3-4121-9532-37d13dfbfb21 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:19.544260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 674/1360] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:01:22.001538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd379d5-b6fe-4027-a5c7-6233bcb9f047 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:22.002069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd379d5-b6fe-4027-a5c7-6233bcb9f047 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:22.002154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd379d5-b6fe-4027-a5c7-6233bcb9f047 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:22.003470 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 687/1361] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:22.013851 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ffe6a-1920-4e47-a655-4bd397b91d11 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:22.014326 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ffe6a-1920-4e47-a655-4bd397b91d11 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:22.014474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ffe6a-1920-4e47-a655-4bd397b91d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:22.032653 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b39ffe6a-1920-4e47-a655-4bd397b91d11 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:22.033873 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b39ffe6a-1920-4e47-a655-4bd397b91d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:22.041721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 675/1362] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:22.086295 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd379d5-b6fe-4027-a5c7-6233bcb9f047 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:22.103501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd379d5-b6fe-4027-a5c7-6233bcb9f047 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:22.110751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312722d-724c-4857-a6b0-11cc6c7f8e2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:22.111406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312722d-724c-4857-a6b0-11cc6c7f8e2e service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:22.111693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312722d-724c-4857-a6b0-11cc6c7f8e2e service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:22.112015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312722d-724c-4857-a6b0-11cc6c7f8e2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:22.122135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312722d-724c-4857-a6b0-11cc6c7f8e2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:22.123728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312722d-724c-4857-a6b0-11cc6c7f8e2e service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:22.134447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 688/1363] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:01:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:01:24.673520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230287c7-470b-49cb-a056-735784000f3b None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:24.674071 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230287c7-470b-49cb-a056-735784000f3b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:24.674071 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230287c7-470b-49cb-a056-735784000f3b None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:24.675450 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 676/1364] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:24.680847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34782b-1431-48a0-97e4-7ec7830f72c2 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:24.681664 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34782b-1431-48a0-97e4-7ec7830f72c2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:24.682089 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34782b-1431-48a0-97e4-7ec7830f72c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:24.703106 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5d34782b-1431-48a0-97e4-7ec7830f72c2 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:24.704414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5d34782b-1431-48a0-97e4-7ec7830f72c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:24.712774 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 689/1365] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:01:24.757102 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a2181-fef1-42b0-81cb-e6508e89f80f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:24.757543 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a2181-fef1-42b0-81cb-e6508e89f80f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:24.757819 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a2181-fef1-42b0-81cb-e6508e89f80f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:24.759382 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 677/1366] 10.222.0.73 () {54 vars in 961 bytes} [Thu May 19 12:01:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:24.764643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2719a5c-afb4-4164-8fa9-7026b4d3fd8b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:24.764937 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2719a5c-afb4-4164-8fa9-7026b4d3fd8b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:24.765219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2719a5c-afb4-4164-8fa9-7026b4d3fd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:24.798652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f2719a5c-afb4-4164-8fa9-7026b4d3fd8b None None] MFA Rules not processed for user `bd0c1f0710f3447d94e67048a508781e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:24.802461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f2719a5c-afb4-4164-8fa9-7026b4d3fd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:24.813637 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 690/1367] 10.222.0.73 () {58 vars in 1058 bytes} [Thu May 19 12:01:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:24.822291 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a2181-fef1-42b0-81cb-e6508e89f80f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:24.837454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a2181-fef1-42b0-81cb-e6508e89f80f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:24.842868 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fd4b5-2952-4556-b39d-765c1b5563c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:24.843504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fd4b5-2952-4556-b39d-765c1b5563c3 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:24.843787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fd4b5-2952-4556-b39d-765c1b5563c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:24.844475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fd4b5-2952-4556-b39d-765c1b5563c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:24.852813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fd4b5-2952-4556-b39d-765c1b5563c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:24.854386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fd4b5-2952-4556-b39d-765c1b5563c3 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:24.863801 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 678/1368] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:01:27.152597 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e9b9c-32db-46a5-96bf-cc2033840d34 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:27.153196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e9b9c-32db-46a5-96bf-cc2033840d34 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:27.153196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e9b9c-32db-46a5-96bf-cc2033840d34 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:27.154544 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 691/1369] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:27.159986 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bffb51-c50a-4134-bae2-8e9b09555e95 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:27.160414 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bffb51-c50a-4134-bae2-8e9b09555e95 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:27.160555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bffb51-c50a-4134-bae2-8e9b09555e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:27.179596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-73bffb51-c50a-4134-bae2-8e9b09555e95 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:27.180853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-73bffb51-c50a-4134-bae2-8e9b09555e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:27.197602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 679/1370] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:27.241292 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e9b9c-32db-46a5-96bf-cc2033840d34 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:27.256278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e9b9c-32db-46a5-96bf-cc2033840d34 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:27.261878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661d935-45b5-4fec-9385-f579d63d16a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:27.262629 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661d935-45b5-4fec-9385-f579d63d16a0 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:27.262991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661d935-45b5-4fec-9385-f579d63d16a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:27.263345 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661d935-45b5-4fec-9385-f579d63d16a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:27.272538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661d935-45b5-4fec-9385-f579d63d16a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:27.274128 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661d935-45b5-4fec-9385-f579d63d16a0 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:27.284005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 692/1371] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:01:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:01:27.552888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc09892-7491-4b16-a120-822a20b338cb None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:27.553276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc09892-7491-4b16-a120-822a20b338cb None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:27.553492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc09892-7491-4b16-a120-822a20b338cb None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:27.555184 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 680/1372] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:27.561192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff0dae-21d7-4c04-b776-3fbcfcd99703 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:27.561489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff0dae-21d7-4c04-b776-3fbcfcd99703 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:27.562065 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff0dae-21d7-4c04-b776-3fbcfcd99703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:27.582071 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-bbff0dae-21d7-4c04-b776-3fbcfcd99703 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:27.584387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bbff0dae-21d7-4c04-b776-3fbcfcd99703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:27.592940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 693/1373] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:27.912903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae365b00-5520-4c62-a3e9-075fa5046fbd None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:27.913340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae365b00-5520-4c62-a3e9-075fa5046fbd None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:27.913707 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae365b00-5520-4c62-a3e9-075fa5046fbd None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:27.915336 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 681/1374] 10.222.0.73 () {54 vars in 963 bytes} [Thu May 19 12:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:27.920667 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022261a1-c784-465e-aa28-aa6ae695089d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:27.921087 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022261a1-c784-465e-aa28-aa6ae695089d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:27.921527 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022261a1-c784-465e-aa28-aa6ae695089d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:27.972051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-022261a1-c784-465e-aa28-aa6ae695089d None None] MFA Rules not processed for user `a44bb5fc455a4965ac6904fb548530f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:27.973401 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-022261a1-c784-465e-aa28-aa6ae695089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:28.040318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 694/1375] 10.222.0.73 () {58 vars in 1060 bytes} [Thu May 19 12:01:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:28.048057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae365b00-5520-4c62-a3e9-075fa5046fbd None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:28.059637 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae365b00-5520-4c62-a3e9-075fa5046fbd None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:28.063570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d06a2-6933-436e-bd6a-0634bbd39136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:28.064519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d06a2-6933-436e-bd6a-0634bbd39136 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:28.064905 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d06a2-6933-436e-bd6a-0634bbd39136 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:28.065280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d06a2-6933-436e-bd6a-0634bbd39136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:28.075810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d06a2-6933-436e-bd6a-0634bbd39136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:28.077396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d06a2-6933-436e-bd6a-0634bbd39136 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:28.087216 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 682/1376] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:01:29.541073 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e093a-1c0d-49e5-bd88-9d780f04e615 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:29.541628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e093a-1c0d-49e5-bd88-9d780f04e615 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:29.541716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e093a-1c0d-49e5-bd88-9d780f04e615 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:29.543436 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 695/1377] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:29.548681 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d5d77-966d-420a-a36b-3ac35e5baad1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:29.549097 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d5d77-966d-420a-a36b-3ac35e5baad1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:29.549244 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d5d77-966d-420a-a36b-3ac35e5baad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:29.567047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-753d5d77-966d-420a-a36b-3ac35e5baad1 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:29.568345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-753d5d77-966d-420a-a36b-3ac35e5baad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:29.576303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 683/1378] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:29.619799 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e093a-1c0d-49e5-bd88-9d780f04e615 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:29.634266 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e093a-1c0d-49e5-bd88-9d780f04e615 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:29.639839 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6b0f1-15c2-4171-aa01-1d1df7952fd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:29.640512 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6b0f1-15c2-4171-aa01-1d1df7952fd9 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:29.640818 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6b0f1-15c2-4171-aa01-1d1df7952fd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:29.641103 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6b0f1-15c2-4171-aa01-1d1df7952fd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:29.650032 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6b0f1-15c2-4171-aa01-1d1df7952fd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:29.651867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6b0f1-15c2-4171-aa01-1d1df7952fd9 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:29.656040 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:29.663196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 696/1379] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:01:32.004938 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784757f-5a3e-42af-8b79-e8e4347792ee None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:32.005468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784757f-5a3e-42af-8b79-e8e4347792ee None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:32.005690 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784757f-5a3e-42af-8b79-e8e4347792ee None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:32.007165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 684/1380] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:32.012299 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2bdaa-40a0-42f6-b3b2-bb6bcd1d77cc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:32.012701 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2bdaa-40a0-42f6-b3b2-bb6bcd1d77cc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:32.012858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2bdaa-40a0-42f6-b3b2-bb6bcd1d77cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:32.030673 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-12b2bdaa-40a0-42f6-b3b2-bb6bcd1d77cc None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:32.032080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-12b2bdaa-40a0-42f6-b3b2-bb6bcd1d77cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:32.040785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 697/1381] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:32.084445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784757f-5a3e-42af-8b79-e8e4347792ee None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:32.099393 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784757f-5a3e-42af-8b79-e8e4347792ee None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:32.104760 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c460c-5e72-45cd-b5e4-43b838f92218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:32.105400 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c460c-5e72-45cd-b5e4-43b838f92218 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:32.105711 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c460c-5e72-45cd-b5e4-43b838f92218 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:32.105989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c460c-5e72-45cd-b5e4-43b838f92218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:32.115198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c460c-5e72-45cd-b5e4-43b838f92218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:32.116804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c460c-5e72-45cd-b5e4-43b838f92218 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:32.128253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 685/1382] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:01:34.401016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f8c52-17c5-4c6f-aad6-baa315bb0161 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.401551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f8c52-17c5-4c6f-aad6-baa315bb0161 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.401698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f8c52-17c5-4c6f-aad6-baa315bb0161 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:34.402965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 698/1383] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:34.408593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a29bf-5077-487a-9a00-7d6d563ff8c5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.409090 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a29bf-5077-487a-9a00-7d6d563ff8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.409246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a29bf-5077-487a-9a00-7d6d563ff8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:34.428557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-dd7a29bf-5077-487a-9a00-7d6d563ff8c5 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:34.429753 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dd7a29bf-5077-487a-9a00-7d6d563ff8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:34.437903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 686/1384] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:34.486145 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f8c52-17c5-4c6f-aad6-baa315bb0161 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:34.501276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f8c52-17c5-4c6f-aad6-baa315bb0161 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:34.506662 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bf4ec-7d97-4334-b654-a57d4fd61b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:34.507304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bf4ec-7d97-4334-b654-a57d4fd61b2d service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:34.507590 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bf4ec-7d97-4334-b654-a57d4fd61b2d service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:34.507868 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bf4ec-7d97-4334-b654-a57d4fd61b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:34.516508 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bf4ec-7d97-4334-b654-a57d4fd61b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:34.518081 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bf4ec-7d97-4334-b654-a57d4fd61b2d service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:34.527972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 699/1385] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:01:36.918653 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03492c4c-e10c-4eab-9ec1-d8c6bc7afe77 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:36.919331 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03492c4c-e10c-4eab-9ec1-d8c6bc7afe77 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:36.919331 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03492c4c-e10c-4eab-9ec1-d8c6bc7afe77 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:36.920696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 687/1386] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:01:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 12:01:36.927773 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8443e2e-fced-4d86-9a31-a36031502e2d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:36.928314 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8443e2e-fced-4d86-9a31-a36031502e2d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:36.928487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8443e2e-fced-4d86-9a31-a36031502e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:36.951464 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e8443e2e-fced-4d86-9a31-a36031502e2d None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:36.953016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e8443e2e-fced-4d86-9a31-a36031502e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:36.963021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 700/1387] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:37.018039 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03492c4c-e10c-4eab-9ec1-d8c6bc7afe77 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:37.035631 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03492c4c-e10c-4eab-9ec1-d8c6bc7afe77 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:37.042272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543abfc1-fb2e-4113-b59c-f4d6d63dc6d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:37.043335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543abfc1-fb2e-4113-b59c-f4d6d63dc6d4 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:37.043729 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543abfc1-fb2e-4113-b59c-f4d6d63dc6d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:37.044108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543abfc1-fb2e-4113-b59c-f4d6d63dc6d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:37.055113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543abfc1-fb2e-4113-b59c-f4d6d63dc6d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:37.057271 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543abfc1-fb2e-4113-b59c-f4d6d63dc6d4 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:37.070738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 688/1388] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:01:39.365121 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ffa0a-03ab-409f-b354-3ece1f974a2d None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:39.365658 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ffa0a-03ab-409f-b354-3ece1f974a2d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:39.365754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ffa0a-03ab-409f-b354-3ece1f974a2d None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:39.367259 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 701/1389] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:01:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:39.372660 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b697d99-786b-4d33-a329-871173e692f6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:39.373230 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b697d99-786b-4d33-a329-871173e692f6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:39.373230 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b697d99-786b-4d33-a329-871173e692f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:39.395284 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3b697d99-786b-4d33-a329-871173e692f6 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:39.396974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3b697d99-786b-4d33-a329-871173e692f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:39.406609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 689/1390] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:39.458782 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ffa0a-03ab-409f-b354-3ece1f974a2d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:39.473860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ffa0a-03ab-409f-b354-3ece1f974a2d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:39.480774 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a43c07-7f07-4742-b3ca-9cb99d503872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:39.481639 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a43c07-7f07-4742-b3ca-9cb99d503872 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:39.481935 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a43c07-7f07-4742-b3ca-9cb99d503872 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:39.482279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a43c07-7f07-4742-b3ca-9cb99d503872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:39.494330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a43c07-7f07-4742-b3ca-9cb99d503872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:39.496551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a43c07-7f07-4742-b3ca-9cb99d503872 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:39.510282 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 702/1391] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:01:42.095665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a0db0-b4a4-44ae-81da-96fed29bcc3f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:42.096346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a0db0-b4a4-44ae-81da-96fed29bcc3f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:42.096346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a0db0-b4a4-44ae-81da-96fed29bcc3f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:42.097653 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 690/1392] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:42.103027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8faf9-74f1-4663-9c47-8aa113d39ce2 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:42.103491 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8faf9-74f1-4663-9c47-8aa113d39ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:42.103602 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8faf9-74f1-4663-9c47-8aa113d39ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:42.121465 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7bd8faf9-74f1-4663-9c47-8aa113d39ce2 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:42.122645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7bd8faf9-74f1-4663-9c47-8aa113d39ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:42.131020 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 703/1393] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:42.174259 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a0db0-b4a4-44ae-81da-96fed29bcc3f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:42.188765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a0db0-b4a4-44ae-81da-96fed29bcc3f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:42.194716 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2b693-98fc-4de0-b030-36557bf8252f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:42.195350 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2b693-98fc-4de0-b030-36557bf8252f service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:42.195633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2b693-98fc-4de0-b030-36557bf8252f service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:42.195909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2b693-98fc-4de0-b030-36557bf8252f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:42.204171 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2b693-98fc-4de0-b030-36557bf8252f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:42.205750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2b693-98fc-4de0-b030-36557bf8252f service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:42.215149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 691/1394] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:01:43.953106 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6c753-47dc-41a4-a5a8-366c3e84fdf3 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:43.953677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6c753-47dc-41a4-a5a8-366c3e84fdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:43.953785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6c753-47dc-41a4-a5a8-366c3e84fdf3 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:43.955164 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 704/1395] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:43.961065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af584e7-1746-4f3f-bc79-7ab68e817033 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:43.961540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af584e7-1746-4f3f-bc79-7ab68e817033 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:43.961643 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af584e7-1746-4f3f-bc79-7ab68e817033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:43.967721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=52 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:43.980921 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-4af584e7-1746-4f3f-bc79-7ab68e817033 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:43.982129 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4af584e7-1746-4f3f-bc79-7ab68e817033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:43.990032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 692/1396] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:44.045886 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cf64d-5c32-4cea-832c-4953f1e4386a None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:44.046181 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cf64d-5c32-4cea-832c-4953f1e4386a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:44.046467 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cf64d-5c32-4cea-832c-4953f1e4386a None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:44.048011 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 705/1397] 10.222.0.73 () {54 vars in 962 bytes} [Thu May 19 12:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:44.052936 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7d576-c2b2-4ffd-9d2e-7773a94f103b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:44.053231 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7d576-c2b2-4ffd-9d2e-7773a94f103b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:44.053513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7d576-c2b2-4ffd-9d2e-7773a94f103b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:44.102671 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-7eb7d576-c2b2-4ffd-9d2e-7773a94f103b None None] MFA Rules not processed for user `182c7bb48c184e9983c02ae86709e803`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:44.103874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7eb7d576-c2b2-4ffd-9d2e-7773a94f103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:44.166006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 693/1398] 10.222.0.73 () {58 vars in 1059 bytes} [Thu May 19 12:01:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:44.174007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cf64d-5c32-4cea-832c-4953f1e4386a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:44.184689 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cf64d-5c32-4cea-832c-4953f1e4386a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:44.188211 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d6948-a8e4-405c-8bdb-a2e0422f93ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182c7bb48c184e9983c02ae86709e803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:44.188840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d6948-a8e4-405c-8bdb-a2e0422f93ef service glance] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:44.189119 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d6948-a8e4-405c-8bdb-a2e0422f93ef service glance] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:44.189392 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d6948-a8e4-405c-8bdb-a2e0422f93ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:44.198714 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d6948-a8e4-405c-8bdb-a2e0422f93ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:44.200149 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d6948-a8e4-405c-8bdb-a2e0422f93ef service glance] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:44.210078 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 706/1399] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:01:44.456642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e4916-ff6f-4eb0-b9e9-0455530c089f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:44.456930 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e4916-ff6f-4eb0-b9e9-0455530c089f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:44.457263 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e4916-ff6f-4eb0-b9e9-0455530c089f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:44.461655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 694/1400] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:01:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:44.469281 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdcae5-3bbf-448f-9442-5db679e68ef7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:44.469822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdcae5-3bbf-448f-9442-5db679e68ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:44.470343 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdcae5-3bbf-448f-9442-5db679e68ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:44.490407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c9cdcae5-3bbf-448f-9442-5db679e68ef7 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:44.491966 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c9cdcae5-3bbf-448f-9442-5db679e68ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:44.499957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 707/1401] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:44.544142 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e4916-ff6f-4eb0-b9e9-0455530c089f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:44.558921 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e4916-ff6f-4eb0-b9e9-0455530c089f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:44.564353 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccb7ff-72eb-4709-9e87-ade147e7f054 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:44.564990 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccb7ff-72eb-4709-9e87-ade147e7f054 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:44.565276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccb7ff-72eb-4709-9e87-ade147e7f054 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:44.565554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccb7ff-72eb-4709-9e87-ade147e7f054 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:44.574665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccb7ff-72eb-4709-9e87-ade147e7f054 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:44.576337 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccb7ff-72eb-4709-9e87-ade147e7f054 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:44.587647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 695/1402] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:01:44.754462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d2639-1431-4706-a0c2-a0f7de4e0780 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:44.754823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d2639-1431-4706-a0c2-a0f7de4e0780 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:44.755040 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d2639-1431-4706-a0c2-a0f7de4e0780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:44.809496 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ee8d2639-1431-4706-a0c2-a0f7de4e0780 None None] MFA Rules not processed for user `b6c5da324ab2405a84036db91a1366a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:44.810743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ee8d2639-1431-4706-a0c2-a0f7de4e0780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:44.877677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 708/1403] 10.222.0.73 () {58 vars in 1009 bytes} [Thu May 19 12:01:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:44.919632 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69839d8-cfca-4ae5-92e3-4c7443c3dfe5 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:44.920059 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69839d8-cfca-4ae5-92e3-4c7443c3dfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:44.920410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69839d8-cfca-4ae5-92e3-4c7443c3dfe5 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:44.921933 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 696/1404] 10.222.0.73 () {54 vars in 942 bytes} [Thu May 19 12:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:44.929094 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d0eda-1746-46ab-8bfe-5d5427873da3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:44.929389 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d0eda-1746-46ab-8bfe-5d5427873da3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:44.929668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d0eda-1746-46ab-8bfe-5d5427873da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:44.978418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1c8d0eda-1746-46ab-8bfe-5d5427873da3 None None] MFA Rules not processed for user `371dae58e95d403b97e311c6616adab5`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:44.979604 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1c8d0eda-1746-46ab-8bfe-5d5427873da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:45.023053 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:45.063231 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 709/1405] 10.222.0.73 () {58 vars in 1039 bytes} [Thu May 19 12:01:44 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:45.072361 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69839d8-cfca-4ae5-92e3-4c7443c3dfe5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:45.086116 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69839d8-cfca-4ae5-92e3-4c7443c3dfe5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:45.091044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56c3b3-60dd-4aa8-95af-8f9fc17597bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371dae58e95d403b97e311c6616adab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:45.091789 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56c3b3-60dd-4aa8-95af-8f9fc17597bc service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:45.092106 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56c3b3-60dd-4aa8-95af-8f9fc17597bc service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:45.092388 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56c3b3-60dd-4aa8-95af-8f9fc17597bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:45.101082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56c3b3-60dd-4aa8-95af-8f9fc17597bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:45.102686 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56c3b3-60dd-4aa8-95af-8f9fc17597bc service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:45.111126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 697/1406] 10.222.0.73 () {60 vars in 1384 bytes} [Thu May 19 12:01:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:01:46.871113 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e6826-4a25-44a2-b772-28a68b8eed69 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:46.877562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e6826-4a25-44a2-b772-28a68b8eed69 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:46.877562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e6826-4a25-44a2-b772-28a68b8eed69 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:46.880387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 710/1407] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:01:46 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:01:46.886242 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8e5a-ece1-425c-8aaa-27ae95f0ae5a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:46.887151 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8e5a-ece1-425c-8aaa-27ae95f0ae5a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:46.902761 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8e5a-ece1-425c-8aaa-27ae95f0ae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:46.971674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-42db8e5a-ece1-425c-8aaa-27ae95f0ae5a None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:01:46.973043 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-42db8e5a-ece1-425c-8aaa-27ae95f0ae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:01:46.982543 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 698/1408] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:01:47.027187 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e6826-4a25-44a2-b772-28a68b8eed69 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:01:47.043673 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e6826-4a25-44a2-b772-28a68b8eed69 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:01:47.049350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a34309-855a-4f04-8650-7809edcc1463 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:01:47.050013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a34309-855a-4f04-8650-7809edcc1463 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:01:47.050306 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a34309-855a-4f04-8650-7809edcc1463 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:01:47.050588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a34309-855a-4f04-8650-7809edcc1463 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:01:47.059537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a34309-855a-4f04-8650-7809edcc1463 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:01:47.061166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a34309-855a-4f04-8650-7809edcc1463 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:01:47.078440 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 711/1409] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:01:56.954359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=55 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:01:57.068584 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=21 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:02:08.264717 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae556fac-2b70-4268-a455-5b6d5b569420 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:08.265348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae556fac-2b70-4268-a455-5b6d5b569420 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:08.265348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae556fac-2b70-4268-a455-5b6d5b569420 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:08.266628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 699/1410] 10.222.0.73 () {54 vars in 918 bytes} [Thu May 19 12:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:08.271617 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a30cfe-7ec8-4a8d-9c8c-0d989e5efae2 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:08.272155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a30cfe-7ec8-4a8d-9c8c-0d989e5efae2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:08.272254 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a30cfe-7ec8-4a8d-9c8c-0d989e5efae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:08.290095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-64a30cfe-7ec8-4a8d-9c8c-0d989e5efae2 None None] MFA Rules not processed for user `e9cccb366fc6429e9a30d4f9de64e8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:08.291277 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-64a30cfe-7ec8-4a8d-9c8c-0d989e5efae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:08.299874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 712/1411] 10.222.0.73 () {58 vars in 1015 bytes} [Thu May 19 12:02:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:08.314152 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c410d-65de-4b8f-8c38-9f8ee1a3eaa3 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:08.314440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c410d-65de-4b8f-8c38-9f8ee1a3eaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:08.314719 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c410d-65de-4b8f-8c38-9f8ee1a3eaa3 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:08.316088 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 700/1412] 10.222.0.73 () {54 vars in 918 bytes} [Thu May 19 12:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:08.320608 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126146c-ba9a-4802-b2d9-9e62e3d2f892 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:08.320907 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126146c-ba9a-4802-b2d9-9e62e3d2f892 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:08.321194 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126146c-ba9a-4802-b2d9-9e62e3d2f892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:08.339013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3126146c-ba9a-4802-b2d9-9e62e3d2f892 None None] MFA Rules not processed for user `bd0c1f0710f3447d94e67048a508781e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:08.340243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3126146c-ba9a-4802-b2d9-9e62e3d2f892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:08.349915 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 713/1413] 10.222.0.73 () {58 vars in 1015 bytes} [Thu May 19 12:02:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:02:11.020584 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc35011-7cd6-4474-8079-ef8234b7bc27 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:11.021136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc35011-7cd6-4474-8079-ef8234b7bc27 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:11.021136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc35011-7cd6-4474-8079-ef8234b7bc27 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:11.022666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:02:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:11.027833 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581c8e5-91b3-48dc-96b2-5d30d6d13134 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:11.028287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581c8e5-91b3-48dc-96b2-5d30d6d13134 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:11.028416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581c8e5-91b3-48dc-96b2-5d30d6d13134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:11.046002 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b581c8e5-91b3-48dc-96b2-5d30d6d13134 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:11.047190 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b581c8e5-91b3-48dc-96b2-5d30d6d13134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:11.054877 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:11.097116 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc35011-7cd6-4474-8079-ef8234b7bc27 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:11.111750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc35011-7cd6-4474-8079-ef8234b7bc27 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:11.117130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba0587-9df3-480c-991b-d88f61e24df1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:11.117778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba0587-9df3-480c-991b-d88f61e24df1 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:11.118045 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba0587-9df3-480c-991b-d88f61e24df1 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:11.118319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba0587-9df3-480c-991b-d88f61e24df1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:11.126260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba0587-9df3-480c-991b-d88f61e24df1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:11.127824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba0587-9df3-480c-991b-d88f61e24df1 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:11.137511 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 702/1416] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:12.114308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa51214-522c-48d2-af78-9abc5372c427 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:12.114886 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa51214-522c-48d2-af78-9abc5372c427 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:12.114886 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa51214-522c-48d2-af78-9abc5372c427 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:12.116326 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:12.121085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a83c25-5364-4429-90c3-9fb4606cc19e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:12.121539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a83c25-5364-4429-90c3-9fb4606cc19e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:12.121645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a83c25-5364-4429-90c3-9fb4606cc19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:12.139199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-21a83c25-5364-4429-90c3-9fb4606cc19e None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:12.140401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-21a83c25-5364-4429-90c3-9fb4606cc19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:12.148729 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:12.322805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa51214-522c-48d2-af78-9abc5372c427 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:12.337420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa51214-522c-48d2-af78-9abc5372c427 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:12.342717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda158eb-4863-4e6c-94bf-1819b1fb52fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:12.343344 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda158eb-4863-4e6c-94bf-1819b1fb52fe service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:12.343632 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda158eb-4863-4e6c-94bf-1819b1fb52fe service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:12.343948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda158eb-4863-4e6c-94bf-1819b1fb52fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:12.352549 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda158eb-4863-4e6c-94bf-1819b1fb52fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:12.354122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda158eb-4863-4e6c-94bf-1819b1fb52fe service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:12.363485 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 716/1419] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:13.303210 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89edd23-b41c-4486-9baa-c8d8fa6b388e None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:13.303778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89edd23-b41c-4486-9baa-c8d8fa6b388e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:13.303778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89edd23-b41c-4486-9baa-c8d8fa6b388e None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:13.305199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:13.310063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba06d04-131a-47d2-b6aa-5389bd82e26f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:13.310515 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba06d04-131a-47d2-b6aa-5389bd82e26f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:13.310625 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba06d04-131a-47d2-b6aa-5389bd82e26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:13.329067 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-aba06d04-131a-47d2-b6aa-5389bd82e26f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:13.330252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-aba06d04-131a-47d2-b6aa-5389bd82e26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:13.337941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:13.487184 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89edd23-b41c-4486-9baa-c8d8fa6b388e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:13.505260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89edd23-b41c-4486-9baa-c8d8fa6b388e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:13.510564 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6251f8b-86c5-42fd-b6da-794ccc9764e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:13.511197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6251f8b-86c5-42fd-b6da-794ccc9764e8 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:13.511483 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6251f8b-86c5-42fd-b6da-794ccc9764e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:13.511759 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6251f8b-86c5-42fd-b6da-794ccc9764e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:13.519824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6251f8b-86c5-42fd-b6da-794ccc9764e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:13.521428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6251f8b-86c5-42fd-b6da-794ccc9764e8 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:13.530643 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 705/1422] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:14.446267 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c518c-f5c7-4bdf-b2ba-fc92028b84c1 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:14.446771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c518c-f5c7-4bdf-b2ba-fc92028b84c1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:14.446898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c518c-f5c7-4bdf-b2ba-fc92028b84c1 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:14.448289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:14.453139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83522595-12d2-4449-96c5-faf5518195f1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:14.453546 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83522595-12d2-4449-96c5-faf5518195f1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:14.453698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83522595-12d2-4449-96c5-faf5518195f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:14.471840 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-83522595-12d2-4449-96c5-faf5518195f1 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:14.473645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-83522595-12d2-4449-96c5-faf5518195f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:14.481879 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:14.628310 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c518c-f5c7-4bdf-b2ba-fc92028b84c1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:14.642406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c518c-f5c7-4bdf-b2ba-fc92028b84c1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:14.648341 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f15352-12a8-4797-95d1-25544c8a890e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:14.648971 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f15352-12a8-4797-95d1-25544c8a890e service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:14.649258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f15352-12a8-4797-95d1-25544c8a890e service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:14.649543 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f15352-12a8-4797-95d1-25544c8a890e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:14.657609 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f15352-12a8-4797-95d1-25544c8a890e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:14.659186 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f15352-12a8-4797-95d1-25544c8a890e service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:14.669422 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 719/1425] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:15.603306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031da36e-a560-4d6c-8374-06a07dfae428 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:15.603839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031da36e-a560-4d6c-8374-06a07dfae428 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:15.603839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031da36e-a560-4d6c-8374-06a07dfae428 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:15.605260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:15.610071 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc81e-ea15-4951-9c5f-671f39755a63 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:15.610495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc81e-ea15-4951-9c5f-671f39755a63 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:15.610633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc81e-ea15-4951-9c5f-671f39755a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:15.628727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1acdc81e-ea15-4951-9c5f-671f39755a63 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:15.629843 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1acdc81e-ea15-4951-9c5f-671f39755a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:15.637399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:15.785003 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031da36e-a560-4d6c-8374-06a07dfae428 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:15.799348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031da36e-a560-4d6c-8374-06a07dfae428 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:15.807069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330202c2-4477-4821-8946-e6cc46ea22f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:15.807721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330202c2-4477-4821-8946-e6cc46ea22f2 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:15.808039 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330202c2-4477-4821-8946-e6cc46ea22f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:15.808315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330202c2-4477-4821-8946-e6cc46ea22f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:15.817218 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330202c2-4477-4821-8946-e6cc46ea22f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:15.818807 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330202c2-4477-4821-8946-e6cc46ea22f2 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:15.828872 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 708/1428] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:16.692591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76a206-f4e0-4fe3-9acc-20e742750864 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:16.693129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76a206-f4e0-4fe3-9acc-20e742750864 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:16.693129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76a206-f4e0-4fe3-9acc-20e742750864 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:16.694477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:16.699199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6c70-795a-41d2-80bc-d75d212f5094 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:16.699586 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6c70-795a-41d2-80bc-d75d212f5094 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:16.699753 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6c70-795a-41d2-80bc-d75d212f5094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:16.717243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ab8e6c70-795a-41d2-80bc-d75d212f5094 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:16.718456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ab8e6c70-795a-41d2-80bc-d75d212f5094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:16.726041 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:16.873987 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76a206-f4e0-4fe3-9acc-20e742750864 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:16.888481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76a206-f4e0-4fe3-9acc-20e742750864 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:16.893726 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681fa4e-b909-4f27-babe-b0869bb26abb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:16.894383 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681fa4e-b909-4f27-babe-b0869bb26abb service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:16.894664 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681fa4e-b909-4f27-babe-b0869bb26abb service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:16.894937 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681fa4e-b909-4f27-babe-b0869bb26abb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:16.902876 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681fa4e-b909-4f27-babe-b0869bb26abb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:16.904480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681fa4e-b909-4f27-babe-b0869bb26abb service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:16.913837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 722/1431] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:17.790773 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77f5a7-0710-42da-bbb6-cb5b8e2c9768 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:17.791314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77f5a7-0710-42da-bbb6-cb5b8e2c9768 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:17.791314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77f5a7-0710-42da-bbb6-cb5b8e2c9768 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:17.792636 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:17.797772 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fec4a5-ca46-4a14-8c86-bc9d51a42458 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:17.798218 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fec4a5-ca46-4a14-8c86-bc9d51a42458 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:17.798314 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fec4a5-ca46-4a14-8c86-bc9d51a42458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:17.816748 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-92fec4a5-ca46-4a14-8c86-bc9d51a42458 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:17.817938 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-92fec4a5-ca46-4a14-8c86-bc9d51a42458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:17.825561 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:17.975892 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77f5a7-0710-42da-bbb6-cb5b8e2c9768 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:17.989998 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77f5a7-0710-42da-bbb6-cb5b8e2c9768 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:17.995410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63075aa5-d3dd-4158-a52f-892b18cf509d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:17.996076 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63075aa5-d3dd-4158-a52f-892b18cf509d service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:17.996362 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63075aa5-d3dd-4158-a52f-892b18cf509d service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:17.996638 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63075aa5-d3dd-4158-a52f-892b18cf509d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:18.005096 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63075aa5-d3dd-4158-a52f-892b18cf509d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:18.006664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63075aa5-d3dd-4158-a52f-892b18cf509d service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:18.015846 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 711/1434] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:18.877056 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba76df-a07d-4a78-a23d-57de9e3e2d24 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:18.877498 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba76df-a07d-4a78-a23d-57de9e3e2d24 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:18.877625 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba76df-a07d-4a78-a23d-57de9e3e2d24 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:18.879022 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 12:02:18.883981 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdbfbf-efe5-414b-b2ad-cc7903f34cb0 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:18.884386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdbfbf-efe5-414b-b2ad-cc7903f34cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:18.884536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdbfbf-efe5-414b-b2ad-cc7903f34cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:18.902628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-7cbdbfbf-efe5-414b-b2ad-cc7903f34cb0 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:18.903803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7cbdbfbf-efe5-414b-b2ad-cc7903f34cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:18.912057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:19.070022 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba76df-a07d-4a78-a23d-57de9e3e2d24 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:19.084196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba76df-a07d-4a78-a23d-57de9e3e2d24 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:19.089576 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10c63c-7d2a-471e-948b-c5218eec9cd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:19.090216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10c63c-7d2a-471e-948b-c5218eec9cd1 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:19.090499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10c63c-7d2a-471e-948b-c5218eec9cd1 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:19.090779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10c63c-7d2a-471e-948b-c5218eec9cd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:19.098858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10c63c-7d2a-471e-948b-c5218eec9cd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:19.100477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10c63c-7d2a-471e-948b-c5218eec9cd1 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:19.109666 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 725/1437] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:19.974901 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba5314-52aa-47d6-a32a-7f44f6f37070 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:19.975443 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba5314-52aa-47d6-a32a-7f44f6f37070 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:19.975443 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba5314-52aa-47d6-a32a-7f44f6f37070 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:19.976889 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:19.981804 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a12fd-f5b3-42da-b95d-0d22c31d4b9f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:19.982241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a12fd-f5b3-42da-b95d-0d22c31d4b9f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:19.982348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a12fd-f5b3-42da-b95d-0d22c31d4b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:19.999894 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-976a12fd-f5b3-42da-b95d-0d22c31d4b9f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:20.001124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-976a12fd-f5b3-42da-b95d-0d22c31d4b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:20.009289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:20.158573 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba5314-52aa-47d6-a32a-7f44f6f37070 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:20.172854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba5314-52aa-47d6-a32a-7f44f6f37070 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:20.178165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc7f00-eefc-4c11-9797-e4629af74a8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:20.178818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc7f00-eefc-4c11-9797-e4629af74a8e service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:20.179100 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc7f00-eefc-4c11-9797-e4629af74a8e service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:20.179377 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc7f00-eefc-4c11-9797-e4629af74a8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:20.187241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc7f00-eefc-4c11-9797-e4629af74a8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:20.188847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc7f00-eefc-4c11-9797-e4629af74a8e service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:20.198426 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 714/1440] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:22.292297 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dd5d3-3d1e-4e4e-82af-b07eef505463 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:22.293071 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dd5d3-3d1e-4e4e-82af-b07eef505463 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:22.293169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dd5d3-3d1e-4e4e-82af-b07eef505463 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:22.294488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:22.299886 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc9d9e-4bd2-4359-a3aa-c8377caeabdd None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:22.300368 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc9d9e-4bd2-4359-a3aa-c8377caeabdd None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:22.300477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc9d9e-4bd2-4359-a3aa-c8377caeabdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:22.318504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-78cc9d9e-4bd2-4359-a3aa-c8377caeabdd None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:22.319688 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-78cc9d9e-4bd2-4359-a3aa-c8377caeabdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:22.327304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:22.365279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dd5d3-3d1e-4e4e-82af-b07eef505463 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:22.376116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dd5d3-3d1e-4e4e-82af-b07eef505463 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:22.380208 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf218882-8c51-4702-9648-f57e009eade5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:22.380876 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf218882-8c51-4702-9648-f57e009eade5 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:22.381163 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf218882-8c51-4702-9648-f57e009eade5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:22.381446 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf218882-8c51-4702-9648-f57e009eade5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:22.390652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf218882-8c51-4702-9648-f57e009eade5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:22.392100 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf218882-8c51-4702-9648-f57e009eade5 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:22.401992 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 728/1443] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:24.745617 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43088a97-627a-4751-aa8c-b04ed06f35e2 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:24.746144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43088a97-627a-4751-aa8c-b04ed06f35e2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:24.746144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43088a97-627a-4751-aa8c-b04ed06f35e2 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:24.747452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:24.752659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b27360-daf3-4480-b269-b9a5489c3188 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:24.753620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b27360-daf3-4480-b269-b9a5489c3188 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:24.753718 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b27360-daf3-4480-b269-b9a5489c3188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:24.771762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-75b27360-daf3-4480-b269-b9a5489c3188 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:24.772985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-75b27360-daf3-4480-b269-b9a5489c3188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:24.780644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:24.818350 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43088a97-627a-4751-aa8c-b04ed06f35e2 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:24.828889 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43088a97-627a-4751-aa8c-b04ed06f35e2 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:24.833022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa464ce-eda4-4dbe-9315-69ac2e67b06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:24.833650 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa464ce-eda4-4dbe-9315-69ac2e67b06a service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:24.833933 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa464ce-eda4-4dbe-9315-69ac2e67b06a service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:24.834209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa464ce-eda4-4dbe-9315-69ac2e67b06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:24.843247 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa464ce-eda4-4dbe-9315-69ac2e67b06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:24.844690 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa464ce-eda4-4dbe-9315-69ac2e67b06a service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:24.853834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 717/1446] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:27.359835 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53962a7e-4369-4deb-8c79-78705341884b None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:27.360432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53962a7e-4369-4deb-8c79-78705341884b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:27.360432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53962a7e-4369-4deb-8c79-78705341884b None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:27.361875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:27.367842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9178c13-7b36-4aa7-b2f7-16119c6eaf58 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:27.368317 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9178c13-7b36-4aa7-b2f7-16119c6eaf58 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:27.368416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9178c13-7b36-4aa7-b2f7-16119c6eaf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:27.386338 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a9178c13-7b36-4aa7-b2f7-16119c6eaf58 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:27.387857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a9178c13-7b36-4aa7-b2f7-16119c6eaf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:27.395977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:27.433903 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53962a7e-4369-4deb-8c79-78705341884b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:27.445092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53962a7e-4369-4deb-8c79-78705341884b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:27.448593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d857d-4157-46cc-8a91-d94a3db94c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:27.449226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d857d-4157-46cc-8a91-d94a3db94c5b service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:27.449517 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d857d-4157-46cc-8a91-d94a3db94c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:27.449800 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d857d-4157-46cc-8a91-d94a3db94c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:27.458560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d857d-4157-46cc-8a91-d94a3db94c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:27.460025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d857d-4157-46cc-8a91-d94a3db94c5b service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:27.469349 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 731/1449] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:29.786213 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3f35c-34f1-4c1f-9eff-6663f31b2bbc None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:29.786805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3f35c-34f1-4c1f-9eff-6663f31b2bbc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:29.786805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3f35c-34f1-4c1f-9eff-6663f31b2bbc None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:29.788092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:29.793827 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cd796-b083-4b7c-8a68-7c40536d476f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:29.794254 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cd796-b083-4b7c-8a68-7c40536d476f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:29.794384 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cd796-b083-4b7c-8a68-7c40536d476f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:29.811974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ac8cd796-b083-4b7c-8a68-7c40536d476f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:29.813181 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ac8cd796-b083-4b7c-8a68-7c40536d476f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:29.821416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:02:29.858384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3f35c-34f1-4c1f-9eff-6663f31b2bbc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:29.868970 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3f35c-34f1-4c1f-9eff-6663f31b2bbc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:29.872463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5b94f-773e-4725-bd08-71b57a3fb864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:29.873097 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5b94f-773e-4725-bd08-71b57a3fb864 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:29.873383 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5b94f-773e-4725-bd08-71b57a3fb864 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:29.873665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5b94f-773e-4725-bd08-71b57a3fb864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:29.882889 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5b94f-773e-4725-bd08-71b57a3fb864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:29.884352 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5b94f-773e-4725-bd08-71b57a3fb864 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:29.894429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 720/1452] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:32.165808 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce3bc1-fe40-4b9f-a483-97f4bf09bb93 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:32.166394 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce3bc1-fe40-4b9f-a483-97f4bf09bb93 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:32.166394 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce3bc1-fe40-4b9f-a483-97f4bf09bb93 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:32.168222 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:32.173343 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d83ae5-aa97-4720-8201-d75b4ae71155 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:32.173758 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d83ae5-aa97-4720-8201-d75b4ae71155 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:32.173910 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d83ae5-aa97-4720-8201-d75b4ae71155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:32.192055 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d2d83ae5-aa97-4720-8201-d75b4ae71155 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:32.193244 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d2d83ae5-aa97-4720-8201-d75b4ae71155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:32.200968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:32.238468 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce3bc1-fe40-4b9f-a483-97f4bf09bb93 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:32.240172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a3ce3bc1-fe40-4b9f-a483-97f4bf09bb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:32.253433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce3bc1-fe40-4b9f-a483-97f4bf09bb93 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:32.256921 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0ae31-9ba1-4ba8-999c-64bca1f4f6d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:32.257555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0ae31-9ba1-4ba8-999c-64bca1f4f6d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:32.257836 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0ae31-9ba1-4ba8-999c-64bca1f4f6d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:32.258112 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0ae31-9ba1-4ba8-999c-64bca1f4f6d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:32.266766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0ae31-9ba1-4ba8-999c-64bca1f4f6d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:32.268212 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0ae31-9ba1-4ba8-999c-64bca1f4f6d1 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:32.277887 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 734/1455] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:34.604593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da286225-9350-4830-859e-318de53a5807 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:34.605148 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da286225-9350-4830-859e-318de53a5807 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:34.605148 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da286225-9350-4830-859e-318de53a5807 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:34.606518 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:34.611693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b475fed-7949-4b0e-8350-6a0755c7550d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:34.612194 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b475fed-7949-4b0e-8350-6a0755c7550d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:34.612338 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b475fed-7949-4b0e-8350-6a0755c7550d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:34.629705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9b475fed-7949-4b0e-8350-6a0755c7550d None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:34.630834 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9b475fed-7949-4b0e-8350-6a0755c7550d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:34.638566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:34.676105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da286225-9350-4830-859e-318de53a5807 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:34.686602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da286225-9350-4830-859e-318de53a5807 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:34.690068 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d816b2-b101-4b50-acf1-d8d345ad18e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:34.690694 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d816b2-b101-4b50-acf1-d8d345ad18e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:34.690980 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d816b2-b101-4b50-acf1-d8d345ad18e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:34.691254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d816b2-b101-4b50-acf1-d8d345ad18e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:34.700115 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d816b2-b101-4b50-acf1-d8d345ad18e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:34.701573 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d816b2-b101-4b50-acf1-d8d345ad18e7 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:34.711527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 723/1458] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:36.976399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8cf7b-ac4a-4158-bf38-3635c2c8bea1 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:36.977047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8cf7b-ac4a-4158-bf38-3635c2c8bea1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:36.977047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8cf7b-ac4a-4158-bf38-3635c2c8bea1 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:36.978403 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:36.983638 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cef1e-fdbf-40c3-9f5c-8cf51b3dfd62 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:36.984079 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cef1e-fdbf-40c3-9f5c-8cf51b3dfd62 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:36.984246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cef1e-fdbf-40c3-9f5c-8cf51b3dfd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:36.990731 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=70 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:02:37.004122 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b57cef1e-fdbf-40c3-9f5c-8cf51b3dfd62 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:37.005329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b57cef1e-fdbf-40c3-9f5c-8cf51b3dfd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:37.013017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:37.049084 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8cf7b-ac4a-4158-bf38-3635c2c8bea1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:37.060013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8cf7b-ac4a-4158-bf38-3635c2c8bea1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:37.063434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388cdcc-8cf6-4ab9-a26c-2afde38895fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:37.064108 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388cdcc-8cf6-4ab9-a26c-2afde38895fc service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:37.064395 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388cdcc-8cf6-4ab9-a26c-2afde38895fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:37.064672 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388cdcc-8cf6-4ab9-a26c-2afde38895fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:37.072240 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=76 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:02:37.074932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388cdcc-8cf6-4ab9-a26c-2afde38895fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:37.076724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388cdcc-8cf6-4ab9-a26c-2afde38895fc service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:37.086112 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 737/1461] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:39.342579 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09357-8448-48de-82d8-01a754af220a None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:39.343152 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09357-8448-48de-82d8-01a754af220a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:39.343152 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09357-8448-48de-82d8-01a754af220a None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:39.344545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:39.350353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad50873-a95c-4927-ac1d-1f401c181dc0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:39.350755 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad50873-a95c-4927-ac1d-1f401c181dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:39.350913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad50873-a95c-4927-ac1d-1f401c181dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:39.368357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8ad50873-a95c-4927-ac1d-1f401c181dc0 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:39.369547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8ad50873-a95c-4927-ac1d-1f401c181dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:39.377943 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:39.415111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead09357-8448-48de-82d8-01a754af220a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:39.425897 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead09357-8448-48de-82d8-01a754af220a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:39.429370 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0441b-9baa-4bff-b3ad-84324e65219d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:39.429995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0441b-9baa-4bff-b3ad-84324e65219d service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:39.430279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0441b-9baa-4bff-b3ad-84324e65219d service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:39.430554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0441b-9baa-4bff-b3ad-84324e65219d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:39.439272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0441b-9baa-4bff-b3ad-84324e65219d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:39.441251 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0441b-9baa-4bff-b3ad-84324e65219d service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:39.450438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 726/1464] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:41.687321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a1c6-e9c3-40de-925e-b316096148e1 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:41.687853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a1c6-e9c3-40de-925e-b316096148e1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:41.687853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a1c6-e9c3-40de-925e-b316096148e1 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:41.689211 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:41.694923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16904ccc-5bfa-4624-ba16-9933cbcb34e4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:41.695357 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16904ccc-5bfa-4624-ba16-9933cbcb34e4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:41.695469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16904ccc-5bfa-4624-ba16-9933cbcb34e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:41.713553 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-16904ccc-5bfa-4624-ba16-9933cbcb34e4 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:41.714747 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-16904ccc-5bfa-4624-ba16-9933cbcb34e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:41.722390 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:41.757997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449a1c6-e9c3-40de-925e-b316096148e1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:41.769104 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449a1c6-e9c3-40de-925e-b316096148e1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:41.772585 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc7723-f5f3-46a3-a3e1-a4989971c356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:41.773214 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc7723-f5f3-46a3-a3e1-a4989971c356 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:41.773500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc7723-f5f3-46a3-a3e1-a4989971c356 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:41.773777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc7723-f5f3-46a3-a3e1-a4989971c356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:41.782570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc7723-f5f3-46a3-a3e1-a4989971c356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:41.784048 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc7723-f5f3-46a3-a3e1-a4989971c356 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:41.793534 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 740/1467] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:44.013805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97dea6-1bf9-4d59-bbe0-79af8d801568 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:44.014373 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97dea6-1bf9-4d59-bbe0-79af8d801568 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:44.014373 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97dea6-1bf9-4d59-bbe0-79af8d801568 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:44.015726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:02:44.021514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c32de7-5d93-42d9-9e88-92dbcf8681c1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:44.021946 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c32de7-5d93-42d9-9e88-92dbcf8681c1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:44.022109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c32de7-5d93-42d9-9e88-92dbcf8681c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:44.039952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-99c32de7-5d93-42d9-9e88-92dbcf8681c1 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:02:44.041140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-99c32de7-5d93-42d9-9e88-92dbcf8681c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:02:44.049010 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:02:44.084666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97dea6-1bf9-4d59-bbe0-79af8d801568 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:02:44.095325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97dea6-1bf9-4d59-bbe0-79af8d801568 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:02:44.098952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd3d4d-ec90-4ffd-adb8-4ae3796ee1bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:02:44.099616 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd3d4d-ec90-4ffd-adb8-4ae3796ee1bf service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:02:44.099902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd3d4d-ec90-4ffd-adb8-4ae3796ee1bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:02:44.100208 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd3d4d-ec90-4ffd-adb8-4ae3796ee1bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:02:44.109090 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd3d4d-ec90-4ffd-adb8-4ae3796ee1bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:02:44.110511 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd3d4d-ec90-4ffd-adb8-4ae3796ee1bf service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:02:44.119704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 729/1470] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:02:54.034791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=14 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:02:54.115640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=17 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:03:17.195514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3aeb4-4477-4433-8a47-60b2e7776239 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:17.196130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3aeb4-4477-4433-8a47-60b2e7776239 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:17.196130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3aeb4-4477-4433-8a47-60b2e7776239 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:17.197514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 742/1471] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:03:17.202675 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2815811-4b2a-409a-b146-2fb6c1240592 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:17.203103 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2815811-4b2a-409a-b146-2fb6c1240592 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:17.203241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2815811-4b2a-409a-b146-2fb6c1240592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:17.221451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f2815811-4b2a-409a-b146-2fb6c1240592 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:17.222641 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f2815811-4b2a-409a-b146-2fb6c1240592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:17.230358 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 730/1472] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:03:17.277165 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e5de2-d37d-4c18-acd1-d5f46bdc0bf7 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:17.277461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e5de2-d37d-4c18-acd1-d5f46bdc0bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:17.277748 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e5de2-d37d-4c18-acd1-d5f46bdc0bf7 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:17.279126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 743/1473] 10.222.0.73 () {54 vars in 962 bytes} [Thu May 19 12:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:03:17.284417 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15725e8c-c028-4bdb-9803-a80d7a1db19f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:17.284736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15725e8c-c028-4bdb-9803-a80d7a1db19f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:17.285000 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15725e8c-c028-4bdb-9803-a80d7a1db19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:17.304325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-15725e8c-c028-4bdb-9803-a80d7a1db19f None None] MFA Rules not processed for user `182c7bb48c184e9983c02ae86709e803`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:17.305502 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-15725e8c-c028-4bdb-9803-a80d7a1db19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:17.311716 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 731/1474] 10.222.0.73 () {58 vars in 1059 bytes} [Thu May 19 12:03:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:03:17.318584 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e5de2-d37d-4c18-acd1-d5f46bdc0bf7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:03:17.329623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e5de2-d37d-4c18-acd1-d5f46bdc0bf7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:03:17.333226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c31ed3-6f3a-4589-a32b-fdcae6df82e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182c7bb48c184e9983c02ae86709e803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:03:17.333852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c31ed3-6f3a-4589-a32b-fdcae6df82e1 service glance] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:17.334141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c31ed3-6f3a-4589-a32b-fdcae6df82e1 service glance] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:17.334424 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c31ed3-6f3a-4589-a32b-fdcae6df82e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:17.343288 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c31ed3-6f3a-4589-a32b-fdcae6df82e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:03:17.344736 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c31ed3-6f3a-4589-a32b-fdcae6df82e1 service glance] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:03:17.354634 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 744/1475] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:03:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:03:19.651342 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad35ad5-ff74-41ee-91ee-ce32354f1f5f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:19.651877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad35ad5-ff74-41ee-91ee-ce32354f1f5f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:19.651877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad35ad5-ff74-41ee-91ee-ce32354f1f5f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:19.653227 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 732/1476] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:03:19.658371 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b373f-5677-414c-a5de-833ae07e9617 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:19.658849 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b373f-5677-414c-a5de-833ae07e9617 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:19.658954 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b373f-5677-414c-a5de-833ae07e9617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:19.677104 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-722b373f-5677-414c-a5de-833ae07e9617 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:19.678326 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-722b373f-5677-414c-a5de-833ae07e9617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:19.686064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 745/1477] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:03:19.709090 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad35ad5-ff74-41ee-91ee-ce32354f1f5f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:03:19.721395 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad35ad5-ff74-41ee-91ee-ce32354f1f5f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:03:19.725855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ca334-9b29-4b58-9fcb-b934b6b467cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:03:19.726498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ca334-9b29-4b58-9fcb-b934b6b467cc admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:19.726787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ca334-9b29-4b58-9fcb-b934b6b467cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:19.727060 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ca334-9b29-4b58-9fcb-b934b6b467cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:19.727791 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ca334-9b29-4b58-9fcb-b934b6b467cc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:03:19.729558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-339ca334-9b29-4b58-9fcb-b934b6b467cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:03:19.729558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: warnings.warn(msg) May 19 12:03:19.729558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: May 19 12:03:19.730703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ca334-9b29-4b58-9fcb-b934b6b467cc admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:03:19.749980 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 733/1478] 10.222.0.73 () {56 vars in 1108 bytes} [Thu May 19 12:03:19 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:03:21.986023 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6ed92-f9d8-4e81-9eaa-8c95950ce5d8 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:21.986562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6ed92-f9d8-4e81-9eaa-8c95950ce5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:21.986562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6ed92-f9d8-4e81-9eaa-8c95950ce5d8 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:21.987961 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 746/1479] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:03:21.993376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e146728-441b-4489-a91f-05f9badec5ad None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:21.993802 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e146728-441b-4489-a91f-05f9badec5ad None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:21.994042 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e146728-441b-4489-a91f-05f9badec5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:22.011645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9e146728-441b-4489-a91f-05f9badec5ad None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:22.012864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9e146728-441b-4489-a91f-05f9badec5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:22.021134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 734/1480] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:03:22.064213 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6ed92-f9d8-4e81-9eaa-8c95950ce5d8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:03:22.078591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6ed92-f9d8-4e81-9eaa-8c95950ce5d8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:03:22.084383 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee436d22-63d6-4e91-817c-1f2c8a4f2a9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:03:22.085019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee436d22-63d6-4e91-817c-1f2c8a4f2a9f service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:22.085299 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee436d22-63d6-4e91-817c-1f2c8a4f2a9f service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:22.085572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee436d22-63d6-4e91-817c-1f2c8a4f2a9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:22.093476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee436d22-63d6-4e91-817c-1f2c8a4f2a9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:03:22.095677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee436d22-63d6-4e91-817c-1f2c8a4f2a9f service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:03:22.104818 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 747/1481] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:03:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:03:24.477527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8becb4b-1706-4c3b-9e3c-7c5854520948 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:24.478051 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8becb4b-1706-4c3b-9e3c-7c5854520948 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:24.478169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8becb4b-1706-4c3b-9e3c-7c5854520948 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:24.479456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 735/1482] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:03:24.484871 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4085b23-99fb-4085-83bc-18a9c90a5e87 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:24.485829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4085b23-99fb-4085-83bc-18a9c90a5e87 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:24.486064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4085b23-99fb-4085-83bc-18a9c90a5e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:24.503523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b4085b23-99fb-4085-83bc-18a9c90a5e87 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:24.504758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b4085b23-99fb-4085-83bc-18a9c90a5e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:24.512551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 748/1483] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:03:24.548923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8becb4b-1706-4c3b-9e3c-7c5854520948 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:03:24.559510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8becb4b-1706-4c3b-9e3c-7c5854520948 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:03:24.563012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68234a4b-eb9d-4f42-9477-9e67007d25f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:03:24.563644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68234a4b-eb9d-4f42-9477-9e67007d25f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:24.563950 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68234a4b-eb9d-4f42-9477-9e67007d25f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:24.564232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68234a4b-eb9d-4f42-9477-9e67007d25f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:24.572946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68234a4b-eb9d-4f42-9477-9e67007d25f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:03:24.574367 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68234a4b-eb9d-4f42-9477-9e67007d25f8 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:03:24.583663 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 736/1484] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:03:26.847410 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcb5cc-159b-4bf4-9ab7-c348434f64c1 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:26.847981 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcb5cc-159b-4bf4-9ab7-c348434f64c1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:26.848107 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcb5cc-159b-4bf4-9ab7-c348434f64c1 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:26.849396 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 749/1485] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:03:26.854639 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5cdf5-4faf-4cda-b6d9-4c4f0b1a9cee None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:26.855024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5cdf5-4faf-4cda-b6d9-4c4f0b1a9cee None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:26.855199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5cdf5-4faf-4cda-b6d9-4c4f0b1a9cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:26.872892 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-70a5cdf5-4faf-4cda-b6d9-4c4f0b1a9cee None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:26.874084 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-70a5cdf5-4faf-4cda-b6d9-4c4f0b1a9cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:26.882336 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 737/1486] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:03:26.919708 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcb5cc-159b-4bf4-9ab7-c348434f64c1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:03:26.930615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcb5cc-159b-4bf4-9ab7-c348434f64c1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:03:26.934200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5613239-c33e-49c9-94f8-76908c379641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:03:26.934839 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5613239-c33e-49c9-94f8-76908c379641 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:26.935121 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5613239-c33e-49c9-94f8-76908c379641 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:26.935394 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5613239-c33e-49c9-94f8-76908c379641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:26.944823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5613239-c33e-49c9-94f8-76908c379641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:03:26.946272 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5613239-c33e-49c9-94f8-76908c379641 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:03:26.956027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 750/1487] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:03:29.264373 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a9814-18dc-44ec-8e59-ee6279128e73 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:29.264917 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a9814-18dc-44ec-8e59-ee6279128e73 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:29.264917 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a9814-18dc-44ec-8e59-ee6279128e73 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:29.266872 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 738/1488] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:03:29.272265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95ea0b-1713-4796-81af-f8d9ecf525f6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:29.272707 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95ea0b-1713-4796-81af-f8d9ecf525f6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:29.272839 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95ea0b-1713-4796-81af-f8d9ecf525f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:29.290617 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0a95ea0b-1713-4796-81af-f8d9ecf525f6 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:29.291852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0a95ea0b-1713-4796-81af-f8d9ecf525f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:29.299979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 751/1489] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:03:29.340272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a9814-18dc-44ec-8e59-ee6279128e73 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:03:29.350800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a9814-18dc-44ec-8e59-ee6279128e73 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:03:29.354252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd59ad-ff20-402d-b99b-a0eb672706c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:03:29.354875 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd59ad-ff20-402d-b99b-a0eb672706c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:29.355159 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd59ad-ff20-402d-b99b-a0eb672706c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:29.355433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd59ad-ff20-402d-b99b-a0eb672706c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:29.364802 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd59ad-ff20-402d-b99b-a0eb672706c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:03:29.366237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd59ad-ff20-402d-b99b-a0eb672706c4 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:03:29.376481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 739/1490] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:03:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:03:31.802542 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a57136-a593-4f02-bafb-26d7bf55316d None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:31.803129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a57136-a593-4f02-bafb-26d7bf55316d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:31.803129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a57136-a593-4f02-bafb-26d7bf55316d None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:31.804902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 752/1491] 10.222.0.73 () {54 vars in 926 bytes} [Thu May 19 12:03:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:03:31.812978 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133cf3e-0005-405d-a5cc-cfc933cb6bcf None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:31.813454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133cf3e-0005-405d-a5cc-cfc933cb6bcf None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:31.813562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133cf3e-0005-405d-a5cc-cfc933cb6bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:31.834025 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9133cf3e-0005-405d-a5cc-cfc933cb6bcf None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:03:31.835226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9133cf3e-0005-405d-a5cc-cfc933cb6bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:03:31.842989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 740/1492] 10.222.0.73 () {58 vars in 1023 bytes} [Thu May 19 12:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:03:31.881201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a57136-a593-4f02-bafb-26d7bf55316d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:03:31.892575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a57136-a593-4f02-bafb-26d7bf55316d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:03:31.896138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fab401-ae98-4ae2-a2af-4be5a2ade04d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:03:31.896778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fab401-ae98-4ae2-a2af-4be5a2ade04d service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:03:31.897068 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fab401-ae98-4ae2-a2af-4be5a2ade04d service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:03:31.897352 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fab401-ae98-4ae2-a2af-4be5a2ade04d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:03:31.906323 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fab401-ae98-4ae2-a2af-4be5a2ade04d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:03:31.908502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fab401-ae98-4ae2-a2af-4be5a2ade04d service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:03:31.918517 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 753/1493] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:03:41.827502 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=33 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:03:41.913890 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=33 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:11.504218 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186471b-f70f-4f23-96e4-9cac738922f9 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:11.504677 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186471b-f70f-4f23-96e4-9cac738922f9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:11.504783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186471b-f70f-4f23-96e4-9cac738922f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:11.522467 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b186471b-f70f-4f23-96e4-9cac738922f9 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:11.523658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b186471b-f70f-4f23-96e4-9cac738922f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:11.531454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 741/1494] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:11.541239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3a203-5b12-4535-b8cb-3358886e3613 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:11.541973 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3a203-5b12-4535-b8cb-3358886e3613 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:11.542081 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3a203-5b12-4535-b8cb-3358886e3613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:11.566176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a8b3a203-5b12-4535-b8cb-3358886e3613 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:11.567391 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a8b3a203-5b12-4535-b8cb-3358886e3613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:11.575230 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 754/1495] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:05:11.579708 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186471b-f70f-4f23-96e4-9cac738922f9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:11.589256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186471b-f70f-4f23-96e4-9cac738922f9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:11.593837 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ec20f-a1b7-4b84-b515-bbbe306a667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:11.594488 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ec20f-a1b7-4b84-b515-bbbe306a667e admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:11.594779 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ec20f-a1b7-4b84-b515-bbbe306a667e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:11.595058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ec20f-a1b7-4b84-b515-bbbe306a667e admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:11.595784 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ec20f-a1b7-4b84-b515-bbbe306a667e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:05:11.596127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ec20f-a1b7-4b84-b515-bbbe306a667e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:11.597139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-300ec20f-a1b7-4b84-b515-bbbe306a667e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:05:11.597139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: warnings.warn(msg) May 19 12:05:11.597139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: May 19 12:05:11.598022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ec20f-a1b7-4b84-b515-bbbe306a667e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:11.609823 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 742/1496] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:05:11.617523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3a203-5b12-4535-b8cb-3358886e3613 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:11.628310 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3a203-5b12-4535-b8cb-3358886e3613 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:11.632726 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de3628-edd3-486f-ab76-75e4831c4731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:11.633362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de3628-edd3-486f-ab76-75e4831c4731 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:11.633644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de3628-edd3-486f-ab76-75e4831c4731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:11.633918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de3628-edd3-486f-ab76-75e4831c4731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:11.634597 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de3628-edd3-486f-ab76-75e4831c4731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:11.636431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: WARNING py.warnings [None req-31de3628-edd3-486f-ab76-75e4831c4731 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:05:11.636431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: warnings.warn(msg) May 19 12:05:11.636431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: May 19 12:05:11.637625 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de3628-edd3-486f-ab76-75e4831c4731 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:11.673190 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 755/1497] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:05:11 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:11.677304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ec20f-a1b7-4b84-b515-bbbe306a667e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:11.687890 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ec20f-a1b7-4b84-b515-bbbe306a667e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:11.741883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9663a-e571-4089-9a09-62539eb97ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:11.742535 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9663a-e571-4089-9a09-62539eb97ddb admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:11.742817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9663a-e571-4089-9a09-62539eb97ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:11.743092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9663a-e571-4089-9a09-62539eb97ddb admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:11.743780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9663a-e571-4089-9a09-62539eb97ddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:11.744811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-d9b9663a-e571-4089-9a09-62539eb97ddb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:05:11.744811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: warnings.warn(msg) May 19 12:05:11.744811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: May 19 12:05:11.746006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9663a-e571-4089-9a09-62539eb97ddb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:11.768145 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 743/1498] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:05:11 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:05:11.772313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de3628-edd3-486f-ab76-75e4831c4731 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:11.782861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de3628-edd3-486f-ab76-75e4831c4731 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:11.787332 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbe1a3-c3af-4fad-9a56-b905f43b00b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:11.788013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbe1a3-c3af-4fad-9a56-b905f43b00b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:11.788300 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbe1a3-c3af-4fad-9a56-b905f43b00b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:11.788575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbe1a3-c3af-4fad-9a56-b905f43b00b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:11.789291 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbe1a3-c3af-4fad-9a56-b905f43b00b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:11.790287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: WARNING py.warnings [None req-e7bbe1a3-c3af-4fad-9a56-b905f43b00b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:05:11.790287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: warnings.warn(msg) May 19 12:05:11.790287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: May 19 12:05:11.791154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbe1a3-c3af-4fad-9a56-b905f43b00b4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:11.804474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 756/1499] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:05:11.808528 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9663a-e571-4089-9a09-62539eb97ddb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:11.818271 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9663a-e571-4089-9a09-62539eb97ddb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:11.822780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a09664-7786-43ef-a30b-70f8e171603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:11.823435 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a09664-7786-43ef-a30b-70f8e171603e admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:11.823720 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a09664-7786-43ef-a30b-70f8e171603e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:11.824039 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a09664-7786-43ef-a30b-70f8e171603e admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:11.824762 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a09664-7786-43ef-a30b-70f8e171603e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:11.825763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-97a09664-7786-43ef-a30b-70f8e171603e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:05:11.825763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: warnings.warn(msg) May 19 12:05:11.825763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: May 19 12:05:11.826652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a09664-7786-43ef-a30b-70f8e171603e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:11.839658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 744/1500] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:05:11.844049 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbe1a3-c3af-4fad-9a56-b905f43b00b4 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:11.853651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbe1a3-c3af-4fad-9a56-b905f43b00b4 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:11.858627 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4007d4-a3ea-4790-b66e-1ac35f7956ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:11.859488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4007d4-a3ea-4790-b66e-1ac35f7956ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:11.859770 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4007d4-a3ea-4790-b66e-1ac35f7956ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:11.860078 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4007d4-a3ea-4790-b66e-1ac35f7956ad admin admin] PATH_INFO: `/v3/projects/5c5804cf2aee48b793cf86a7ad346887/users/6092633a247f42c0910f5af7ed9a50b9/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:11.874140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4007d4-a3ea-4790-b66e-1ac35f7956ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c5804cf2aee48b793cf86a7ad346887, user_id=6092633a247f42c0910f5af7ed9a50b9, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:11.875155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: WARNING py.warnings [None req-8f4007d4-a3ea-4790-b66e-1ac35f7956ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:05:11.875155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: warnings.warn(msg) May 19 12:05:11.875155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: May 19 12:05:11.877112 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4007d4-a3ea-4790-b66e-1ac35f7956ad admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:11.889635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 757/1501] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:05:11 2022] PUT /identity/v3/projects/5c5804cf2aee48b793cf86a7ad346887/users/6092633a247f42c0910f5af7ed9a50b9/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:11.900577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116f6e6-f5a6-43b7-8dc7-715065fe3ab3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:11.900900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116f6e6-f5a6-43b7-8dc7-715065fe3ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:11.901183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116f6e6-f5a6-43b7-8dc7-715065fe3ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:11.928323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c116f6e6-f5a6-43b7-8dc7-715065fe3ab3 None None] MFA Rules not processed for user `6092633a247f42c0910f5af7ed9a50b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:11.929522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c116f6e6-f5a6-43b7-8dc7-715065fe3ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:11.992160 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 745/1502] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:05:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:12.005127 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31c5c-e545-4225-8bee-228befd8b0a7 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:12.005422 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31c5c-e545-4225-8bee-228befd8b0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:12.005706 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31c5c-e545-4225-8bee-228befd8b0a7 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:12.007093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 758/1503] 10.222.0.73 () {54 vars in 963 bytes} [Thu May 19 12:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:05:12.011761 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8844ab0-b6fe-4be1-abcc-1411bb88af62 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:12.012116 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8844ab0-b6fe-4be1-abcc-1411bb88af62 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:12.012392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8844ab0-b6fe-4be1-abcc-1411bb88af62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:12.030135 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c8844ab0-b6fe-4be1-abcc-1411bb88af62 None None] MFA Rules not processed for user `a44bb5fc455a4965ac6904fb548530f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:12.031322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c8844ab0-b6fe-4be1-abcc-1411bb88af62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:12.073691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:12.084049 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 746/1504] 10.222.0.73 () {58 vars in 1060 bytes} [Thu May 19 12:05:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:05:12.090031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee31c5c-e545-4225-8bee-228befd8b0a7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:12.101385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee31c5c-e545-4225-8bee-228befd8b0a7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:12.104865 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05dbbb-84cf-4bb6-92b8-a72a05779769 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:12.105491 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05dbbb-84cf-4bb6-92b8-a72a05779769 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:12.105774 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05dbbb-84cf-4bb6-92b8-a72a05779769 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:12.106051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05dbbb-84cf-4bb6-92b8-a72a05779769 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:12.118289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05dbbb-84cf-4bb6-92b8-a72a05779769 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:12.119710 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05dbbb-84cf-4bb6-92b8-a72a05779769 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:12.129537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 759/1505] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:05:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:12.172021 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bc049-a722-4c47-8254-9d50fa31b883 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:12.172314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bc049-a722-4c47-8254-9d50fa31b883 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:12.172592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bc049-a722-4c47-8254-9d50fa31b883 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:12.173864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 747/1506] 10.222.0.73 () {52 vars in 829 bytes} [Thu May 19 12:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:05:12.177275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05dbbb-84cf-4bb6-92b8-a72a05779769 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:12.237515 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05dbbb-84cf-4bb6-92b8-a72a05779769 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:12.241997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e147b7e-2635-4f3a-b796-7a47b03526f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:12.242862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e147b7e-2635-4f3a-b796-7a47b03526f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:12.243147 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e147b7e-2635-4f3a-b796-7a47b03526f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:12.243432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e147b7e-2635-4f3a-b796-7a47b03526f3 admin admin] PATH_INFO: `/v3/users/6092633a247f42c0910f5af7ed9a50b9` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:12.244618 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e147b7e-2635-4f3a-b796-7a47b03526f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6092633a247f42c0910f5af7ed9a50b9)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:12.245630 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: WARNING py.warnings [None req-5e147b7e-2635-4f3a-b796-7a47b03526f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:05:12.245630 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: warnings.warn(msg) May 19 12:05:12.245630 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: May 19 12:05:12.246834 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e147b7e-2635-4f3a-b796-7a47b03526f3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:12.309855 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5e147b7e-2635-4f3a-b796-7a47b03526f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6092633a247f42c0910f5af7ed9a50b9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:12.310585 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5e147b7e-2635-4f3a-b796-7a47b03526f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6092633a247f42c0910f5af7ed9a50b9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:12.320143 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5e147b7e-2635-4f3a-b796-7a47b03526f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6092633a247f42c0910f5af7ed9a50b9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:12.332495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5e147b7e-2635-4f3a-b796-7a47b03526f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6092633a247f42c0910f5af7ed9a50b9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:12.348724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:12.351284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5e147b7e-2635-4f3a-b796-7a47b03526f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6092633a247f42c0910f5af7ed9a50b9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:12.359191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 760/1507] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:05:12 2022] DELETE /identity/v3/users/6092633a247f42c0910f5af7ed9a50b9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:12.363655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096af0d4-4aa1-40ab-bdf9-f05deaa8f56e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:12.363984 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096af0d4-4aa1-40ab-bdf9-f05deaa8f56e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:12.364300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096af0d4-4aa1-40ab-bdf9-f05deaa8f56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:12.383828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-096af0d4-4aa1-40ab-bdf9-f05deaa8f56e None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:05:12.385071 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-096af0d4-4aa1-40ab-bdf9-f05deaa8f56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:12.442856 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 748/1508] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:05:12.453108 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e147b7e-2635-4f3a-b796-7a47b03526f3 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:12.454579 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5e147b7e-2635-4f3a-b796-7a47b03526f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:12.511103 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e147b7e-2635-4f3a-b796-7a47b03526f3 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:12.514754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdc6ae-7b56-4635-94d7-f30ec0ff5fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:12.515402 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdc6ae-7b56-4635-94d7-f30ec0ff5fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:12.515692 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdc6ae-7b56-4635-94d7-f30ec0ff5fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:12.516001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdc6ae-7b56-4635-94d7-f30ec0ff5fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:12.524859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdc6ae-7b56-4635-94d7-f30ec0ff5fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:12.526323 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdc6ae-7b56-4635-94d7-f30ec0ff5fa0 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:12.536125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 761/1509] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:05:12.862197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096af0d4-4aa1-40ab-bdf9-f05deaa8f56e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:05:12.864690 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-096af0d4-4aa1-40ab-bdf9-f05deaa8f56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:05:12.880041 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096af0d4-4aa1-40ab-bdf9-f05deaa8f56e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:05:12.885184 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdcc1d-53bd-4940-97e2-57e570352d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:05:12.886158 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdcc1d-53bd-4940-97e2-57e570352d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:05:12.886528 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdcc1d-53bd-4940-97e2-57e570352d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:05:12.886923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdcc1d-53bd-4940-97e2-57e570352d22 admin admin] PATH_INFO: `/v3/projects/5c5804cf2aee48b793cf86a7ad346887` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:05:12.888718 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdcc1d-53bd-4940-97e2-57e570352d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c5804cf2aee48b793cf86a7ad346887)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:05:12.889779 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-73fdcc1d-53bd-4940-97e2-57e570352d22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:05:12.889779 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: warnings.warn(msg) May 19 12:05:12.889779 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: May 19 12:05:12.890959 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdcc1d-53bd-4940-97e2-57e570352d22 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:05:12.951755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73fdcc1d-53bd-4940-97e2-57e570352d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c5804cf2aee48b793cf86a7ad346887', 'request_id': 'req-73fdcc1d-53bd-4940-97e2-57e570352d22'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:12.957845 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73fdcc1d-53bd-4940-97e2-57e570352d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c5804cf2aee48b793cf86a7ad346887', 'request_id': 'req-73fdcc1d-53bd-4940-97e2-57e570352d22'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:12.968141 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73fdcc1d-53bd-4940-97e2-57e570352d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c5804cf2aee48b793cf86a7ad346887', 'request_id': 'req-73fdcc1d-53bd-4940-97e2-57e570352d22'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:12.986259 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73fdcc1d-53bd-4940-97e2-57e570352d22 admin admin] The token cache is being invalidate because project 5c5804cf2aee48b793cf86a7ad346887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:05:12.986550 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73fdcc1d-53bd-4940-97e2-57e570352d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:12.987280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73fdcc1d-53bd-4940-97e2-57e570352d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:05:12.988872 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 749/1510] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:05:12 2022] DELETE /identity/v3/projects/5c5804cf2aee48b793cf86a7ad346887 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:05:22.532034 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:05:22.983186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:00.179938 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a7b48-d375-4de4-8f35-ba10c43baebe None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:00.180529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a7b48-d375-4de4-8f35-ba10c43baebe None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:00.180529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a7b48-d375-4de4-8f35-ba10c43baebe None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:00.181938 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:07:00.192560 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047c145-0bc0-46d2-bbdf-997781c5f1a6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:00.193101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047c145-0bc0-46d2-bbdf-997781c5f1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:00.193101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047c145-0bc0-46d2-bbdf-997781c5f1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:00.216443 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6047c145-0bc0-46d2-bbdf-997781c5f1a6 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:00.217647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6047c145-0bc0-46d2-bbdf-997781c5f1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:00.277050 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:00.442655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a7b48-d375-4de4-8f35-ba10c43baebe None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:00.444438 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8a9a7b48-d375-4de4-8f35-ba10c43baebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:00.516203 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a7b48-d375-4de4-8f35-ba10c43baebe None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:00.522004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bd8bb-b904-4bad-84ca-c8ce78c5f7ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:00.522637 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bd8bb-b904-4bad-84ca-c8ce78c5f7ac service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:00.522921 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bd8bb-b904-4bad-84ca-c8ce78c5f7ac service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:00.523196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bd8bb-b904-4bad-84ca-c8ce78c5f7ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:00.531070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bd8bb-b904-4bad-84ca-c8ce78c5f7ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:00.532700 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bd8bb-b904-4bad-84ca-c8ce78c5f7ac service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:00.542661 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 763/1513] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:01.438536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856dbd6-1026-40c8-bf16-adde0f533150 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:01.439097 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856dbd6-1026-40c8-bf16-adde0f533150 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:01.439097 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856dbd6-1026-40c8-bf16-adde0f533150 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:01.440492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:07:01.445207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a22d0-abfd-4e76-b9fe-0afea8d8b33b None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:01.445610 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a22d0-abfd-4e76-b9fe-0afea8d8b33b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:01.445716 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a51df-f8be-4f2f-8f8e-eb38314052e0 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:01.445811 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a22d0-abfd-4e76-b9fe-0afea8d8b33b None None] PATH_INFO: `/v3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:01.445973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a51df-f8be-4f2f-8f8e-eb38314052e0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:01.446226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a51df-f8be-4f2f-8f8e-eb38314052e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:01.447077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 764/1515] 10.222.0.78 () {54 vars in 925 bytes} [Thu May 19 12:07:01 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:07:01.452931 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05a8b2-3d0b-4baa-a5ce-3a5b657f189b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:01.453229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05a8b2-3d0b-4baa-a5ce-3a5b657f189b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:01.453518 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05a8b2-3d0b-4baa-a5ce-3a5b657f189b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:01.465135 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5a7a51df-f8be-4f2f-8f8e-eb38314052e0 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:01.466379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5a7a51df-f8be-4f2f-8f8e-eb38314052e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:01.471738 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1c05a8b2-3d0b-4baa-a5ce-3a5b657f189b None None] MFA Rules not processed for user `e9cccb366fc6429e9a30d4f9de64e8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:01.472969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1c05a8b2-3d0b-4baa-a5ce-3a5b657f189b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:01.474290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 752/1516] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:07:01.542006 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 765/1517] 10.222.0.78 () {58 vars in 1015 bytes} [Thu May 19 12:07:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:07:01.631094 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a51df-f8be-4f2f-8f8e-eb38314052e0 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:01.643336 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a51df-f8be-4f2f-8f8e-eb38314052e0 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:01.649333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc173b-af8c-41e7-8f41-f2fff0685058 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:01.649977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc173b-af8c-41e7-8f41-f2fff0685058 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:01.650303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc173b-af8c-41e7-8f41-f2fff0685058 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:01.650582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc173b-af8c-41e7-8f41-f2fff0685058 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:01.658611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc173b-af8c-41e7-8f41-f2fff0685058 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:01.660346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc173b-af8c-41e7-8f41-f2fff0685058 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:01.669846 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 753/1518] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:10.549235 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f401c55-6e76-41ce-a74b-75475ba9768e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:10.549809 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f401c55-6e76-41ce-a74b-75475ba9768e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:10.549809 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f401c55-6e76-41ce-a74b-75475ba9768e None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:10.551190 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 766/1519] 10.222.0.73 () {54 vars in 960 bytes} [Thu May 19 12:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:07:10.556147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661317e6-2e25-4ac6-af93-91258641de74 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:10.556579 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661317e6-2e25-4ac6-af93-91258641de74 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:10.556711 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661317e6-2e25-4ac6-af93-91258641de74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:10.574843 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-661317e6-2e25-4ac6-af93-91258641de74 None None] MFA Rules not processed for user `e9cccb366fc6429e9a30d4f9de64e8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:10.576053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-661317e6-2e25-4ac6-af93-91258641de74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:10.585107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 754/1520] 10.222.0.73 () {58 vars in 1057 bytes} [Thu May 19 12:07:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:10.592423 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f401c55-6e76-41ce-a74b-75475ba9768e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:10.605474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f401c55-6e76-41ce-a74b-75475ba9768e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:10.610362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee42f38-e572-4bf4-9593-40f025c981b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cccb366fc6429e9a30d4f9de64e8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:10.610982 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee42f38-e572-4bf4-9593-40f025c981b8 service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:10.611269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee42f38-e572-4bf4-9593-40f025c981b8 service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:10.611547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee42f38-e572-4bf4-9593-40f025c981b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:10.619831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee42f38-e572-4bf4-9593-40f025c981b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:10.621462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee42f38-e572-4bf4-9593-40f025c981b8 service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:10.631663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 767/1521] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:07:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:07:12.977168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99e6eb-a777-483e-a782-2deb746a03aa None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:12.977738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99e6eb-a777-483e-a782-2deb746a03aa None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:12.977738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99e6eb-a777-483e-a782-2deb746a03aa None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:12.979113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:07:12.983751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557268e0-ffc7-4778-bb0d-5b1e46e2e883 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:12.984176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557268e0-ffc7-4778-bb0d-5b1e46e2e883 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:12.984359 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557268e0-ffc7-4778-bb0d-5b1e46e2e883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:13.002027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-557268e0-ffc7-4778-bb0d-5b1e46e2e883 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:13.003234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-557268e0-ffc7-4778-bb0d-5b1e46e2e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:13.011477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:13.164089 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99e6eb-a777-483e-a782-2deb746a03aa None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:13.179241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99e6eb-a777-483e-a782-2deb746a03aa None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:13.184670 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f4faf-4a6a-48c2-b599-ea9005af1e3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:13.185301 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f4faf-4a6a-48c2-b599-ea9005af1e3d service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:13.185589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f4faf-4a6a-48c2-b599-ea9005af1e3d service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:13.185866 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f4faf-4a6a-48c2-b599-ea9005af1e3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:13.194420 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f4faf-4a6a-48c2-b599-ea9005af1e3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:13.196037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f4faf-4a6a-48c2-b599-ea9005af1e3d service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:13.205284 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 756/1524] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:14.093516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472c6ef-aec6-4aec-8cac-5821ed0a5353 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:14.094084 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472c6ef-aec6-4aec-8cac-5821ed0a5353 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:14.094084 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472c6ef-aec6-4aec-8cac-5821ed0a5353 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:14.095497 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 12:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:07:14.100944 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32e4c7-0bbf-4042-9c59-25dad4ebcc14 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:14.101359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32e4c7-0bbf-4042-9c59-25dad4ebcc14 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:14.101504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32e4c7-0bbf-4042-9c59-25dad4ebcc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:14.118991 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-be32e4c7-0bbf-4042-9c59-25dad4ebcc14 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:14.120216 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-be32e4c7-0bbf-4042-9c59-25dad4ebcc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:14.128295 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 12:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:14.279092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472c6ef-aec6-4aec-8cac-5821ed0a5353 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:14.293585 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472c6ef-aec6-4aec-8cac-5821ed0a5353 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:14.298952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1b207-49dd-4b06-bd60-dd6731f7af78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:14.299587 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1b207-49dd-4b06-bd60-dd6731f7af78 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:14.299875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1b207-49dd-4b06-bd60-dd6731f7af78 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:14.300189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1b207-49dd-4b06-bd60-dd6731f7af78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:14.308174 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1b207-49dd-4b06-bd60-dd6731f7af78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:14.309744 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1b207-49dd-4b06-bd60-dd6731f7af78 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:14.319837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 770/1527] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:18.623386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1c066-5239-4d6f-a59b-ab3f7fa081f8 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:18.623970 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1c066-5239-4d6f-a59b-ab3f7fa081f8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:18.623970 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1c066-5239-4d6f-a59b-ab3f7fa081f8 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:18.625386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:07:18.631486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9905d-0584-4aab-ae19-c21b2c6d4c84 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:18.631943 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9905d-0584-4aab-ae19-c21b2c6d4c84 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:18.632054 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9905d-0584-4aab-ae19-c21b2c6d4c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:18.649636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-24d9905d-0584-4aab-ae19-c21b2c6d4c84 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:18.650859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-24d9905d-0584-4aab-ae19-c21b2c6d4c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:18.658534 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:18.695246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1c066-5239-4d6f-a59b-ab3f7fa081f8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:18.696967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7fd1c066-5239-4d6f-a59b-ab3f7fa081f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:18.752958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1c066-5239-4d6f-a59b-ab3f7fa081f8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:18.756451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bda76-600f-4a11-9eff-82a84f21f9d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:18.757093 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bda76-600f-4a11-9eff-82a84f21f9d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:18.757380 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bda76-600f-4a11-9eff-82a84f21f9d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:18.757656 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bda76-600f-4a11-9eff-82a84f21f9d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:18.766498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bda76-600f-4a11-9eff-82a84f21f9d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:18.767947 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bda76-600f-4a11-9eff-82a84f21f9d4 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:18.777233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 759/1530] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:20.965228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518df360-eb53-4ee0-a596-bbcf46727a3f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:20.965858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518df360-eb53-4ee0-a596-bbcf46727a3f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:20.965858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518df360-eb53-4ee0-a596-bbcf46727a3f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:20.967256 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:07:20.972816 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3f4d7-d789-46a3-b5df-2fef941f49d7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:20.973285 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3f4d7-d789-46a3-b5df-2fef941f49d7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:20.973399 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3f4d7-d789-46a3-b5df-2fef941f49d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:20.990981 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e6d3f4d7-d789-46a3-b5df-2fef941f49d7 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:20.992196 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e6d3f4d7-d789-46a3-b5df-2fef941f49d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:20.999803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:21.035725 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518df360-eb53-4ee0-a596-bbcf46727a3f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:21.046426 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518df360-eb53-4ee0-a596-bbcf46727a3f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:21.049941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2e519-9f08-46e7-ba41-da6b48d0d067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:21.050570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2e519-9f08-46e7-ba41-da6b48d0d067 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:21.050935 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2e519-9f08-46e7-ba41-da6b48d0d067 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:21.051138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2e519-9f08-46e7-ba41-da6b48d0d067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:21.060162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2e519-9f08-46e7-ba41-da6b48d0d067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:21.061634 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2e519-9f08-46e7-ba41-da6b48d0d067 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:21.071688 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 773/1533] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:24.783894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb43db-10b4-4dde-a1e9-8c1fdcc1f25b None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:24.784443 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb43db-10b4-4dde-a1e9-8c1fdcc1f25b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:24.784443 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb43db-10b4-4dde-a1e9-8c1fdcc1f25b None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:24.785852 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:07:24.791521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd962e-2d18-4c1a-bcc7-e7c4d21c6f10 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:24.791933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd962e-2d18-4c1a-bcc7-e7c4d21c6f10 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:24.792133 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd962e-2d18-4c1a-bcc7-e7c4d21c6f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:24.798376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=88 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:24.811141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-eafd962e-2d18-4c1a-bcc7-e7c4d21c6f10 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:24.812373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-eafd962e-2d18-4c1a-bcc7-e7c4d21c6f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:24.820749 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:25.089864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb43db-10b4-4dde-a1e9-8c1fdcc1f25b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:25.091595 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6cdb43db-10b4-4dde-a1e9-8c1fdcc1f25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:25.097538 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=78 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:25.150173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb43db-10b4-4dde-a1e9-8c1fdcc1f25b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:25.153685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6236d7-1eb7-46cc-9288-e9b8a0737635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:25.154322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6236d7-1eb7-46cc-9288-e9b8a0737635 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:25.154624 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6236d7-1eb7-46cc-9288-e9b8a0737635 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:25.154881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6236d7-1eb7-46cc-9288-e9b8a0737635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:25.163686 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6236d7-1eb7-46cc-9288-e9b8a0737635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:25.165136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6236d7-1eb7-46cc-9288-e9b8a0737635 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:25.174523 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 762/1536] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:27.435803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373b39-679c-4f6e-95b5-960ae987404f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:27.436358 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373b39-679c-4f6e-95b5-960ae987404f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:27.436456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77373b39-679c-4f6e-95b5-960ae987404f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:27.437770 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 12:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:07:27.443413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d29c93-7f3f-47d6-a43c-1f6f3e0aac6a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:27.443857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d29c93-7f3f-47d6-a43c-1f6f3e0aac6a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:27.444021 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d29c93-7f3f-47d6-a43c-1f6f3e0aac6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:27.461564 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f8d29c93-7f3f-47d6-a43c-1f6f3e0aac6a None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:07:27.462754 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f8d29c93-7f3f-47d6-a43c-1f6f3e0aac6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:27.470372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 12:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:07:27.739114 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77373b39-679c-4f6e-95b5-960ae987404f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:07:27.740816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-77373b39-679c-4f6e-95b5-960ae987404f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:07:27.753992 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77373b39-679c-4f6e-95b5-960ae987404f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:07:27.757531 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7864f54-5401-4cc6-a63d-4ae69ca093ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:07:27.758175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7864f54-5401-4cc6-a63d-4ae69ca093ce service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:07:27.758463 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7864f54-5401-4cc6-a63d-4ae69ca093ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:07:27.758740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7864f54-5401-4cc6-a63d-4ae69ca093ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:07:27.768578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7864f54-5401-4cc6-a63d-4ae69ca093ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:07:27.770030 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7864f54-5401-4cc6-a63d-4ae69ca093ce service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:07:27.779466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 776/1539] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:07:37.456418 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=28 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:07:37.775437 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=8 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:00.061980 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c07a89-5cb6-4339-9468-863619de8a9f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.062618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c07a89-5cb6-4339-9468-863619de8a9f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.062618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c07a89-5cb6-4339-9468-863619de8a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.093028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e8c07a89-5cb6-4339-9468-863619de8a9f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:00.095178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e8c07a89-5cb6-4339-9468-863619de8a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:00.104058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 764/1540] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:00.114990 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be45c53-ca98-4287-aafa-6b4e96edb35a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.115544 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be45c53-ca98-4287-aafa-6b4e96edb35a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.115638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be45c53-ca98-4287-aafa-6b4e96edb35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.143013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5be45c53-ca98-4287-aafa-6b4e96edb35a None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:00.144275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5be45c53-ca98-4287-aafa-6b4e96edb35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:00.153043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 777/1541] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:00.158340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c07a89-5cb6-4339-9468-863619de8a9f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:00.169276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c07a89-5cb6-4339-9468-863619de8a9f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:00.179407 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3ed1b-08e0-4e42-ba0b-b6249ec013f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:00.180658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3ed1b-08e0-4e42-ba0b-b6249ec013f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.180798 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3ed1b-08e0-4e42-ba0b-b6249ec013f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.181024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3ed1b-08e0-4e42-ba0b-b6249ec013f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.181726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3ed1b-08e0-4e42-ba0b-b6249ec013f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:00.182063 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3ed1b-08e0-4e42-ba0b-b6249ec013f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:00.183821 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3ed1b-08e0-4e42-ba0b-b6249ec013f6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:00.201714 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 765/1542] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:00.210257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be45c53-ca98-4287-aafa-6b4e96edb35a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:00.220410 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be45c53-ca98-4287-aafa-6b4e96edb35a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:00.232361 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76283d4-f658-4024-b87a-467d68f968d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:00.233033 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76283d4-f658-4024-b87a-467d68f968d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.233321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76283d4-f658-4024-b87a-467d68f968d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.233605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76283d4-f658-4024-b87a-467d68f968d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.234320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76283d4-f658-4024-b87a-467d68f968d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:00.236829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76283d4-f658-4024-b87a-467d68f968d7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:00.278263 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 778/1543] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:00 2022] POST /identity/v3/projects => generated 391 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:00.283670 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3ed1b-08e0-4e42-ba0b-b6249ec013f6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:00.297615 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3ed1b-08e0-4e42-ba0b-b6249ec013f6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:00.369968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa007f7-ad32-4df0-bdce-b33888ce6d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:00.370581 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa007f7-ad32-4df0-bdce-b33888ce6d75 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.370868 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa007f7-ad32-4df0-bdce-b33888ce6d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.371155 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa007f7-ad32-4df0-bdce-b33888ce6d75 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.371875 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa007f7-ad32-4df0-bdce-b33888ce6d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:00.373855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa007f7-ad32-4df0-bdce-b33888ce6d75 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:00.409879 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 766/1544] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:00 2022] POST /identity/v3/users => generated 296 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:00.414261 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76283d4-f658-4024-b87a-467d68f968d7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:00.429278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76283d4-f658-4024-b87a-467d68f968d7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:00.447137 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d454d-2032-4672-8153-4b5ac5c1882c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:00.448248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d454d-2032-4672-8153-4b5ac5c1882c admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.448765 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d454d-2032-4672-8153-4b5ac5c1882c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.449270 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d454d-2032-4672-8153-4b5ac5c1882c admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.450223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d454d-2032-4672-8153-4b5ac5c1882c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:00.452123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d454d-2032-4672-8153-4b5ac5c1882c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:00.469962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 779/1545] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:00.474440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa007f7-ad32-4df0-bdce-b33888ce6d75 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:00.490198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa007f7-ad32-4df0-bdce-b33888ce6d75 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:00.497499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6a3e5-53ea-4524-9710-7f31d9b9dc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:00.498256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6a3e5-53ea-4524-9710-7f31d9b9dc4d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.498554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6a3e5-53ea-4524-9710-7f31d9b9dc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.498831 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6a3e5-53ea-4524-9710-7f31d9b9dc4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.499590 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6a3e5-53ea-4524-9710-7f31d9b9dc4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:00.501431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6a3e5-53ea-4524-9710-7f31d9b9dc4d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:00.517735 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 767/1546] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:00.522062 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d454d-2032-4672-8153-4b5ac5c1882c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:00.538409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d454d-2032-4672-8153-4b5ac5c1882c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:00.548518 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614c00f-cb60-4e9b-b627-bb8c5f60f8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:00.549764 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614c00f-cb60-4e9b-b627-bb8c5f60f8e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.550258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614c00f-cb60-4e9b-b627-bb8c5f60f8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.550752 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614c00f-cb60-4e9b-b627-bb8c5f60f8e4 admin admin] PATH_INFO: `/v3/projects/cc116fcb3c3a4aecb4a00f28430d58c7/users/78de8b3155bf4181a27f9395030c1f6a/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.577584 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614c00f-cb60-4e9b-b627-bb8c5f60f8e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc116fcb3c3a4aecb4a00f28430d58c7, user_id=78de8b3155bf4181a27f9395030c1f6a, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:00.581618 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614c00f-cb60-4e9b-b627-bb8c5f60f8e4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:00.601134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2d82c-af54-4e63-9cc7-89494c6f7fd1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.601873 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2d82c-af54-4e63-9cc7-89494c6f7fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.602382 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2d82c-af54-4e63-9cc7-89494c6f7fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.606548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 780/1547] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:00 2022] PUT /identity/v3/projects/cc116fcb3c3a4aecb4a00f28430d58c7/users/78de8b3155bf4181a27f9395030c1f6a/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:00.626491 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fe084-4053-4b2e-aabf-3ab890d072d0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.626699 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fe084-4053-4b2e-aabf-3ab890d072d0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.626960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fe084-4053-4b2e-aabf-3ab890d072d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.634359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e5a2d82c-af54-4e63-9cc7-89494c6f7fd1 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:00.636019 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e5a2d82c-af54-4e63-9cc7-89494c6f7fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:00.652992 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a35fe084-4053-4b2e-aabf-3ab890d072d0 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:00.654229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a35fe084-4053-4b2e-aabf-3ab890d072d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:00.736988 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 768/1548] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:00.738802 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb935c-767c-428b-a478-0be40b75ef8d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.739339 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb935c-767c-428b-a478-0be40b75ef8d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.739957 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb935c-767c-428b-a478-0be40b75ef8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.785398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-dceb935c-767c-428b-a478-0be40b75ef8d None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:00.787678 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dceb935c-767c-428b-a478-0be40b75ef8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:00.814430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 769/1549] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:00.816696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8c15d-259a-4f1a-a0a6-41850cf95a4f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.817228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8c15d-259a-4f1a-a0a6-41850cf95a4f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.817719 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8c15d-259a-4f1a-a0a6-41850cf95a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.839957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 781/1550] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:09:00.839957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54777d-4b20-4011-9787-d1f2351c421d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.840257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54777d-4b20-4011-9787-d1f2351c421d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.840363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54777d-4b20-4011-9787-d1f2351c421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.858324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-94e8c15d-259a-4f1a-a0a6-41850cf95a4f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:00.858324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-94e8c15d-259a-4f1a-a0a6-41850cf95a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:00.866972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 770/1551] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:00.868186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1805b-3e47-428a-af82-17b136310032 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.868481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1805b-3e47-428a-af82-17b136310032 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.868762 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1805b-3e47-428a-af82-17b136310032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.882338 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fe54777d-4b20-4011-9787-d1f2351c421d None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:00.883489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fe54777d-4b20-4011-9787-d1f2351c421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:00.893782 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 782/1552] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:00.894507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54777d-4b20-4011-9787-d1f2351c421d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:00.902729 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-eee1805b-3e47-428a-af82-17b136310032 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:00.904786 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-eee1805b-3e47-428a-af82-17b136310032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:00.914008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 771/1553] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:00.916474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe623d7-12aa-434d-ac4f-97ecc33907d7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.916998 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe623d7-12aa-434d-ac4f-97ecc33907d7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.917592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe623d7-12aa-434d-ac4f-97ecc33907d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.937317 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-fbe623d7-12aa-434d-ac4f-97ecc33907d7 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:00.939099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-fbe623d7-12aa-434d-ac4f-97ecc33907d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:00.947071 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 772/1554] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:00.947842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe623d7-12aa-434d-ac4f-97ecc33907d7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:00.957906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe623d7-12aa-434d-ac4f-97ecc33907d7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:00.962902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c37db-954b-4c8a-9a9f-ed063a144f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:00.963572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c37db-954b-4c8a-9a9f-ed063a144f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.963859 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c37db-954b-4c8a-9a9f-ed063a144f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.964205 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c37db-954b-4c8a-9a9f-ed063a144f29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.965627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c37db-954b-4c8a-9a9f-ed063a144f29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:00.965627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c37db-954b-4c8a-9a9f-ed063a144f29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:00.965833 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54777d-4b20-4011-9787-d1f2351c421d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:00.967051 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c37db-954b-4c8a-9a9f-ed063a144f29 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:00.970558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934acb1-8719-4cf7-8051-5fbf785f1af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:00.971263 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934acb1-8719-4cf7-8051-5fbf785f1af6 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.971550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934acb1-8719-4cf7-8051-5fbf785f1af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.971895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934acb1-8719-4cf7-8051-5fbf785f1af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.979999 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 773/1555] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:00.981528 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be8918-6081-4976-8c3f-4964101deab2 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.982363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be8918-6081-4976-8c3f-4964101deab2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.982654 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be8918-6081-4976-8c3f-4964101deab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:00.984123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934acb1-8719-4cf7-8051-5fbf785f1af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:00.985620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934acb1-8719-4cf7-8051-5fbf785f1af6 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:00.995672 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 783/1556] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:00.997358 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd19ed3-787f-4a66-895f-95cd30ebbb22 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:00.997652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd19ed3-787f-4a66-895f-95cd30ebbb22 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:00.997931 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd19ed3-787f-4a66-895f-95cd30ebbb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.002507 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-53be8918-6081-4976-8c3f-4964101deab2 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:01.003779 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-53be8918-6081-4976-8c3f-4964101deab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:01.013373 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 774/1557] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:01.014274 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be8918-6081-4976-8c3f-4964101deab2 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.019426 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2bd19ed3-787f-4a66-895f-95cd30ebbb22 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:01.020793 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2bd19ed3-787f-4a66-895f-95cd30ebbb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:01.027236 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be8918-6081-4976-8c3f-4964101deab2 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.030459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 784/1558] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:01.031792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6e436-4364-48c9-8427-ff5a3a7d6edd None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.032101 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6e436-4364-48c9-8427-ff5a3a7d6edd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.032249 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52e676-9ccd-4370-9c46-34b01c4767f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:01.032378 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6e436-4364-48c9-8427-ff5a3a7d6edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.033022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e676-9ccd-4370-9c46-34b01c4767f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.033369 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e676-9ccd-4370-9c46-34b01c4767f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.033946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e676-9ccd-4370-9c46-34b01c4767f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.034850 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52e676-9ccd-4370-9c46-34b01c4767f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:01.034850 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52e676-9ccd-4370-9c46-34b01c4767f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:01.036604 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52e676-9ccd-4370-9c46-34b01c4767f1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:01.048579 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:01.052341 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-64a6e436-4364-48c9-8427-ff5a3a7d6edd None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:01.053128 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 775/1559] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:01.053702 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-64a6e436-4364-48c9-8427-ff5a3a7d6edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:01.054533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1403e5-7779-4d6b-ae4c-91c11a72ba06 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.054872 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1403e5-7779-4d6b-ae4c-91c11a72ba06 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.055681 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1403e5-7779-4d6b-ae4c-91c11a72ba06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.062930 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 785/1560] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:01.064914 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5b304-e69d-47f9-aa6b-2002242e628c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.065263 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5b304-e69d-47f9-aa6b-2002242e628c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.065602 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5b304-e69d-47f9-aa6b-2002242e628c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.079579 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-da1403e5-7779-4d6b-ae4c-91c11a72ba06 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:01.081516 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-da1403e5-7779-4d6b-ae4c-91c11a72ba06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:01.085980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ddd5b304-e69d-47f9-aa6b-2002242e628c None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:01.087486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ddd5b304-e69d-47f9-aa6b-2002242e628c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:01.097953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 776/1561] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:01.097953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1403e5-7779-4d6b-ae4c-91c11a72ba06 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.107961 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 786/1562] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:01.107961 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc354fc-d349-4358-b7cb-ffba120ada85 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.107961 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc354fc-d349-4358-b7cb-ffba120ada85 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.107961 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc354fc-d349-4358-b7cb-ffba120ada85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.113733 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1403e5-7779-4d6b-ae4c-91c11a72ba06 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.121823 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3e646-5732-4455-a3f4-b92e731e8fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:01.122588 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3e646-5732-4455-a3f4-b92e731e8fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.122943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3e646-5732-4455-a3f4-b92e731e8fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.123300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3e646-5732-4455-a3f4-b92e731e8fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.124124 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3e646-5732-4455-a3f4-b92e731e8fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:01.125151 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-4ea3e646-5732-4455-a3f4-b92e731e8fa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:09:01.125151 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: warnings.warn(msg) May 19 12:09:01.125151 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: May 19 12:09:01.126929 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3e646-5732-4455-a3f4-b92e731e8fa9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:01.129125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4cc354fc-d349-4358-b7cb-ffba120ada85 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:01.130411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4cc354fc-d349-4358-b7cb-ffba120ada85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:01.140849 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 787/1563] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:01.145880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc354fc-d349-4358-b7cb-ffba120ada85 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.154937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 777/1564] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:01 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:01.155791 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3e646-5732-4455-a3f4-b92e731e8fa9 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.156472 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc354fc-d349-4358-b7cb-ffba120ada85 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.160896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:01.237696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3e646-5732-4455-a3f4-b92e731e8fa9 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.242377 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05461231-b605-4b47-9424-27e984cb6255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:01.243589 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05461231-b605-4b47-9424-27e984cb6255 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.243589 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05461231-b605-4b47-9424-27e984cb6255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.243853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05461231-b605-4b47-9424-27e984cb6255 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.244075 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcca471-c9ec-4071-880f-2ab575f575c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:01.244620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05461231-b605-4b47-9424-27e984cb6255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:01.244926 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05461231-b605-4b47-9424-27e984cb6255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:01.245093 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcca471-c9ec-4071-880f-2ab575f575c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.245444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcca471-c9ec-4071-880f-2ab575f575c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.245813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcca471-c9ec-4071-880f-2ab575f575c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.245926 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: WARNING py.warnings [None req-05461231-b605-4b47-9424-27e984cb6255 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:09:01.245926 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: warnings.warn(msg) May 19 12:09:01.245926 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: May 19 12:09:01.246719 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcca471-c9ec-4071-880f-2ab575f575c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:01.246845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05461231-b605-4b47-9424-27e984cb6255 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:01.248800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcca471-c9ec-4071-880f-2ab575f575c9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:01.260892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 788/1565] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:01.262254 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c912c1c-9d65-43c6-a846-759bdd93af51 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.262558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c912c1c-9d65-43c6-a846-759bdd93af51 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.262844 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c912c1c-9d65-43c6-a846-759bdd93af51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.281500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9c912c1c-9d65-43c6-a846-759bdd93af51 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:01.282761 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9c912c1c-9d65-43c6-a846-759bdd93af51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:01.287957 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 778/1566] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:01 2022] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:01.289314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a75c8-ae0a-43ce-8af4-0a82e5970b1b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.289314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a75c8-ae0a-43ce-8af4-0a82e5970b1b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.289552 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a75c8-ae0a-43ce-8af4-0a82e5970b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.293887 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 789/1567] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:01.294901 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c912c1c-9d65-43c6-a846-759bdd93af51 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.305406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c912c1c-9d65-43c6-a846-759bdd93af51 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.312395 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-520a75c8-ae0a-43ce-8af4-0a82e5970b1b None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:01.314215 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-520a75c8-ae0a-43ce-8af4-0a82e5970b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:01.378291 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0bf88-2c56-480b-b1f9-af44c585855f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:01.379062 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0bf88-2c56-480b-b1f9-af44c585855f admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.379445 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0bf88-2c56-480b-b1f9-af44c585855f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.379734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0bf88-2c56-480b-b1f9-af44c585855f admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.380632 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0bf88-2c56-480b-b1f9-af44c585855f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:01.381274 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0bf88-2c56-480b-b1f9-af44c585855f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:01.384340 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0bf88-2c56-480b-b1f9-af44c585855f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:01.404957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 790/1568] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:01.406552 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 779/1569] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:01.408244 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a75c8-ae0a-43ce-8af4-0a82e5970b1b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.418433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0bf88-2c56-480b-b1f9-af44c585855f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.422032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a75c8-ae0a-43ce-8af4-0a82e5970b1b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.430793 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee281d5-9d2c-49c0-94db-82fb9c0b20db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:01.431800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee281d5-9d2c-49c0-94db-82fb9c0b20db admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.432002 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0bf88-2c56-480b-b1f9-af44c585855f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.433007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee281d5-9d2c-49c0-94db-82fb9c0b20db admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.433496 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee281d5-9d2c-49c0-94db-82fb9c0b20db admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.434359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee281d5-9d2c-49c0-94db-82fb9c0b20db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:01.436812 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee281d5-9d2c-49c0-94db-82fb9c0b20db admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:01.437056 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04de42-ba59-4344-9b33-405d1d76f288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:01.437717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04de42-ba59-4344-9b33-405d1d76f288 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.438048 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04de42-ba59-4344-9b33-405d1d76f288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.438339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04de42-ba59-4344-9b33-405d1d76f288 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.439059 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04de42-ba59-4344-9b33-405d1d76f288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:01.439366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04de42-ba59-4344-9b33-405d1d76f288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:01.440968 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04de42-ba59-4344-9b33-405d1d76f288 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:01.457556 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 791/1570] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:01.458828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04de42-ba59-4344-9b33-405d1d76f288 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.463195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 780/1571] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:01 2022] POST /identity/v3/users => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:01.464111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee281d5-9d2c-49c0-94db-82fb9c0b20db admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.471377 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04de42-ba59-4344-9b33-405d1d76f288 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.476371 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab8190-5147-439e-b22f-02ec9869cc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:01.477040 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8190-5147-439e-b22f-02ec9869cc2d admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.477181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee281d5-9d2c-49c0-94db-82fb9c0b20db admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.477330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8190-5147-439e-b22f-02ec9869cc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.477609 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8190-5147-439e-b22f-02ec9869cc2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.478309 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab8190-5147-439e-b22f-02ec9869cc2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:01.480618 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab8190-5147-439e-b22f-02ec9869cc2d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:01.483660 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8269ad7-d031-440c-972d-b369a4e005ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:01.484601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269ad7-d031-440c-972d-b369a4e005ff admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.486120 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269ad7-d031-440c-972d-b369a4e005ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.486120 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269ad7-d031-440c-972d-b369a4e005ff admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.486368 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8269ad7-d031-440c-972d-b369a4e005ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:01.488646 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8269ad7-d031-440c-972d-b369a4e005ff admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:01.510777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 792/1572] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:01 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:01.511630 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab8190-5147-439e-b22f-02ec9869cc2d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.512068 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 781/1573] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:01 2022] POST /identity/v3/users => generated 302 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:01.513041 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8269ad7-d031-440c-972d-b369a4e005ff admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.524317 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8269ad7-d031-440c-972d-b369a4e005ff admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.547232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:01.576605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:01.589446 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab8190-5147-439e-b22f-02ec9869cc2d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.590554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed0fc8-037d-4729-ba5d-fbcfc2b596c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:01.591347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed0fc8-037d-4729-ba5d-fbcfc2b596c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.591737 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed0fc8-037d-4729-ba5d-fbcfc2b596c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.592119 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed0fc8-037d-4729-ba5d-fbcfc2b596c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.592901 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed0fc8-037d-4729-ba5d-fbcfc2b596c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:01.595422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed0fc8-037d-4729-ba5d-fbcfc2b596c1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:01.595631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217b47b-bb7b-44c7-b504-a24b21b74ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:01.596419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217b47b-bb7b-44c7-b504-a24b21b74ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.596773 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217b47b-bb7b-44c7-b504-a24b21b74ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.597124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217b47b-bb7b-44c7-b504-a24b21b74ea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.597969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217b47b-bb7b-44c7-b504-a24b21b74ea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:01.598389 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217b47b-bb7b-44c7-b504-a24b21b74ea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:01.600451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217b47b-bb7b-44c7-b504-a24b21b74ea8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:01.614542 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 793/1574] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:01.615251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217b47b-bb7b-44c7-b504-a24b21b74ea8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.625351 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217b47b-bb7b-44c7-b504-a24b21b74ea8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.630269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e83da-a093-4077-b3cb-e66d9bc4b281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:01.631000 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e83da-a093-4077-b3cb-e66d9bc4b281 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.631402 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e83da-a093-4077-b3cb-e66d9bc4b281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.631763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e83da-a093-4077-b3cb-e66d9bc4b281 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.632552 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e83da-a093-4077-b3cb-e66d9bc4b281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:01.632847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e83da-a093-4077-b3cb-e66d9bc4b281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:01.637134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 782/1575] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:01 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:01.637309 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e83da-a093-4077-b3cb-e66d9bc4b281 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:01.637409 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed0fc8-037d-4729-ba5d-fbcfc2b596c1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.649679 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 794/1576] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:01.659180 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e83da-a093-4077-b3cb-e66d9bc4b281 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.671990 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e83da-a093-4077-b3cb-e66d9bc4b281 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.712397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed0fc8-037d-4729-ba5d-fbcfc2b596c1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.724861 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c35cee-7f92-4f1e-b42b-d51bb262aad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:01.725642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c35cee-7f92-4f1e-b42b-d51bb262aad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.726005 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c35cee-7f92-4f1e-b42b-d51bb262aad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.726352 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c35cee-7f92-4f1e-b42b-d51bb262aad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.727174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c35cee-7f92-4f1e-b42b-d51bb262aad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:01.728893 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c35cee-7f92-4f1e-b42b-d51bb262aad4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:01.740177 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1391b-3d07-44b3-87b5-f324c19e7d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:01.744060 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 783/1577] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:01.744231 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1391b-3d07-44b3-87b5-f324c19e7d2d admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.744231 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1391b-3d07-44b3-87b5-f324c19e7d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.744406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c35cee-7f92-4f1e-b42b-d51bb262aad4 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.744483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1391b-3d07-44b3-87b5-f324c19e7d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.744483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1391b-3d07-44b3-87b5-f324c19e7d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:01.745432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1391b-3d07-44b3-87b5-f324c19e7d2d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:01.753000 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c35cee-7f92-4f1e-b42b-d51bb262aad4 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.758153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cc9a2-d026-46ed-b00c-f6e2cbb721bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:01.758825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cc9a2-d026-46ed-b00c-f6e2cbb721bf admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.759151 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cc9a2-d026-46ed-b00c-f6e2cbb721bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.759418 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cc9a2-d026-46ed-b00c-f6e2cbb721bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.760153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cc9a2-d026-46ed-b00c-f6e2cbb721bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:01.761851 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cc9a2-d026-46ed-b00c-f6e2cbb721bf admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:01.775150 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 784/1578] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:01.775872 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cc9a2-d026-46ed-b00c-f6e2cbb721bf admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.784687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 795/1579] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:01 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:01.784687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1391b-3d07-44b3-87b5-f324c19e7d2d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.786597 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cc9a2-d026-46ed-b00c-f6e2cbb721bf admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.864693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1391b-3d07-44b3-87b5-f324c19e7d2d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.866155 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8642ded-f352-427f-b615-c1c579aa9590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:01.867129 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8642ded-f352-427f-b615-c1c579aa9590 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.867422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8642ded-f352-427f-b615-c1c579aa9590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.867812 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8642ded-f352-427f-b615-c1c579aa9590 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.868648 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8642ded-f352-427f-b615-c1c579aa9590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:01.870956 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48723184-729e-459e-977e-5795d41676dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:01.871345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8642ded-f352-427f-b615-c1c579aa9590 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:01.871985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48723184-729e-459e-977e-5795d41676dc admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:01.872371 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48723184-729e-459e-977e-5795d41676dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:01.872743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48723184-729e-459e-977e-5795d41676dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:01.873679 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48723184-729e-459e-977e-5795d41676dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:01.875948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48723184-729e-459e-977e-5795d41676dc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:01.897283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 785/1580] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:01 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:01.898109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8642ded-f352-427f-b615-c1c579aa9590 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.910466 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8642ded-f352-427f-b615-c1c579aa9590 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:01.913580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 796/1581] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:01 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:01.915126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48723184-729e-459e-977e-5795d41676dc admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:01.943899 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:01.973239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:01.996264 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48723184-729e-459e-977e-5795d41676dc admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.000315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b3155-c47a-4c0e-8e88-cef46217197c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.001250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b3155-c47a-4c0e-8e88-cef46217197c admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.001686 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b3155-c47a-4c0e-8e88-cef46217197c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.002057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b3155-c47a-4c0e-8e88-cef46217197c admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.002955 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808615d4-6bfc-4d72-beff-c9e5dfe1862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.003787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b3155-c47a-4c0e-8e88-cef46217197c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.004155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808615d4-6bfc-4d72-beff-c9e5dfe1862a admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.004606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808615d4-6bfc-4d72-beff-c9e5dfe1862a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.005087 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808615d4-6bfc-4d72-beff-c9e5dfe1862a admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.005925 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808615d4-6bfc-4d72-beff-c9e5dfe1862a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.007077 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b3155-c47a-4c0e-8e88-cef46217197c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.008284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808615d4-6bfc-4d72-beff-c9e5dfe1862a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.038916 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 786/1582] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:01 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:02.038916 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b3155-c47a-4c0e-8e88-cef46217197c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.051572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b3155-c47a-4c0e-8e88-cef46217197c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.052008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 797/1583] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:01 2022] POST /identity/v3/projects => generated 405 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:02.053083 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808615d4-6bfc-4d72-beff-c9e5dfe1862a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.125229 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e8248-86a2-457a-b922-ea8b245b5ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.126731 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8248-86a2-457a-b922-ea8b245b5ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.127107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8248-86a2-457a-b922-ea8b245b5ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.127468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8248-86a2-457a-b922-ea8b245b5ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.128519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e8248-86a2-457a-b922-ea8b245b5ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.130374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e8248-86a2-457a-b922-ea8b245b5ac8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.139177 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808615d4-6bfc-4d72-beff-c9e5dfe1862a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.142286 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 787/1584] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:02.143339 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e8248-86a2-457a-b922-ea8b245b5ac8 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.147228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a64d1-e488-4e52-9808-206b28427626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.147941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a64d1-e488-4e52-9808-206b28427626 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.148269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a64d1-e488-4e52-9808-206b28427626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.148581 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a64d1-e488-4e52-9808-206b28427626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.149796 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a64d1-e488-4e52-9808-206b28427626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.152100 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a64d1-e488-4e52-9808-206b28427626 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.154702 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e8248-86a2-457a-b922-ea8b245b5ac8 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.159896 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4b850-bf5b-4053-9471-52039c524b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.160750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4b850-bf5b-4053-9471-52039c524b40 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.161076 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4b850-bf5b-4053-9471-52039c524b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.161463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4b850-bf5b-4053-9471-52039c524b40 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.162254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4b850-bf5b-4053-9471-52039c524b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.164291 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4b850-bf5b-4053-9471-52039c524b40 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.168832 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 798/1585] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:02.168832 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a64d1-e488-4e52-9808-206b28427626 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.179279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a64d1-e488-4e52-9808-206b28427626 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.185322 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfeeb2-e736-43ce-98a8-d538f00145b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.186028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfeeb2-e736-43ce-98a8-d538f00145b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.186520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfeeb2-e736-43ce-98a8-d538f00145b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.186839 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfeeb2-e736-43ce-98a8-d538f00145b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.187545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfeeb2-e736-43ce-98a8-d538f00145b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.189747 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfeeb2-e736-43ce-98a8-d538f00145b9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.194837 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 788/1586] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:02 2022] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:02.197519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4b850-bf5b-4053-9471-52039c524b40 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.208464 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 799/1587] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:02.208464 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfeeb2-e736-43ce-98a8-d538f00145b9 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.213937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4b850-bf5b-4053-9471-52039c524b40 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.221850 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00497321-599f-4c48-86f5-e9e19b5e1b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.222064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfeeb2-e736-43ce-98a8-d538f00145b9 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.223217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00497321-599f-4c48-86f5-e9e19b5e1b38 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.223634 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00497321-599f-4c48-86f5-e9e19b5e1b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.224045 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00497321-599f-4c48-86f5-e9e19b5e1b38 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.225251 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00497321-599f-4c48-86f5-e9e19b5e1b38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.228118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00497321-599f-4c48-86f5-e9e19b5e1b38 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.229184 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d6e91-4492-489e-bfcd-211d49fc405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.230373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d6e91-4492-489e-bfcd-211d49fc405a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.230826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d6e91-4492-489e-bfcd-211d49fc405a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.231328 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d6e91-4492-489e-bfcd-211d49fc405a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.232338 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d6e91-4492-489e-bfcd-211d49fc405a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.234456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d6e91-4492-489e-bfcd-211d49fc405a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.246638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 800/1588] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:02.247545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d6e91-4492-489e-bfcd-211d49fc405a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.259858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d6e91-4492-489e-bfcd-211d49fc405a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.265099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 789/1589] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:02 2022] POST /identity/v3/users => generated 284 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:02.265099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00497321-599f-4c48-86f5-e9e19b5e1b38 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.265806 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810cfc2-3cfd-4c4f-91c3-b054066cd83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.267065 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810cfc2-3cfd-4c4f-91c3-b054066cd83f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.267355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810cfc2-3cfd-4c4f-91c3-b054066cd83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.267796 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810cfc2-3cfd-4c4f-91c3-b054066cd83f admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.268738 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810cfc2-3cfd-4c4f-91c3-b054066cd83f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.269762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: WARNING py.warnings [None req-b810cfc2-3cfd-4c4f-91c3-b054066cd83f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:09:02.269762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: warnings.warn(msg) May 19 12:09:02.269762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: May 19 12:09:02.270974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810cfc2-3cfd-4c4f-91c3-b054066cd83f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.277456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00497321-599f-4c48-86f5-e9e19b5e1b38 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.283814 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1536611-917b-419b-905d-8522f2b70b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.285580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1536611-917b-419b-905d-8522f2b70b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.286067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1536611-917b-419b-905d-8522f2b70b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.286509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1536611-917b-419b-905d-8522f2b70b52 admin admin] PATH_INFO: `/v3/projects/7a4583d722934c65ac491706596c5538/users/742acbf02db44496afd7dafdb7ca0091/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.297568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 801/1590] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:02 2022] POST /identity/v3/users => generated 303 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:02.298561 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810cfc2-3cfd-4c4f-91c3-b054066cd83f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.309949 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1536611-917b-419b-905d-8522f2b70b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a4583d722934c65ac491706596c5538, user_id=742acbf02db44496afd7dafdb7ca0091, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.311690 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-b1536611-917b-419b-905d-8522f2b70b52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:09:02.311690 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: warnings.warn(msg) May 19 12:09:02.311690 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: May 19 12:09:02.314634 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1536611-917b-419b-905d-8522f2b70b52 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.316347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810cfc2-3cfd-4c4f-91c3-b054066cd83f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.323294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c9f17-af72-42b5-abe6-d74a83e4fec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.324526 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c9f17-af72-42b5-abe6-d74a83e4fec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.324900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c9f17-af72-42b5-abe6-d74a83e4fec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.325275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c9f17-af72-42b5-abe6-d74a83e4fec8 admin admin] PATH_INFO: `/v3/projects/1d062625964248e9837faaf1e6890c10/users/ba2a6f7bd1664fe4a83e2e4fe52b200d/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.338732 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 790/1591] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:02 2022] PUT /identity/v3/projects/7a4583d722934c65ac491706596c5538/users/742acbf02db44496afd7dafdb7ca0091/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:02.340776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1536611-917b-419b-905d-8522f2b70b52 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.350473 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c9f17-af72-42b5-abe6-d74a83e4fec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d062625964248e9837faaf1e6890c10, user_id=ba2a6f7bd1664fe4a83e2e4fe52b200d, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.358027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c9f17-af72-42b5-abe6-d74a83e4fec8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.386077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 802/1592] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:02 2022] PUT /identity/v3/projects/1d062625964248e9837faaf1e6890c10/users/ba2a6f7bd1664fe4a83e2e4fe52b200d/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:02.387313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c9f17-af72-42b5-abe6-d74a83e4fec8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.474969 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:02.498618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1536611-917b-419b-905d-8522f2b70b52 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.504270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998fc13-7c48-48e9-93a9-469eb27cd115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.504959 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998fc13-7c48-48e9-93a9-469eb27cd115 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.505299 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998fc13-7c48-48e9-93a9-469eb27cd115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.505589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998fc13-7c48-48e9-93a9-469eb27cd115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.506338 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998fc13-7c48-48e9-93a9-469eb27cd115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.507005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c9f17-af72-42b5-abe6-d74a83e4fec8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.508295 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998fc13-7c48-48e9-93a9-469eb27cd115 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.512480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c915c4-ca2f-4327-b7a2-811976e630e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.513409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c915c4-ca2f-4327-b7a2-811976e630e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.513861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c915c4-ca2f-4327-b7a2-811976e630e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.514431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c915c4-ca2f-4327-b7a2-811976e630e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.515383 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c915c4-ca2f-4327-b7a2-811976e630e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.517955 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c915c4-ca2f-4327-b7a2-811976e630e0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.520695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:02.525650 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 791/1593] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:02.525650 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998fc13-7c48-48e9-93a9-469eb27cd115 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.536629 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 803/1594] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:02.538052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c915c4-ca2f-4327-b7a2-811976e630e0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.539956 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998fc13-7c48-48e9-93a9-469eb27cd115 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.549777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee271925-635d-43ce-b197-a500f3370065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.551631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c915c4-ca2f-4327-b7a2-811976e630e0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.552467 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee271925-635d-43ce-b197-a500f3370065 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.552882 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee271925-635d-43ce-b197-a500f3370065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.553369 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee271925-635d-43ce-b197-a500f3370065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.554193 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee271925-635d-43ce-b197-a500f3370065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.557235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee271925-635d-43ce-b197-a500f3370065 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.558746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81993f60-4c87-4565-8e7a-e616a21e20a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.559313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81993f60-4c87-4565-8e7a-e616a21e20a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.559601 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81993f60-4c87-4565-8e7a-e616a21e20a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.559882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81993f60-4c87-4565-8e7a-e616a21e20a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.560632 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81993f60-4c87-4565-8e7a-e616a21e20a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.562237 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81993f60-4c87-4565-8e7a-e616a21e20a3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.574106 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 792/1595] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:02.575363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee271925-635d-43ce-b197-a500f3370065 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.578108 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 804/1596] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:02.580024 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435b2f3-d0d6-4c51-b1ee-c9179a039bd7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.580488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435b2f3-d0d6-4c51-b1ee-c9179a039bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.581068 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435b2f3-d0d6-4c51-b1ee-c9179a039bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.587859 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee271925-635d-43ce-b197-a500f3370065 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.595419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43a3a9-72b1-4383-87f7-a5243a10b007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.596146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43a3a9-72b1-4383-87f7-a5243a10b007 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.596434 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43a3a9-72b1-4383-87f7-a5243a10b007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.596715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43a3a9-72b1-4383-87f7-a5243a10b007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.597497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43a3a9-72b1-4383-87f7-a5243a10b007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.599404 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43a3a9-72b1-4383-87f7-a5243a10b007 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.614268 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 793/1597] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:02.615602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d50fb-0b15-4a22-8959-267a2d4bfc36 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.616485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d50fb-0b15-4a22-8959-267a2d4bfc36 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.616975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7435b2f3-d0d6-4c51-b1ee-c9179a039bd7 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:02.617091 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d50fb-0b15-4a22-8959-267a2d4bfc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.624761 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7435b2f3-d0d6-4c51-b1ee-c9179a039bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:02.639091 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 805/1598] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:02.640631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435b2f3-d0d6-4c51-b1ee-c9179a039bd7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.652445 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435b2f3-d0d6-4c51-b1ee-c9179a039bd7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.656885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b26d50fb-0b15-4a22-8959-267a2d4bfc36 None None] MFA Rules not processed for user `ba2a6f7bd1664fe4a83e2e4fe52b200d`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:02.658322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b26d50fb-0b15-4a22-8959-267a2d4bfc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:02.659513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cdeac-60c5-4d03-a494-b09e676509a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.661024 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cdeac-60c5-4d03-a494-b09e676509a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.661550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cdeac-60c5-4d03-a494-b09e676509a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.662044 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cdeac-60c5-4d03-a494-b09e676509a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.663433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2cdeac-60c5-4d03-a494-b09e676509a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.665705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2cdeac-60c5-4d03-a494-b09e676509a7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.680268 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 806/1599] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:02.681747 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cdeac-60c5-4d03-a494-b09e676509a7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.693984 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cdeac-60c5-4d03-a494-b09e676509a7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.699468 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9919b-ba6e-4f5c-a291-43e8eebaa67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.701308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9919b-ba6e-4f5c-a291-43e8eebaa67a admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.701663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9919b-ba6e-4f5c-a291-43e8eebaa67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.702211 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9919b-ba6e-4f5c-a291-43e8eebaa67a admin admin] PATH_INFO: `/v3/projects/2c81f2396c844183bcb29107917af0c4/users/dd29391d48434f67894eb8efcec99012/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.719472 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9919b-ba6e-4f5c-a291-43e8eebaa67a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c81f2396c844183bcb29107917af0c4, user_id=dd29391d48434f67894eb8efcec99012, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.722479 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9919b-ba6e-4f5c-a291-43e8eebaa67a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.745221 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 807/1600] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:02 2022] PUT /identity/v3/projects/2c81f2396c844183bcb29107917af0c4/users/dd29391d48434f67894eb8efcec99012/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:02.746471 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9919b-ba6e-4f5c-a291-43e8eebaa67a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.766803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 794/1601] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:02.767942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d50fb-0b15-4a22-8959-267a2d4bfc36 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.792765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d50fb-0b15-4a22-8959-267a2d4bfc36 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.863096 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9919b-ba6e-4f5c-a291-43e8eebaa67a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.868768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88f39f-2552-422e-879e-d9be1f0dc0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.868936 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eec7a7-9ae3-4719-9ba0-a089fb30067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.869464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eec7a7-9ae3-4719-9ba0-a089fb30067f admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.869743 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eec7a7-9ae3-4719-9ba0-a089fb30067f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.870024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eec7a7-9ae3-4719-9ba0-a089fb30067f admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.870909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eec7a7-9ae3-4719-9ba0-a089fb30067f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.871099 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88f39f-2552-422e-879e-d9be1f0dc0ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.871580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88f39f-2552-422e-879e-d9be1f0dc0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.872345 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88f39f-2552-422e-879e-d9be1f0dc0ae admin admin] PATH_INFO: `/v3/projects/dc10c67b949e4e91a5add7996094f3db/users/b7f4fed0af3b4b8d93fa7881be94edfc/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.872689 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eec7a7-9ae3-4719-9ba0-a089fb30067f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.885723 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 795/1602] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:02.886555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eec7a7-9ae3-4719-9ba0-a089fb30067f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.897798 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eec7a7-9ae3-4719-9ba0-a089fb30067f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:02.898341 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88f39f-2552-422e-879e-d9be1f0dc0ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc10c67b949e4e91a5add7996094f3db, user_id=b7f4fed0af3b4b8d93fa7881be94edfc, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.901344 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88f39f-2552-422e-879e-d9be1f0dc0ae admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.904742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3502d1-0cd3-4404-a425-780be21c3148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:02.905726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3502d1-0cd3-4404-a425-780be21c3148 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:02.906117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3502d1-0cd3-4404-a425-780be21c3148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:02.906502 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3502d1-0cd3-4404-a425-780be21c3148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:02.908208 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3502d1-0cd3-4404-a425-780be21c3148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:02.909925 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3502d1-0cd3-4404-a425-780be21c3148 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:02.925387 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 796/1603] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:02.926976 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3502d1-0cd3-4404-a425-780be21c3148 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.939985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 808/1604] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:02 2022] PUT /identity/v3/projects/dc10c67b949e4e91a5add7996094f3db/users/b7f4fed0af3b4b8d93fa7881be94edfc/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:02.939985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88f39f-2552-422e-879e-d9be1f0dc0ae admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:02.940427 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bd3502d1-0cd3-4404-a425-780be21c3148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:03.037255 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:03.058593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88f39f-2552-422e-879e-d9be1f0dc0ae admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:03.062246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3502d1-0cd3-4404-a425-780be21c3148 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:03.063573 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb543ce-0702-4af5-b566-1d28feb78670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:03.064682 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb543ce-0702-4af5-b566-1d28feb78670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:03.065236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb543ce-0702-4af5-b566-1d28feb78670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:03.065639 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb543ce-0702-4af5-b566-1d28feb78670 admin admin] PATH_INFO: `/v3/projects/3da28f5e361c4e03badc1253b2dd9c01/users/41d129f3abda4ed4a24720f6662ac5f2/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:03.084837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb543ce-0702-4af5-b566-1d28feb78670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da28f5e361c4e03badc1253b2dd9c01, user_id=41d129f3abda4ed4a24720f6662ac5f2, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:03.087651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb543ce-0702-4af5-b566-1d28feb78670 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:03.117414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 809/1605] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:02 2022] PUT /identity/v3/projects/3da28f5e361c4e03badc1253b2dd9c01/users/41d129f3abda4ed4a24720f6662ac5f2/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:03.120646 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effe509-1c81-42b5-82c2-6366fccf4df0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:03.121055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effe509-1c81-42b5-82c2-6366fccf4df0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:03.121629 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effe509-1c81-42b5-82c2-6366fccf4df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:03.142499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2effe509-1c81-42b5-82c2-6366fccf4df0 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:03.143849 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2effe509-1c81-42b5-82c2-6366fccf4df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:03.149081 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ad08e-51b5-4ac9-adf6-45df00b769cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:03.149752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ad08e-51b5-4ac9-adf6-45df00b769cc service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:03.150040 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ad08e-51b5-4ac9-adf6-45df00b769cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:03.150278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:03.150405 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ad08e-51b5-4ac9-adf6-45df00b769cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:03.162864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ad08e-51b5-4ac9-adf6-45df00b769cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:03.164439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ad08e-51b5-4ac9-adf6-45df00b769cc service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:03.175742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 797/1606] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:03.176793 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ad08e-51b5-4ac9-adf6-45df00b769cc service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:03.187579 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ad08e-51b5-4ac9-adf6-45df00b769cc service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:03.233854 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 810/1607] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:03.235842 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effe509-1c81-42b5-82c2-6366fccf4df0 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:03.248137 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effe509-1c81-42b5-82c2-6366fccf4df0 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:03.254924 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73e802-d0d2-48f9-a51e-06d858e70ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:03.256107 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73e802-d0d2-48f9-a51e-06d858e70ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:03.256469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73e802-d0d2-48f9-a51e-06d858e70ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:03.256830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73e802-d0d2-48f9-a51e-06d858e70ff3 admin admin] PATH_INFO: `/v3/projects/c5fcb6104ac148b7b077d0a098a57c55/users/8f151217dc5d45e694ac22976e821796/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:03.277229 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e05e0d-ac5d-4690-b53e-43ed68424c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:03.278207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e05e0d-ac5d-4690-b53e-43ed68424c36 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:03.278633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e05e0d-ac5d-4690-b53e-43ed68424c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:03.279001 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e05e0d-ac5d-4690-b53e-43ed68424c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:03.280171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73e802-d0d2-48f9-a51e-06d858e70ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5fcb6104ac148b7b077d0a098a57c55, user_id=8f151217dc5d45e694ac22976e821796, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:03.280332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e05e0d-ac5d-4690-b53e-43ed68424c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:03.283957 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e05e0d-ac5d-4690-b53e-43ed68424c36 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:03.284840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73e802-d0d2-48f9-a51e-06d858e70ff3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:03.303428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 811/1608] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:03 2022] PUT /identity/v3/projects/c5fcb6104ac148b7b077d0a098a57c55/users/8f151217dc5d45e694ac22976e821796/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:03.313302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73e802-d0d2-48f9-a51e-06d858e70ff3 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:03.320860 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 798/1609] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:03 2022] POST /identity/v3/projects => generated 405 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:03.323062 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88674a8e-3756-4577-bb84-884922f3b2e3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:03.323452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88674a8e-3756-4577-bb84-884922f3b2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:03.323786 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88674a8e-3756-4577-bb84-884922f3b2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:03.359656 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-88674a8e-3756-4577-bb84-884922f3b2e3 None None] MFA Rules not processed for user `b7f4fed0af3b4b8d93fa7881be94edfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:03.362543 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-88674a8e-3756-4577-bb84-884922f3b2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:03.451628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73e802-d0d2-48f9-a51e-06d858e70ff3 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:03.457739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 799/1610] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:03.459904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeda41c-a4df-478c-8bd5-51629397a0d9 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:03.460333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeda41c-a4df-478c-8bd5-51629397a0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:03.460994 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeda41c-a4df-478c-8bd5-51629397a0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:03.487239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:03.499280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-baeda41c-a4df-478c-8bd5-51629397a0d9 None None] MFA Rules not processed for user `41d129f3abda4ed4a24720f6662ac5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:03.501628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-baeda41c-a4df-478c-8bd5-51629397a0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:03.598359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 800/1611] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:03.599091 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeda41c-a4df-478c-8bd5-51629397a0d9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:03.606222 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fb635-5150-45ee-95c0-ce9bc1d1f25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:03.607049 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fb635-5150-45ee-95c0-ce9bc1d1f25e admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:03.607344 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fb635-5150-45ee-95c0-ce9bc1d1f25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:03.607626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fb635-5150-45ee-95c0-ce9bc1d1f25e admin admin] PATH_INFO: `/v3/projects/913f339d469d47358b667d307dfa17c8/users/7fe7faa84d8847a6a11e9ae379e4b15d/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:03.651816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fb635-5150-45ee-95c0-ce9bc1d1f25e admin admin] RBAC: Authorizing `identity:create_grant(project_id=913f339d469d47358b667d307dfa17c8, user_id=7fe7faa84d8847a6a11e9ae379e4b15d, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:03.657197 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fb635-5150-45ee-95c0-ce9bc1d1f25e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:03.682642 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 812/1612] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:03 2022] PUT /identity/v3/projects/913f339d469d47358b667d307dfa17c8/users/7fe7faa84d8847a6a11e9ae379e4b15d/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:03.684010 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e710b-841b-4996-bff3-883eaf4d5f50 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:03.684314 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e710b-841b-4996-bff3-883eaf4d5f50 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:03.684603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e710b-841b-4996-bff3-883eaf4d5f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:03.754481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d25e710b-841b-4996-bff3-883eaf4d5f50 None None] MFA Rules not processed for user `8f151217dc5d45e694ac22976e821796`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:03.755851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d25e710b-841b-4996-bff3-883eaf4d5f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:03.757063 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeda41c-a4df-478c-8bd5-51629397a0d9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:03.782603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:03.898417 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcc1bf-98f5-4e62-903a-a55e5c1a12e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:03.899876 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcc1bf-98f5-4e62-903a-a55e5c1a12e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:03.900215 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcc1bf-98f5-4e62-903a-a55e5c1a12e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:03.900501 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcc1bf-98f5-4e62-903a-a55e5c1a12e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:03.918991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 813/1613] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:03.918991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e710b-841b-4996-bff3-883eaf4d5f50 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:04.051502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e710b-841b-4996-bff3-883eaf4d5f50 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:04.057341 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcc1bf-98f5-4e62-903a-a55e5c1a12e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:04.062469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcc1bf-98f5-4e62-903a-a55e5c1a12e8 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:04.068296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6536591-ca1d-4ae9-8381-9d9c1f3b4a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:04.069241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6536591-ca1d-4ae9-8381-9d9c1f3b4a28 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:04.069754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6536591-ca1d-4ae9-8381-9d9c1f3b4a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:04.071549 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6536591-ca1d-4ae9-8381-9d9c1f3b4a28 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:04.072515 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6536591-ca1d-4ae9-8381-9d9c1f3b4a28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:04.075976 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6536591-ca1d-4ae9-8381-9d9c1f3b4a28 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:04.092575 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 801/1614] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:04.095331 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc88a24-5256-41e4-900d-a5212fb993f2 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:04.095717 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc88a24-5256-41e4-900d-a5212fb993f2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:04.096243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc88a24-5256-41e4-900d-a5212fb993f2 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:04.099322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 802/1615] 10.222.0.73 () {54 vars in 961 bytes} [Thu May 19 12:09:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:09:04.104153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31184f6-2775-49df-a938-439af45528ae None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:04.104834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31184f6-2775-49df-a938-439af45528ae None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:04.105212 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31184f6-2775-49df-a938-439af45528ae None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:04.107433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 803/1616] 10.222.0.73 () {54 vars in 961 bytes} [Thu May 19 12:09:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:09:04.109169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ec9e5-fd32-437f-9d57-9fa0d85add09 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:04.111168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ec9e5-fd32-437f-9d57-9fa0d85add09 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:04.118222 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ec9e5-fd32-437f-9d57-9fa0d85add09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:04.129412 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 814/1617] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:03 2022] POST /identity/v3/users => generated 309 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:04.130973 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6536591-ca1d-4ae9-8381-9d9c1f3b4a28 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:04.157541 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:04.179648 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-816ec9e5-fd32-437f-9d57-9fa0d85add09 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:04.188946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-816ec9e5-fd32-437f-9d57-9fa0d85add09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:04.224522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 804/1618] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:04.231771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31923f-8f18-4851-9b2d-dab4d0a66658 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:04.234159 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31923f-8f18-4851-9b2d-dab4d0a66658 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:04.234638 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31923f-8f18-4851-9b2d-dab4d0a66658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:04.281551 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ed31923f-8f18-4851-9b2d-dab4d0a66658 None None] MFA Rules not processed for user `bd0c1f0710f3447d94e67048a508781e`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:04.283519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ed31923f-8f18-4851-9b2d-dab4d0a66658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:04.336606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6536591-ca1d-4ae9-8381-9d9c1f3b4a28 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:04.349882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769e765-f65b-4842-99d5-49ce67eda771 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:04.350793 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769e765-f65b-4842-99d5-49ce67eda771 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:04.351189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769e765-f65b-4842-99d5-49ce67eda771 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:04.351619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769e765-f65b-4842-99d5-49ce67eda771 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:04.374106 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769e765-f65b-4842-99d5-49ce67eda771 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:04.377475 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769e765-f65b-4842-99d5-49ce67eda771 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:04.396758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 815/1619] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:04.412585 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f031-7c2f-41df-a463-35099d8d6afc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:04.413257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f031-7c2f-41df-a463-35099d8d6afc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:04.413794 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f031-7c2f-41df-a463-35099d8d6afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:04.423685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 805/1620] 10.222.0.73 () {58 vars in 1058 bytes} [Thu May 19 12:09:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:04.425542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31923f-8f18-4851-9b2d-dab4d0a66658 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:04.450647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31923f-8f18-4851-9b2d-dab4d0a66658 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:04.458928 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2af8f031-7c2f-41df-a463-35099d8d6afc None None] MFA Rules not processed for user `bd0c1f0710f3447d94e67048a508781e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:04.461369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2af8f031-7c2f-41df-a463-35099d8d6afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:04.461767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c1886-be4b-445a-92e8-292755a52a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:04.463182 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c1886-be4b-445a-92e8-292755a52a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:04.463466 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c1886-be4b-445a-92e8-292755a52a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:04.463745 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c1886-be4b-445a-92e8-292755a52a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:04.464513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c1886-be4b-445a-92e8-292755a52a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:04.470536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c1886-be4b-445a-92e8-292755a52a0c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:04.490578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 816/1621] 10.222.0.73 () {58 vars in 1058 bytes} [Thu May 19 12:09:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:04.491878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8f031-7c2f-41df-a463-35099d8d6afc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:04.503742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 806/1622] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:04.503742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1f6a4-a27b-4049-90b1-6bb54dc84673 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:04.503742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1f6a4-a27b-4049-90b1-6bb54dc84673 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:04.503742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1f6a4-a27b-4049-90b1-6bb54dc84673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:04.509564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8f031-7c2f-41df-a463-35099d8d6afc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:04.515501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a43018-3323-49ec-98c3-281a421e2d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:04.517841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a43018-3323-49ec-98c3-281a421e2d00 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:04.518493 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a43018-3323-49ec-98c3-281a421e2d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:04.519050 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a43018-3323-49ec-98c3-281a421e2d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:04.534116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a43018-3323-49ec-98c3-281a421e2d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:04.537001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a43018-3323-49ec-98c3-281a421e2d00 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:04.553641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 817/1623] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:04.554938 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a43018-3323-49ec-98c3-281a421e2d00 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:04.576135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a43018-3323-49ec-98c3-281a421e2d00 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:04.585469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8feadbe-9350-48cc-b337-e3d5adff9c9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:04.586337 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8feadbe-9350-48cc-b337-e3d5adff9c9d service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:04.586785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8feadbe-9350-48cc-b337-e3d5adff9c9d service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:04.587172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8feadbe-9350-48cc-b337-e3d5adff9c9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:04.588843 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9ef1f6a4-a27b-4049-90b1-6bb54dc84673 None None] MFA Rules not processed for user `742acbf02db44496afd7dafdb7ca0091`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:04.591522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9ef1f6a4-a27b-4049-90b1-6bb54dc84673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:04.635525 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:04.710647 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8feadbe-9350-48cc-b337-e3d5adff9c9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:04.712748 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8feadbe-9350-48cc-b337-e3d5adff9c9d service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:04.737275 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 807/1624] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:04.738783 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 818/1625] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:04.739853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1f6a4-a27b-4049-90b1-6bb54dc84673 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:04.740213 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8feadbe-9350-48cc-b337-e3d5adff9c9d service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:04.759719 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8feadbe-9350-48cc-b337-e3d5adff9c9d service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:04.763895 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1f6a4-a27b-4049-90b1-6bb54dc84673 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:04.776172 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5750b-4f12-45ff-a9c1-84664094dba1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:04.777060 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5750b-4f12-45ff-a9c1-84664094dba1 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:04.778107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5750b-4f12-45ff-a9c1-84664094dba1 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:04.778595 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5750b-4f12-45ff-a9c1-84664094dba1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:04.786644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70910f-aa58-4922-8667-529eb80cdeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:04.790796 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70910f-aa58-4922-8667-529eb80cdeb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:04.795085 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70910f-aa58-4922-8667-529eb80cdeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:04.797008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70910f-aa58-4922-8667-529eb80cdeb2 admin admin] PATH_INFO: `/v3/projects/9ece571b0c364973b1b6c78762daf760/users/4d6e79df3d1b4de2bed2ebd9de86c513/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:04.845672 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70910f-aa58-4922-8667-529eb80cdeb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ece571b0c364973b1b6c78762daf760, user_id=4d6e79df3d1b4de2bed2ebd9de86c513, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:04.849017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70910f-aa58-4922-8667-529eb80cdeb2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:04.892881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 819/1626] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:04 2022] PUT /identity/v3/projects/9ece571b0c364973b1b6c78762daf760/users/4d6e79df3d1b4de2bed2ebd9de86c513/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:04.894249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6376ef-6988-4756-8fea-9b49eee024f4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:04.894549 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6376ef-6988-4756-8fea-9b49eee024f4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:04.894831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6376ef-6988-4756-8fea-9b49eee024f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:04.920946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5750b-4f12-45ff-a9c1-84664094dba1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:04.923367 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5750b-4f12-45ff-a9c1-84664094dba1 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:04.935521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 808/1627] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:04.936591 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5750b-4f12-45ff-a9c1-84664094dba1 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:04.950677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fe6376ef-6988-4756-8fea-9b49eee024f4 None None] MFA Rules not processed for user `742acbf02db44496afd7dafdb7ca0091`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:04.950892 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5750b-4f12-45ff-a9c1-84664094dba1 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:04.954798 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fe6376ef-6988-4756-8fea-9b49eee024f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:04.956200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:05.020711 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28e507-5435-46e2-bcde-b3ef53a0c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:05.021562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28e507-5435-46e2-bcde-b3ef53a0c0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:05.022043 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28e507-5435-46e2-bcde-b3ef53a0c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:05.022477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28e507-5435-46e2-bcde-b3ef53a0c0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:05.024679 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28e507-5435-46e2-bcde-b3ef53a0c0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:05.028414 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28e507-5435-46e2-bcde-b3ef53a0c0e3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:05.053527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 809/1628] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:05.059594 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28e507-5435-46e2-bcde-b3ef53a0c0e3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:05.078745 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28e507-5435-46e2-bcde-b3ef53a0c0e3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:05.098266 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82ad8a-275b-43c9-994b-93d1777e2a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:05.098266 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82ad8a-275b-43c9-994b-93d1777e2a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:05.101198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82ad8a-275b-43c9-994b-93d1777e2a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:05.101627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82ad8a-275b-43c9-994b-93d1777e2a73 admin admin] PATH_INFO: `/v3/projects/9ece571b0c364973b1b6c78762daf760/users/4d6e79df3d1b4de2bed2ebd9de86c513/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:05.108981 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82ad8a-275b-43c9-994b-93d1777e2a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ece571b0c364973b1b6c78762daf760, user_id=4d6e79df3d1b4de2bed2ebd9de86c513, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:05.112436 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82ad8a-275b-43c9-994b-93d1777e2a73 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:05.137558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 820/1629] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:05.146624 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 810/1630] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:05 2022] PUT /identity/v3/projects/9ece571b0c364973b1b6c78762daf760/users/4d6e79df3d1b4de2bed2ebd9de86c513/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:05.148641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6579b9-7b9a-47a6-900a-c63eb699fdfc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:05.148941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6579b9-7b9a-47a6-900a-c63eb699fdfc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:05.149227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6579b9-7b9a-47a6-900a-c63eb699fdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:05.212700 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8f6579b9-7b9a-47a6-900a-c63eb699fdfc None None] MFA Rules not processed for user `4d6e79df3d1b4de2bed2ebd9de86c513`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:05.213840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8f6579b9-7b9a-47a6-900a-c63eb699fdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:05.465386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9f4b1-faf9-42b8-9be3-8bb84766e1cf None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:05.465825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9f4b1-faf9-42b8-9be3-8bb84766e1cf None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:05.466148 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9f4b1-faf9-42b8-9be3-8bb84766e1cf None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:05.467699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 811/1631] 10.222.0.73 () {54 vars in 912 bytes} [Thu May 19 12:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 12:09:05.480813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdefc3-9612-4de4-819f-75898b09e833 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:05.481539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdefc3-9612-4de4-819f-75898b09e833 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:05.481956 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdefc3-9612-4de4-819f-75898b09e833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:05.542284 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f8cdefc3-9612-4de4-819f-75898b09e833 None None] MFA Rules not processed for user `bd0c1f0710f3447d94e67048a508781e`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:05.545429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f8cdefc3-9612-4de4-819f-75898b09e833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:05.660343 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 821/1632] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:05 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 512 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:05.660343 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6579b9-7b9a-47a6-900a-c63eb699fdfc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:05.713616 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 812/1633] 10.222.0.73 () {58 vars in 1009 bytes} [Thu May 19 12:09:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:09:05.714771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdefc3-9612-4de4-819f-75898b09e833 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:05.736909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:05.857770 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6579b9-7b9a-47a6-900a-c63eb699fdfc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:05.870973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdefc3-9612-4de4-819f-75898b09e833 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:05.877714 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdcba7-f88e-48f0-a8b5-f538dd77391e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:05.878743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdcba7-f88e-48f0-a8b5-f538dd77391e service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:05.879162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdcba7-f88e-48f0-a8b5-f538dd77391e service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:05.879478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdcba7-f88e-48f0-a8b5-f538dd77391e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:05.882004 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d51d1c-c19e-487b-826b-e51795a8ca3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:05.882959 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d51d1c-c19e-487b-826b-e51795a8ca3b service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:05.883485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d51d1c-c19e-487b-826b-e51795a8ca3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:05.884053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d51d1c-c19e-487b-826b-e51795a8ca3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:05.910552 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d51d1c-c19e-487b-826b-e51795a8ca3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:05.912291 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d51d1c-c19e-487b-826b-e51795a8ca3b service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:05.936749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 813/1634] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:05 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:05.937721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d51d1c-c19e-487b-826b-e51795a8ca3b service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:05.962567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d51d1c-c19e-487b-826b-e51795a8ca3b service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:05.980378 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54648c-6d6a-4d97-845e-39ba3f046a5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:05.981682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54648c-6d6a-4d97-845e-39ba3f046a5b service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:05.982083 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54648c-6d6a-4d97-845e-39ba3f046a5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:05.982467 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54648c-6d6a-4d97-845e-39ba3f046a5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:06.004547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54648c-6d6a-4d97-845e-39ba3f046a5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:06.005787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54648c-6d6a-4d97-845e-39ba3f046a5b service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:06.023140 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 814/1635] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:06.091402 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdcba7-f88e-48f0-a8b5-f538dd77391e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:06.093066 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdcba7-f88e-48f0-a8b5-f538dd77391e service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:06.135619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 822/1636] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:06.346114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85272e5a-924e-4cc6-ad66-f560e6046186 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:06.346505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85272e5a-924e-4cc6-ad66-f560e6046186 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:06.348013 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85272e5a-924e-4cc6-ad66-f560e6046186 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:06.350047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 815/1637] 10.222.0.73 () {54 vars in 912 bytes} [Thu May 19 12:09:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:09:06.369562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f2632-6a07-4bde-b302-619dae9a0c40 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:06.370004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f2632-6a07-4bde-b302-619dae9a0c40 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:06.370949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f2632-6a07-4bde-b302-619dae9a0c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:06.410604 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1b7f2632-6a07-4bde-b302-619dae9a0c40 None None] MFA Rules not processed for user `bd0c1f0710f3447d94e67048a508781e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:06.415019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1b7f2632-6a07-4bde-b302-619dae9a0c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:06.441557 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 823/1638] 10.222.0.73 () {58 vars in 1009 bytes} [Thu May 19 12:09:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:06.457335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85272e5a-924e-4cc6-ad66-f560e6046186 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:06.461807 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-85272e5a-924e-4cc6-ad66-f560e6046186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:06.518617 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:06.708513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85272e5a-924e-4cc6-ad66-f560e6046186 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:06.713080 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d5a9b-d8b3-44b5-827f-1921a9c862f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182c7bb48c184e9983c02ae86709e803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:06.714062 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d5a9b-d8b3-44b5-827f-1921a9c862f2 service glance] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:06.714572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d5a9b-d8b3-44b5-827f-1921a9c862f2 service glance] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:06.715007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d5a9b-d8b3-44b5-827f-1921a9c862f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:06.757862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d5a9b-d8b3-44b5-827f-1921a9c862f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:06.765040 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d5a9b-d8b3-44b5-827f-1921a9c862f2 service glance] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:06.809661 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 816/1639] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:09:06.853136 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f2632-6a07-4bde-b302-619dae9a0c40 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:07.006757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f2632-6a07-4bde-b302-619dae9a0c40 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:07.026685 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccfc53-a56f-46c4-b5a4-cb337f358d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:07.027750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccfc53-a56f-46c4-b5a4-cb337f358d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:07.028089 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccfc53-a56f-46c4-b5a4-cb337f358d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:07.028379 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccfc53-a56f-46c4-b5a4-cb337f358d37 admin admin] PATH_INFO: `/v3/users/ba2a6f7bd1664fe4a83e2e4fe52b200d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:07.029873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccfc53-a56f-46c4-b5a4-cb337f358d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba2a6f7bd1664fe4a83e2e4fe52b200d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:07.035880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccfc53-a56f-46c4-b5a4-cb337f358d37 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:07.207332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d5a9b-d8b3-44b5-827f-1921a9c862f2 service glance] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:07.210419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-61ccfc53-a56f-46c4-b5a4-cb337f358d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba2a6f7bd1664fe4a83e2e4fe52b200d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:07.210419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-61ccfc53-a56f-46c4-b5a4-cb337f358d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba2a6f7bd1664fe4a83e2e4fe52b200d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:07.213906 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-61ccfc53-a56f-46c4-b5a4-cb337f358d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba2a6f7bd1664fe4a83e2e4fe52b200d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:07.217041 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:07.218749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d5a9b-d8b3-44b5-827f-1921a9c862f2 service glance] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:07.226215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-61ccfc53-a56f-46c4-b5a4-cb337f358d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba2a6f7bd1664fe4a83e2e4fe52b200d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:07.229006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c93d9a-ef71-4172-9bc4-bbd5e409941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:07.230087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c93d9a-ef71-4172-9bc4-bbd5e409941d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:07.230473 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c93d9a-ef71-4172-9bc4-bbd5e409941d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:07.230845 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c93d9a-ef71-4172-9bc4-bbd5e409941d admin admin] PATH_INFO: `/v3/users/b7f4fed0af3b4b8d93fa7881be94edfc` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:07.234226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c93d9a-ef71-4172-9bc4-bbd5e409941d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f4fed0af3b4b8d93fa7881be94edfc)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:07.238638 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-a8c93d9a-ef71-4172-9bc4-bbd5e409941d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:09:07.238638 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: warnings.warn(msg) May 19 12:09:07.238638 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: May 19 12:09:07.240180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c93d9a-ef71-4172-9bc4-bbd5e409941d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:07.247312 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-61ccfc53-a56f-46c4-b5a4-cb337f358d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba2a6f7bd1664fe4a83e2e4fe52b200d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:07.256875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 824/1640] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:06 2022] DELETE /identity/v3/users/ba2a6f7bd1664fe4a83e2e4fe52b200d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:07.261268 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761d9ea-63c3-47d1-a319-644dbfe47879 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:07.261685 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761d9ea-63c3-47d1-a319-644dbfe47879 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:07.262445 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761d9ea-63c3-47d1-a319-644dbfe47879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:07.298698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f761d9ea-63c3-47d1-a319-644dbfe47879 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:07.301252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f761d9ea-63c3-47d1-a319-644dbfe47879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:07.356343 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a8c93d9a-ef71-4172-9bc4-bbd5e409941d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f4fed0af3b4b8d93fa7881be94edfc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:07.388654 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a8c93d9a-ef71-4172-9bc4-bbd5e409941d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f4fed0af3b4b8d93fa7881be94edfc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:07.404512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a8c93d9a-ef71-4172-9bc4-bbd5e409941d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f4fed0af3b4b8d93fa7881be94edfc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:07.405458 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a8c93d9a-ef71-4172-9bc4-bbd5e409941d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f4fed0af3b4b8d93fa7881be94edfc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:07.406721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a8c93d9a-ef71-4172-9bc4-bbd5e409941d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f4fed0af3b4b8d93fa7881be94edfc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:07.465456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 825/1641] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:09:07.502482 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 817/1642] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:07 2022] DELETE /identity/v3/users/b7f4fed0af3b4b8d93fa7881be94edfc => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:09:07.507098 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a3fe7-1ce7-4df0-8443-1574a75faa80 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:07.507836 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a3fe7-1ce7-4df0-8443-1574a75faa80 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:07.508168 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a3fe7-1ce7-4df0-8443-1574a75faa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:07.519877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c93d9a-ef71-4172-9bc4-bbd5e409941d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:07.524555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a8c93d9a-ef71-4172-9bc4-bbd5e409941d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:07.573942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-833a3fe7-1ce7-4df0-8443-1574a75faa80 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:07.576338 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-833a3fe7-1ce7-4df0-8443-1574a75faa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:07.710244 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c93d9a-ef71-4172-9bc4-bbd5e409941d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:07.722755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0cbb7-22e0-4def-8682-6c83a3d35d0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:07.723780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0cbb7-22e0-4def-8682-6c83a3d35d0f service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:07.724086 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0cbb7-22e0-4def-8682-6c83a3d35d0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:07.724371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0cbb7-22e0-4def-8682-6c83a3d35d0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:07.741058 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 826/1643] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:07.744968 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c6e3c-6351-4bae-bce3-937295118718 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:07.745266 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c6e3c-6351-4bae-bce3-937295118718 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:07.745551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c6e3c-6351-4bae-bce3-937295118718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:07.751242 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0cbb7-22e0-4def-8682-6c83a3d35d0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:07.753140 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0cbb7-22e0-4def-8682-6c83a3d35d0f service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:07.777527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 818/1644] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:07.803952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e4d3e-c337-4347-8d50-338a9b27e1a5 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:07.804254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e4d3e-c337-4347-8d50-338a9b27e1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:07.804564 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e4d3e-c337-4347-8d50-338a9b27e1a5 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:07.806465 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 819/1645] 10.222.0.73 () {54 vars in 912 bytes} [Thu May 19 12:09:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:09:07.807389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e4d3e-c337-4347-8d50-338a9b27e1a5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:07.815627 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ea4c6e3c-6351-4bae-bce3-937295118718 None None] MFA Rules not processed for user `7fe7faa84d8847a6a11e9ae379e4b15d`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:07.818620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ea4c6e3c-6351-4bae-bce3-937295118718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:07.842111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e4d3e-c337-4347-8d50-338a9b27e1a5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:07.853070 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade5f02-206d-457a-b2e3-b838f7ef9f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:07.856342 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade5f02-206d-457a-b2e3-b838f7ef9f9f service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:07.857247 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade5f02-206d-457a-b2e3-b838f7ef9f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:07.858310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade5f02-206d-457a-b2e3-b838f7ef9f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:07.888277 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade5f02-206d-457a-b2e3-b838f7ef9f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:07.893076 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade5f02-206d-457a-b2e3-b838f7ef9f9f service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:07.920765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 820/1646] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:07.923371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b960f3-cc3d-4e7e-a31b-bd7b073e6cdc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:07.926156 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b960f3-cc3d-4e7e-a31b-bd7b073e6cdc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:07.941249 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b960f3-cc3d-4e7e-a31b-bd7b073e6cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:07.988830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 827/1647] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:07 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:07.993474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c6e3c-6351-4bae-bce3-937295118718 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:07.994988 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ea4c6e3c-6351-4bae-bce3-937295118718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:08.022609 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:08.036265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c6e3c-6351-4bae-bce3-937295118718 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:08.048269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a84a44-7c99-47ac-8f7a-479bcc569fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:08.050892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a84a44-7c99-47ac-8f7a-479bcc569fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:08.051875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a84a44-7c99-47ac-8f7a-479bcc569fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:08.052198 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a84a44-7c99-47ac-8f7a-479bcc569fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:08.053763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a84a44-7c99-47ac-8f7a-479bcc569fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:08.060117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:08.060866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a84a44-7c99-47ac-8f7a-479bcc569fd7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:08.084912 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d5b960f3-cc3d-4e7e-a31b-bd7b073e6cdc None None] MFA Rules not processed for user `4897919923a64881ac5540cc5d58df1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:08.088047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d5b960f3-cc3d-4e7e-a31b-bd7b073e6cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:08.112481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 821/1648] 10.222.0.73 () {58 vars in 1009 bytes} [Thu May 19 12:09:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:08.138760 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 828/1649] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:07 2022] POST /identity/v3/projects => generated 403 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:08.143001 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b960f3-cc3d-4e7e-a31b-bd7b073e6cdc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:08.153547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a84a44-7c99-47ac-8f7a-479bcc569fd7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:08.169131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b960f3-cc3d-4e7e-a31b-bd7b073e6cdc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:08.316733 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a84a44-7c99-47ac-8f7a-479bcc569fd7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:08.326300 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ba03e-80a2-48bd-97dc-48133d50c580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:08.326993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ba03e-80a2-48bd-97dc-48133d50c580 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:08.330122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ba03e-80a2-48bd-97dc-48133d50c580 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:08.330528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ba03e-80a2-48bd-97dc-48133d50c580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:08.337014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d7713-f50c-4bc0-8a45-8d001eaa2aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:08.337702 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d7713-f50c-4bc0-8a45-8d001eaa2aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:08.337986 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d7713-f50c-4bc0-8a45-8d001eaa2aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:08.338260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d7713-f50c-4bc0-8a45-8d001eaa2aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:08.341109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d7713-f50c-4bc0-8a45-8d001eaa2aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:08.345685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d7713-f50c-4bc0-8a45-8d001eaa2aa7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:08.349908 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ba03e-80a2-48bd-97dc-48133d50c580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:08.362569 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ba03e-80a2-48bd-97dc-48133d50c580 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:08.400080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 829/1650] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:08.413189 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 822/1651] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:08 2022] POST /identity/v3/users => generated 308 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:08.417372 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ba03e-80a2-48bd-97dc-48133d50c580 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:08.443157 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ba03e-80a2-48bd-97dc-48133d50c580 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:08.457295 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06656303-80b9-4d6b-a2ea-f5eb0a0e274d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:08.457985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656303-80b9-4d6b-a2ea-f5eb0a0e274d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:08.458271 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656303-80b9-4d6b-a2ea-f5eb0a0e274d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:08.462757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656303-80b9-4d6b-a2ea-f5eb0a0e274d admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:08.464100 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06656303-80b9-4d6b-a2ea-f5eb0a0e274d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:08.466785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06656303-80b9-4d6b-a2ea-f5eb0a0e274d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:08.492579 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 830/1652] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:08.495870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d7713-f50c-4bc0-8a45-8d001eaa2aa7 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:08.510187 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d7713-f50c-4bc0-8a45-8d001eaa2aa7 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:08.522475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa3ec-7222-4eac-b80b-9d084a070711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:08.524605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa3ec-7222-4eac-b80b-9d084a070711 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:08.526006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa3ec-7222-4eac-b80b-9d084a070711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:08.526006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa3ec-7222-4eac-b80b-9d084a070711 admin admin] PATH_INFO: `/v3/projects/94d561027acf49129b8878131fdd100d/users/f9964e2d7ecd453dbae3851cad81c5b4/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:08.570794 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fa3ec-7222-4eac-b80b-9d084a070711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d561027acf49129b8878131fdd100d, user_id=f9964e2d7ecd453dbae3851cad81c5b4, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:08.578050 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fa3ec-7222-4eac-b80b-9d084a070711 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:08.610198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 823/1653] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:08 2022] PUT /identity/v3/projects/94d561027acf49129b8878131fdd100d/users/f9964e2d7ecd453dbae3851cad81c5b4/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:08.614038 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06656303-80b9-4d6b-a2ea-f5eb0a0e274d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:08.631372 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06656303-80b9-4d6b-a2ea-f5eb0a0e274d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:08.806861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a515a3-84ca-4742-aa41-7343db436ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:08.817671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a515a3-84ca-4742-aa41-7343db436ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:08.818159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a515a3-84ca-4742-aa41-7343db436ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:08.818580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a515a3-84ca-4742-aa41-7343db436ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:08.819478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a515a3-84ca-4742-aa41-7343db436ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:08.823488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a515a3-84ca-4742-aa41-7343db436ef1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:08.854816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 831/1654] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:08.860510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa3ec-7222-4eac-b80b-9d084a070711 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:08.884820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa3ec-7222-4eac-b80b-9d084a070711 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:08.898222 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3450eff-14b1-4d44-8718-ee539ea54da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:08.900539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3450eff-14b1-4d44-8718-ee539ea54da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:08.901004 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3450eff-14b1-4d44-8718-ee539ea54da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:08.901440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3450eff-14b1-4d44-8718-ee539ea54da9 admin admin] PATH_INFO: `/v3/projects/94d561027acf49129b8878131fdd100d/users/f9964e2d7ecd453dbae3851cad81c5b4/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:08.921732 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3450eff-14b1-4d44-8718-ee539ea54da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d561027acf49129b8878131fdd100d, user_id=f9964e2d7ecd453dbae3851cad81c5b4, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:08.928804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3450eff-14b1-4d44-8718-ee539ea54da9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:08.944878 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 824/1655] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:08 2022] PUT /identity/v3/projects/94d561027acf49129b8878131fdd100d/users/f9964e2d7ecd453dbae3851cad81c5b4/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:09.642865 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a515a3-84ca-4742-aa41-7343db436ef1 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:09.647614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d7a515a3-84ca-4742-aa41-7343db436ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:09.698788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a515a3-84ca-4742-aa41-7343db436ef1 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:09.730911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b2496-e1fc-471c-bcd2-897791044b90 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:09.731757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b2496-e1fc-471c-bcd2-897791044b90 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:09.732270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b2496-e1fc-471c-bcd2-897791044b90 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:09.738880 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 825/1656] 10.222.0.73 () {54 vars in 960 bytes} [Thu May 19 12:09:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:09:09.750207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9241a0-0c1d-4e1d-8684-66c926ba017a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:09.750711 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9241a0-0c1d-4e1d-8684-66c926ba017a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:09.751217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9241a0-0c1d-4e1d-8684-66c926ba017a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:09.824134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-de9241a0-0c1d-4e1d-8684-66c926ba017a None None] MFA Rules not processed for user `e9cccb366fc6429e9a30d4f9de64e8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:09.854081 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-de9241a0-0c1d-4e1d-8684-66c926ba017a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:09.967749 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bf549-7639-4909-afc4-69b83e4b18a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:09.971191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bf549-7639-4909-afc4-69b83e4b18a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:09.971554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bf549-7639-4909-afc4-69b83e4b18a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:09.972713 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bf549-7639-4909-afc4-69b83e4b18a7 admin admin] PATH_INFO: `/v3/projects/1d062625964248e9837faaf1e6890c10` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:09.980870 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bf549-7639-4909-afc4-69b83e4b18a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d062625964248e9837faaf1e6890c10)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:09.982032 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: WARNING py.warnings [None req-529bf549-7639-4909-afc4-69b83e4b18a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 12:09:09.982032 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: warnings.warn(msg) May 19 12:09:09.982032 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: May 19 12:09:09.990075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bf549-7639-4909-afc4-69b83e4b18a7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:10.014750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:10.076303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 826/1657] 10.222.0.73 () {58 vars in 1057 bytes} [Thu May 19 12:09:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:10.093026 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9241a0-0c1d-4e1d-8684-66c926ba017a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:10.116124 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9241a0-0c1d-4e1d-8684-66c926ba017a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:10.117740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-529bf549-7639-4909-afc4-69b83e4b18a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d062625964248e9837faaf1e6890c10', 'request_id': 'req-529bf549-7639-4909-afc4-69b83e4b18a7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:10.133413 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-529bf549-7639-4909-afc4-69b83e4b18a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d062625964248e9837faaf1e6890c10', 'request_id': 'req-529bf549-7639-4909-afc4-69b83e4b18a7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:10.173616 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-529bf549-7639-4909-afc4-69b83e4b18a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d062625964248e9837faaf1e6890c10', 'request_id': 'req-529bf549-7639-4909-afc4-69b83e4b18a7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:10.193966 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-529bf549-7639-4909-afc4-69b83e4b18a7 admin admin] The token cache is being invalidate because project 1d062625964248e9837faaf1e6890c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:10.194295 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-529bf549-7639-4909-afc4-69b83e4b18a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:10.196474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-529bf549-7639-4909-afc4-69b83e4b18a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:10.201551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 832/1658] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:09 2022] DELETE /identity/v3/projects/1d062625964248e9837faaf1e6890c10 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:10.207301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bf549-7639-4909-afc4-69b83e4b18a7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:10.210944 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-529bf549-7639-4909-afc4-69b83e4b18a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:10.253742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:10.306019 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8229d2-bd75-4146-86d7-3f5a8054ef5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cccb366fc6429e9a30d4f9de64e8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:10.306458 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8229d2-bd75-4146-86d7-3f5a8054ef5b service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:10.308366 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8229d2-bd75-4146-86d7-3f5a8054ef5b service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:10.308657 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8229d2-bd75-4146-86d7-3f5a8054ef5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:10.311350 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ed8229d2-bd75-4146-86d7-3f5a8054ef5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:10.328238 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bf549-7639-4909-afc4-69b83e4b18a7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:10.335725 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8229d2-bd75-4146-86d7-3f5a8054ef5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:10.337513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a992e76-23f4-46c1-8d87-9dec78a556fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:10.338624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a992e76-23f4-46c1-8d87-9dec78a556fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:10.338922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a992e76-23f4-46c1-8d87-9dec78a556fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:10.339044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8229d2-bd75-4146-86d7-3f5a8054ef5b service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:10.339200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a992e76-23f4-46c1-8d87-9dec78a556fe admin admin] PATH_INFO: `/v3/users/4d6e79df3d1b4de2bed2ebd9de86c513` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:10.340665 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a992e76-23f4-46c1-8d87-9dec78a556fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6e79df3d1b4de2bed2ebd9de86c513)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:10.345345 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a992e76-23f4-46c1-8d87-9dec78a556fe admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:10.366955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 827/1659] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:10.367877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8229d2-bd75-4146-86d7-3f5a8054ef5b service placement] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:10.371192 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ed8229d2-bd75-4146-86d7-3f5a8054ef5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:10.406781 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8229d2-bd75-4146-86d7-3f5a8054ef5b service placement] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:10.416667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a66c0-1b3c-4013-a65f-b1d9937bc4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:10.418779 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a66c0-1b3c-4013-a65f-b1d9937bc4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:10.418779 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a66c0-1b3c-4013-a65f-b1d9937bc4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:10.419039 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a66c0-1b3c-4013-a65f-b1d9937bc4c2 admin admin] PATH_INFO: `/v3/projects/dc10c67b949e4e91a5add7996094f3db` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:10.421092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a66c0-1b3c-4013-a65f-b1d9937bc4c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc10c67b949e4e91a5add7996094f3db)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:10.424771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a66c0-1b3c-4013-a65f-b1d9937bc4c2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:10.459828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6a992e76-23f4-46c1-8d87-9dec78a556fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6e79df3d1b4de2bed2ebd9de86c513'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:10.462924 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6a992e76-23f4-46c1-8d87-9dec78a556fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6e79df3d1b4de2bed2ebd9de86c513'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:10.485839 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6a992e76-23f4-46c1-8d87-9dec78a556fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6e79df3d1b4de2bed2ebd9de86c513'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:10.508604 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6a992e76-23f4-46c1-8d87-9dec78a556fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6e79df3d1b4de2bed2ebd9de86c513'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:10.548385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6a992e76-23f4-46c1-8d87-9dec78a556fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6e79df3d1b4de2bed2ebd9de86c513'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:10.564897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 833/1660] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:10 2022] DELETE /identity/v3/users/4d6e79df3d1b4de2bed2ebd9de86c513 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:09:10.574798 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915e97e-e67a-4858-bdb8-0e02ce4c8022 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:10.575101 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915e97e-e67a-4858-bdb8-0e02ce4c8022 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:10.575834 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915e97e-e67a-4858-bdb8-0e02ce4c8022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:10.600040 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5a7a66c0-1b3c-4013-a65f-b1d9937bc4c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc10c67b949e4e91a5add7996094f3db', 'request_id': 'req-5a7a66c0-1b3c-4013-a65f-b1d9937bc4c2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:10.616581 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5a7a66c0-1b3c-4013-a65f-b1d9937bc4c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc10c67b949e4e91a5add7996094f3db', 'request_id': 'req-5a7a66c0-1b3c-4013-a65f-b1d9937bc4c2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:10.642623 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5a7a66c0-1b3c-4013-a65f-b1d9937bc4c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc10c67b949e4e91a5add7996094f3db', 'request_id': 'req-5a7a66c0-1b3c-4013-a65f-b1d9937bc4c2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:10.711094 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c915e97e-e67a-4858-bdb8-0e02ce4c8022 None None] MFA Rules not processed for user `78de8b3155bf4181a27f9395030c1f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:10.711765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5a7a66c0-1b3c-4013-a65f-b1d9937bc4c2 admin admin] The token cache is being invalidate because project dc10c67b949e4e91a5add7996094f3db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:10.712635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c915e97e-e67a-4858-bdb8-0e02ce4c8022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:10.719133 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5a7a66c0-1b3c-4013-a65f-b1d9937bc4c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:10.721158 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5a7a66c0-1b3c-4013-a65f-b1d9937bc4c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:10.731296 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 828/1661] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:10 2022] DELETE /identity/v3/projects/dc10c67b949e4e91a5add7996094f3db => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:10.733604 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34894f-1650-416a-ab39-3d53905d02eb None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:10.733901 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34894f-1650-416a-ab39-3d53905d02eb None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:10.734180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34894f-1650-416a-ab39-3d53905d02eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:10.740387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:10.808991 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3f34894f-1650-416a-ab39-3d53905d02eb None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:10.810236 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3f34894f-1650-416a-ab39-3d53905d02eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:11.003008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 834/1662] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:11.010756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2dec0-dbb9-4535-8ebb-babd65e89445 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:11.011060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2dec0-dbb9-4535-8ebb-babd65e89445 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:11.011622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2dec0-dbb9-4535-8ebb-babd65e89445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:11.046370 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 829/1663] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:11.048849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1da73-16ff-49e9-b1b6-d162d93c1206 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:11.049118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4fd2dec0-dbb9-4535-8ebb-babd65e89445 None None] MFA Rules not processed for user `78de8b3155bf4181a27f9395030c1f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:11.049224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1da73-16ff-49e9-b1b6-d162d93c1206 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:11.049450 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1da73-16ff-49e9-b1b6-d162d93c1206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:11.050457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4fd2dec0-dbb9-4535-8ebb-babd65e89445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:11.073876 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 835/1664] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:11.084837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2dec0-dbb9-4535-8ebb-babd65e89445 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:11.086847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4fd2dec0-dbb9-4535-8ebb-babd65e89445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:11.129595 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-58e1da73-16ff-49e9-b1b6-d162d93c1206 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:11.131116 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-58e1da73-16ff-49e9-b1b6-d162d93c1206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:11.168140 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 830/1665] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:11.176179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1da73-16ff-49e9-b1b6-d162d93c1206 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:11.211729 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1da73-16ff-49e9-b1b6-d162d93c1206 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:11.242048 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2dec0-dbb9-4535-8ebb-babd65e89445 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:11.246528 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b516240-999f-45bf-bfa2-3c0e152b0fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:11.247433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516240-999f-45bf-bfa2-3c0e152b0fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:11.248113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516240-999f-45bf-bfa2-3c0e152b0fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:11.248536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516240-999f-45bf-bfa2-3c0e152b0fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:11.249423 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b516240-999f-45bf-bfa2-3c0e152b0fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:11.249866 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b516240-999f-45bf-bfa2-3c0e152b0fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:11.251874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b516240-999f-45bf-bfa2-3c0e152b0fa2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:11.256483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbcf7c-f110-42f4-9027-52670a30fc2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:11.257166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbcf7c-f110-42f4-9027-52670a30fc2b service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:11.257454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbcf7c-f110-42f4-9027-52670a30fc2b service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:11.257721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbcf7c-f110-42f4-9027-52670a30fc2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:11.283887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 831/1666] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:11.285310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b516240-999f-45bf-bfa2-3c0e152b0fa2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:11.288731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbcf7c-f110-42f4-9027-52670a30fc2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:11.290610 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbcf7c-f110-42f4-9027-52670a30fc2b service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:11.313593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b516240-999f-45bf-bfa2-3c0e152b0fa2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:11.325780 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 836/1667] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:09:11.333491 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3c06c-79fc-4f74-b67e-8a80dc8f09ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:11.334946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3c06c-79fc-4f74-b67e-8a80dc8f09ea admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:11.335381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3c06c-79fc-4f74-b67e-8a80dc8f09ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:11.335806 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3c06c-79fc-4f74-b67e-8a80dc8f09ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:11.336690 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3c06c-79fc-4f74-b67e-8a80dc8f09ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:11.339780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3c06c-79fc-4f74-b67e-8a80dc8f09ea admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:11.433804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 832/1668] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:11 2022] POST /identity/v3/projects => generated 369 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:11.434917 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbcf7c-f110-42f4-9027-52670a30fc2b service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:11.461235 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbcf7c-f110-42f4-9027-52670a30fc2b service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:11.591155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8148fa8-84c7-406b-86b3-1dd86ea7c350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:11.591857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8148fa8-84c7-406b-86b3-1dd86ea7c350 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:11.592349 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8148fa8-84c7-406b-86b3-1dd86ea7c350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:11.592879 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8148fa8-84c7-406b-86b3-1dd86ea7c350 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:11.593590 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8148fa8-84c7-406b-86b3-1dd86ea7c350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:11.596703 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8148fa8-84c7-406b-86b3-1dd86ea7c350 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:11.653721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 837/1669] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:11 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:09:11.657416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3c06c-79fc-4f74-b67e-8a80dc8f09ea admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:11.671539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3c06c-79fc-4f74-b67e-8a80dc8f09ea admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:11.682664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f0685-e3f0-4562-879f-978ae70237cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:11.685167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f0685-e3f0-4562-879f-978ae70237cf admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:11.686195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f0685-e3f0-4562-879f-978ae70237cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:11.687254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f0685-e3f0-4562-879f-978ae70237cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:11.690271 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f0685-e3f0-4562-879f-978ae70237cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:11.696786 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f0685-e3f0-4562-879f-978ae70237cf admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:11.724464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 833/1670] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:11.729077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8148fa8-84c7-406b-86b3-1dd86ea7c350 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:11.760035 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8148fa8-84c7-406b-86b3-1dd86ea7c350 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:11.776190 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981b5fc-1c6d-40b4-9802-5ca16d24ebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:11.777568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b5fc-1c6d-40b4-9802-5ca16d24ebd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:11.777568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b5fc-1c6d-40b4-9802-5ca16d24ebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:11.777941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b5fc-1c6d-40b4-9802-5ca16d24ebd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:11.778780 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981b5fc-1c6d-40b4-9802-5ca16d24ebd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:11.789429 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981b5fc-1c6d-40b4-9802-5ca16d24ebd2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:11.814957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 838/1671] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:11.816219 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f0685-e3f0-4562-879f-978ae70237cf admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:11.842038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f0685-e3f0-4562-879f-978ae70237cf admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:11.857968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6aa6e6-47a8-4b04-8a32-105e70b7abda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:11.859063 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aa6e6-47a8-4b04-8a32-105e70b7abda admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:11.859515 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aa6e6-47a8-4b04-8a32-105e70b7abda admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:11.860120 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aa6e6-47a8-4b04-8a32-105e70b7abda admin admin] PATH_INFO: `/v3/projects/935a1552f46d411ba42c973634af2cc8/users/7243c90de66d4f11bbe9f2854b00fb82/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:11.871905 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:11.905022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6aa6e6-47a8-4b04-8a32-105e70b7abda admin admin] RBAC: Authorizing `identity:create_grant(project_id=935a1552f46d411ba42c973634af2cc8, user_id=7243c90de66d4f11bbe9f2854b00fb82, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:11.908127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6aa6e6-47a8-4b04-8a32-105e70b7abda admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:11.941594 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 834/1672] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:11 2022] PUT /identity/v3/projects/935a1552f46d411ba42c973634af2cc8/users/7243c90de66d4f11bbe9f2854b00fb82/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:11.953043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e653eb-d6e4-44e2-9986-81ea82dd8a3e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:11.954323 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e653eb-d6e4-44e2-9986-81ea82dd8a3e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:11.954323 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e653eb-d6e4-44e2-9986-81ea82dd8a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:11.967671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:11.995071 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a0e653eb-d6e4-44e2-9986-81ea82dd8a3e None None] MFA Rules not processed for user `7243c90de66d4f11bbe9f2854b00fb82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:11.996611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a0e653eb-d6e4-44e2-9986-81ea82dd8a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:12.128963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6aa6e6-47a8-4b04-8a32-105e70b7abda admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:12.131895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 839/1673] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:12.258374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6aa6e6-47a8-4b04-8a32-105e70b7abda admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:12.265300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d1858-7b0a-4f1a-8e7c-c91bf7a969b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:12.266787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d1858-7b0a-4f1a-8e7c-c91bf7a969b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:12.267216 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d1858-7b0a-4f1a-8e7c-c91bf7a969b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:12.267714 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d1858-7b0a-4f1a-8e7c-c91bf7a969b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:12.268646 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d1858-7b0a-4f1a-8e7c-c91bf7a969b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:12.271019 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d1858-7b0a-4f1a-8e7c-c91bf7a969b6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:12.329762 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 835/1674] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:12 2022] POST /identity/v3/projects => generated 367 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:12.333714 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e653eb-d6e4-44e2-9986-81ea82dd8a3e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:12.354308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e653eb-d6e4-44e2-9986-81ea82dd8a3e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:12.494086 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49c9ad-5f63-4612-9c80-3fa627fb69a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:12.496718 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49c9ad-5f63-4612-9c80-3fa627fb69a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:12.498589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d1858-7b0a-4f1a-8e7c-c91bf7a969b6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:12.500792 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a67d1858-7b0a-4f1a-8e7c-c91bf7a969b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:12.506474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49c9ad-5f63-4612-9c80-3fa627fb69a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:12.510033 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49c9ad-5f63-4612-9c80-3fa627fb69a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:12.511144 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49c9ad-5f63-4612-9c80-3fa627fb69a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:12.517880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49c9ad-5f63-4612-9c80-3fa627fb69a9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:12.526602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d1858-7b0a-4f1a-8e7c-c91bf7a969b6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:12.538777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03dc1a9-cca6-4b64-91e1-a62b25104118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:12.541501 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dc1a9-cca6-4b64-91e1-a62b25104118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:12.541871 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dc1a9-cca6-4b64-91e1-a62b25104118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:12.543675 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dc1a9-cca6-4b64-91e1-a62b25104118 admin admin] PATH_INFO: `/v3/projects/9ece571b0c364973b1b6c78762daf760` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:12.548476 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03dc1a9-cca6-4b64-91e1-a62b25104118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ece571b0c364973b1b6c78762daf760)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:12.551151 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03dc1a9-cca6-4b64-91e1-a62b25104118 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:12.565364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 840/1675] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:12 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:12.569057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49c9ad-5f63-4612-9c80-3fa627fb69a9 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:12.593547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49c9ad-5f63-4612-9c80-3fa627fb69a9 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:12.605563 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163973c-0096-4a28-816d-ed7402263853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:12.606411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163973c-0096-4a28-816d-ed7402263853 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:12.607088 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163973c-0096-4a28-816d-ed7402263853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:12.608572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163973c-0096-4a28-816d-ed7402263853 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:12.610044 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163973c-0096-4a28-816d-ed7402263853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:12.613375 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163973c-0096-4a28-816d-ed7402263853 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:12.638714 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 841/1676] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:12.641371 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163973c-0096-4a28-816d-ed7402263853 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:12.668679 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f03dc1a9-cca6-4b64-91e1-a62b25104118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ece571b0c364973b1b6c78762daf760', 'request_id': 'req-f03dc1a9-cca6-4b64-91e1-a62b25104118'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:12.672200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163973c-0096-4a28-816d-ed7402263853 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:12.678877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f03dc1a9-cca6-4b64-91e1-a62b25104118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ece571b0c364973b1b6c78762daf760', 'request_id': 'req-f03dc1a9-cca6-4b64-91e1-a62b25104118'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:12.699540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f03dc1a9-cca6-4b64-91e1-a62b25104118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ece571b0c364973b1b6c78762daf760', 'request_id': 'req-f03dc1a9-cca6-4b64-91e1-a62b25104118'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:12.718770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f03dc1a9-cca6-4b64-91e1-a62b25104118 admin admin] The token cache is being invalidate because project 9ece571b0c364973b1b6c78762daf760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:12.719449 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f03dc1a9-cca6-4b64-91e1-a62b25104118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:12.722305 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f03dc1a9-cca6-4b64-91e1-a62b25104118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:12.726975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 836/1677] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:12 2022] DELETE /identity/v3/projects/9ece571b0c364973b1b6c78762daf760 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:09:12.729049 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f482587-b1d7-4c27-8f2b-40ac818a6274 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:12.730516 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f482587-b1d7-4c27-8f2b-40ac818a6274 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:12.731902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f482587-b1d7-4c27-8f2b-40ac818a6274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:12.772772 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747a798-bc98-4177-8e47-3da32abd8e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:12.773694 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747a798-bc98-4177-8e47-3da32abd8e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:12.773975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747a798-bc98-4177-8e47-3da32abd8e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:12.774252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747a798-bc98-4177-8e47-3da32abd8e2f admin admin] PATH_INFO: `/v3/projects/ab7fff4f8fc24493a4ba0010c071b8b7/users/5fd4acfbe4b747b6bb1ba2baae7be57b/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:12.802072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9f482587-b1d7-4c27-8f2b-40ac818a6274 None None] MFA Rules not processed for user `f9964e2d7ecd453dbae3851cad81c5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:12.806280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9f482587-b1d7-4c27-8f2b-40ac818a6274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:12.811435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747a798-bc98-4177-8e47-3da32abd8e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7fff4f8fc24493a4ba0010c071b8b7, user_id=5fd4acfbe4b747b6bb1ba2baae7be57b, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:12.821968 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747a798-bc98-4177-8e47-3da32abd8e2f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:12.845200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:12.871255 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 842/1678] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:12 2022] PUT /identity/v3/projects/ab7fff4f8fc24493a4ba0010c071b8b7/users/5fd4acfbe4b747b6bb1ba2baae7be57b/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:12.873907 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb335b-e10c-4e78-8bb0-fcd36d4db3ff None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:12.874205 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb335b-e10c-4e78-8bb0-fcd36d4db3ff None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:12.874424 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb335b-e10c-4e78-8bb0-fcd36d4db3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:12.941112 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-34eb335b-e10c-4e78-8bb0-fcd36d4db3ff None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:12.942928 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-34eb335b-e10c-4e78-8bb0-fcd36d4db3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:12.966908 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:13.066864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 837/1679] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:12 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:13.067852 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f482587-b1d7-4c27-8f2b-40ac818a6274 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:13.071588 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9f482587-b1d7-4c27-8f2b-40ac818a6274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:13.108169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f482587-b1d7-4c27-8f2b-40ac818a6274 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:13.137094 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 843/1680] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:13.140707 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96abd2-0589-4abd-8612-9d72d0fe1996 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:13.143132 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96abd2-0589-4abd-8612-9d72d0fe1996 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:13.145560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96abd2-0589-4abd-8612-9d72d0fe1996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:13.205197 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3a96abd2-0589-4abd-8612-9d72d0fe1996 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:13.206686 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3a96abd2-0589-4abd-8612-9d72d0fe1996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:13.226611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 844/1681] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:13.231640 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96abd2-0589-4abd-8612-9d72d0fe1996 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:13.244494 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bf3e2-0df8-4e1f-911d-fff6cb900c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:13.245298 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bf3e2-0df8-4e1f-911d-fff6cb900c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:13.245751 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bf3e2-0df8-4e1f-911d-fff6cb900c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:13.246133 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bf3e2-0df8-4e1f-911d-fff6cb900c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:13.247681 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3bf3e2-0df8-4e1f-911d-fff6cb900c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:13.253084 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3bf3e2-0df8-4e1f-911d-fff6cb900c8d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:13.261812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96abd2-0589-4abd-8612-9d72d0fe1996 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:13.267643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21ac0a-5089-40fa-a3af-89c73beed54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:13.268888 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21ac0a-5089-40fa-a3af-89c73beed54c admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:13.269436 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21ac0a-5089-40fa-a3af-89c73beed54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:13.270019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21ac0a-5089-40fa-a3af-89c73beed54c admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:13.270978 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21ac0a-5089-40fa-a3af-89c73beed54c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:13.271514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21ac0a-5089-40fa-a3af-89c73beed54c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:13.273512 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21ac0a-5089-40fa-a3af-89c73beed54c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:13.279697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 838/1682] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:13.282891 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bf3e2-0df8-4e1f-911d-fff6cb900c8d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:13.292180 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 845/1683] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:13.298705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21ac0a-5089-40fa-a3af-89c73beed54c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:13.322673 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21ac0a-5089-40fa-a3af-89c73beed54c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:13.337010 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c357cf-37ef-4a9d-bd89-fe60c162df49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:13.337712 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c357cf-37ef-4a9d-bd89-fe60c162df49 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:13.338007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c357cf-37ef-4a9d-bd89-fe60c162df49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:13.338289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c357cf-37ef-4a9d-bd89-fe60c162df49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:13.339081 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c357cf-37ef-4a9d-bd89-fe60c162df49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:13.342574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c357cf-37ef-4a9d-bd89-fe60c162df49 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:13.355841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bf3e2-0df8-4e1f-911d-fff6cb900c8d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:13.368633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa390bba-8446-4ec5-9725-902faa32d36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:13.371081 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa390bba-8446-4ec5-9725-902faa32d36b admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:13.371371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa390bba-8446-4ec5-9725-902faa32d36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:13.371655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa390bba-8446-4ec5-9725-902faa32d36b admin admin] PATH_INFO: `/v3/projects/ab7fff4f8fc24493a4ba0010c071b8b7/users/5fd4acfbe4b747b6bb1ba2baae7be57b/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:13.385848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa390bba-8446-4ec5-9725-902faa32d36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7fff4f8fc24493a4ba0010c071b8b7, user_id=5fd4acfbe4b747b6bb1ba2baae7be57b, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:13.394969 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa390bba-8446-4ec5-9725-902faa32d36b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:13.399428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 846/1684] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:13 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:09:13.405755 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c357cf-37ef-4a9d-bd89-fe60c162df49 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:13.455153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 839/1685] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:13 2022] PUT /identity/v3/projects/ab7fff4f8fc24493a4ba0010c071b8b7/users/5fd4acfbe4b747b6bb1ba2baae7be57b/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:13.459008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fe24e-4823-4c05-a946-516e5aea3d6c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:13.459331 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fe24e-4823-4c05-a946-516e5aea3d6c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:13.459764 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fe24e-4823-4c05-a946-516e5aea3d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:13.559784 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6d7fe24e-4823-4c05-a946-516e5aea3d6c None None] MFA Rules not processed for user `5fd4acfbe4b747b6bb1ba2baae7be57b`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:13.561145 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6d7fe24e-4823-4c05-a946-516e5aea3d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:13.651334 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c357cf-37ef-4a9d-bd89-fe60c162df49 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:13.784113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 840/1686] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:13 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:13.786162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c133bc-449b-4400-8db3-941c66b00088 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:13.786467 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c133bc-449b-4400-8db3-941c66b00088 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:13.786750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c133bc-449b-4400-8db3-941c66b00088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:13.850632 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ae605-4b2b-4483-9cec-47afbf9da49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:13.851360 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ae605-4b2b-4483-9cec-47afbf9da49a admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:13.851743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ae605-4b2b-4483-9cec-47afbf9da49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:13.852079 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ae605-4b2b-4483-9cec-47afbf9da49a admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:13.852780 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ae605-4b2b-4483-9cec-47afbf9da49a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:13.856935 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ae605-4b2b-4483-9cec-47afbf9da49a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:13.865098 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-13c133bc-449b-4400-8db3-941c66b00088 None None] MFA Rules not processed for user `78de8b3155bf4181a27f9395030c1f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:13.868419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-13c133bc-449b-4400-8db3-941c66b00088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:13.879002 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:13.923057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 847/1687] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:13 2022] POST /identity/v3/users => generated 293 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:13.926865 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ae605-4b2b-4483-9cec-47afbf9da49a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:13.949608 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-473ae605-4b2b-4483-9cec-47afbf9da49a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:14.010369 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:14.056442 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 841/1688] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:14.059962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c133bc-449b-4400-8db3-941c66b00088 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:14.087260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c133bc-449b-4400-8db3-941c66b00088 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:14.100520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c001d-1e8c-4384-bde4-2f44fb84d54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:14.103620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c001d-1e8c-4384-bde4-2f44fb84d54a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:14.106530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c001d-1e8c-4384-bde4-2f44fb84d54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:14.106922 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c001d-1e8c-4384-bde4-2f44fb84d54a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:14.107791 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c001d-1e8c-4384-bde4-2f44fb84d54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:14.115528 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c001d-1e8c-4384-bde4-2f44fb84d54a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:14.121130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ae605-4b2b-4483-9cec-47afbf9da49a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:14.132899 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b34380-6cec-4ae8-8ebc-073896ef89b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:14.133742 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b34380-6cec-4ae8-8ebc-073896ef89b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:14.134063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b34380-6cec-4ae8-8ebc-073896ef89b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:14.134723 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b34380-6cec-4ae8-8ebc-073896ef89b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:14.144310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 842/1689] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:14.149585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c001d-1e8c-4384-bde4-2f44fb84d54a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:14.160709 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b34380-6cec-4ae8-8ebc-073896ef89b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:14.162455 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b34380-6cec-4ae8-8ebc-073896ef89b1 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:14.178371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c001d-1e8c-4384-bde4-2f44fb84d54a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:14.223151 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a3b3a-c0d9-41ba-8a09-e70c9f833ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:14.223882 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a3b3a-c0d9-41ba-8a09-e70c9f833ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:14.224332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a3b3a-c0d9-41ba-8a09-e70c9f833ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:14.224620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a3b3a-c0d9-41ba-8a09-e70c9f833ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:14.225468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a3b3a-c0d9-41ba-8a09-e70c9f833ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:14.225819 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 848/1690] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:13 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:14.231198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a3b3a-c0d9-41ba-8a09-e70c9f833ca2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:14.281224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 843/1691] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:14.284803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b34380-6cec-4ae8-8ebc-073896ef89b1 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:14.301882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b34380-6cec-4ae8-8ebc-073896ef89b1 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:14.309614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc1061-3c93-4a0f-a0cb-9f07fda0ead3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:14.310661 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc1061-3c93-4a0f-a0cb-9f07fda0ead3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:14.311023 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc1061-3c93-4a0f-a0cb-9f07fda0ead3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:14.311359 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc1061-3c93-4a0f-a0cb-9f07fda0ead3 admin admin] PATH_INFO: `/v3/projects/dbfe2a2d9cbe4c9091c9f44db24eea22/users/51425c4d0ec94dc6be9cc37695151350/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:14.362667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a3b3a-c0d9-41ba-8a09-e70c9f833ca2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:14.365222 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-959a3b3a-c0d9-41ba-8a09-e70c9f833ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:14.390168 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc1061-3c93-4a0f-a0cb-9f07fda0ead3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfe2a2d9cbe4c9091c9f44db24eea22, user_id=51425c4d0ec94dc6be9cc37695151350, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:14.396947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc1061-3c93-4a0f-a0cb-9f07fda0ead3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:14.404175 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a3b3a-c0d9-41ba-8a09-e70c9f833ca2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:14.415566 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810738c1-19b5-4239-9b95-f6847107651e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:14.416547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810738c1-19b5-4239-9b95-f6847107651e service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:14.416963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810738c1-19b5-4239-9b95-f6847107651e service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:14.417250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810738c1-19b5-4239-9b95-f6847107651e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:14.424314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-810738c1-19b5-4239-9b95-f6847107651e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:14.441343 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 849/1692] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:14 2022] PUT /identity/v3/projects/dbfe2a2d9cbe4c9091c9f44db24eea22/users/51425c4d0ec94dc6be9cc37695151350/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:14.442968 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1d15e-d073-4057-8ab5-d94a04daf53b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:14.443265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1d15e-d073-4057-8ab5-d94a04daf53b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:14.443548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1d15e-d073-4057-8ab5-d94a04daf53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:14.491468 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-27f1d15e-d073-4057-8ab5-d94a04daf53b None None] MFA Rules not processed for user `51425c4d0ec94dc6be9cc37695151350`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:14.493095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-27f1d15e-d073-4057-8ab5-d94a04daf53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:14.560134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810738c1-19b5-4239-9b95-f6847107651e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:14.564151 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810738c1-19b5-4239-9b95-f6847107651e service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:14.585072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 844/1693] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:14.599005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 850/1694] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:14.601499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810738c1-19b5-4239-9b95-f6847107651e service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:14.631138 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810738c1-19b5-4239-9b95-f6847107651e service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:14.858634 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0965c-ea22-460a-8591-a6c6e6cd70f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:14.859552 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0965c-ea22-460a-8591-a6c6e6cd70f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:14.859676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0965c-ea22-460a-8591-a6c6e6cd70f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:14.859905 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0965c-ea22-460a-8591-a6c6e6cd70f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:14.860626 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0965c-ea22-460a-8591-a6c6e6cd70f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:14.865301 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0965c-ea22-460a-8591-a6c6e6cd70f9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:14.950782 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 845/1695] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:14 2022] POST /identity/v3/projects => generated 385 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:14.956204 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1d15e-d073-4057-8ab5-d94a04daf53b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:14.992075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1d15e-d073-4057-8ab5-d94a04daf53b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:15.228390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d0311-01b2-442c-bab0-67d652bc1979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:15.229085 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d0311-01b2-442c-bab0-67d652bc1979 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:15.229387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d0311-01b2-442c-bab0-67d652bc1979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:15.229909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d0311-01b2-442c-bab0-67d652bc1979 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:15.230678 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d0311-01b2-442c-bab0-67d652bc1979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:15.232887 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d0311-01b2-442c-bab0-67d652bc1979 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:15.242149 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:15.266977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 851/1696] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:14 2022] POST /identity/v3/users => generated 299 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:15.271280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0965c-ea22-460a-8591-a6c6e6cd70f9 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:15.292478 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0965c-ea22-460a-8591-a6c6e6cd70f9 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:15.311335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543224d4-3335-46fb-8eb7-ab16db87ef8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:15.312252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543224d4-3335-46fb-8eb7-ab16db87ef8b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:15.313197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543224d4-3335-46fb-8eb7-ab16db87ef8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:15.318612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543224d4-3335-46fb-8eb7-ab16db87ef8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:15.320824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543224d4-3335-46fb-8eb7-ab16db87ef8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:15.325199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543224d4-3335-46fb-8eb7-ab16db87ef8b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:15.362294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d0311-01b2-442c-bab0-67d652bc1979 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:15.363904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 846/1697] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:15.385125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d0311-01b2-442c-bab0-67d652bc1979 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:15.403154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc1ca9-86fa-400f-b363-4c08a1cdc514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:15.412173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc1ca9-86fa-400f-b363-4c08a1cdc514 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:15.412403 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc1ca9-86fa-400f-b363-4c08a1cdc514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:15.412730 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc1ca9-86fa-400f-b363-4c08a1cdc514 admin admin] PATH_INFO: `/v3/projects/1126a264af2a4035af9087ad4fd13caf/users/b072860c099f4251ab82f1479bfa75e6/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:15.474141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc1ca9-86fa-400f-b363-4c08a1cdc514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1126a264af2a4035af9087ad4fd13caf, user_id=b072860c099f4251ab82f1479bfa75e6, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:15.490063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc1ca9-86fa-400f-b363-4c08a1cdc514 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:15.542409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 852/1698] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:15 2022] PUT /identity/v3/projects/1126a264af2a4035af9087ad4fd13caf/users/b072860c099f4251ab82f1479bfa75e6/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:15.543679 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543224d4-3335-46fb-8eb7-ab16db87ef8b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:15.572644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543224d4-3335-46fb-8eb7-ab16db87ef8b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:15.710697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:15.737303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d84e59-14bd-46ea-90fa-925151f06701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:15.738411 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d84e59-14bd-46ea-90fa-925151f06701 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:15.738887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d84e59-14bd-46ea-90fa-925151f06701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:15.739214 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d84e59-14bd-46ea-90fa-925151f06701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:15.740234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d84e59-14bd-46ea-90fa-925151f06701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:15.741997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d84e59-14bd-46ea-90fa-925151f06701 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:15.761165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 847/1699] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:15.763132 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc1ca9-86fa-400f-b363-4c08a1cdc514 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:15.779747 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc1ca9-86fa-400f-b363-4c08a1cdc514 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:15.790406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873c521-6a1e-486c-9fad-4ac77bfec00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:15.791511 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873c521-6a1e-486c-9fad-4ac77bfec00a admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:15.791796 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873c521-6a1e-486c-9fad-4ac77bfec00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:15.792103 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873c521-6a1e-486c-9fad-4ac77bfec00a admin admin] PATH_INFO: `/v3/projects/1126a264af2a4035af9087ad4fd13caf/users/b072860c099f4251ab82f1479bfa75e6/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:15.794350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873c521-6a1e-486c-9fad-4ac77bfec00a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1126a264af2a4035af9087ad4fd13caf, user_id=b072860c099f4251ab82f1479bfa75e6, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:15.797947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873c521-6a1e-486c-9fad-4ac77bfec00a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:15.818628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f964c3-31b0-4ecc-815f-6cb26721d568 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:15.819173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f964c3-31b0-4ecc-815f-6cb26721d568 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:15.819554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f964c3-31b0-4ecc-815f-6cb26721d568 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:15.821701 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 848/1701] 10.222.0.73 () {54 vars in 912 bytes} [Thu May 19 12:09:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 12:09:15.823020 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 853/1701] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:15 2022] PUT /identity/v3/projects/1126a264af2a4035af9087ad4fd13caf/users/b072860c099f4251ab82f1479bfa75e6/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:15.824734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ca7cc-c8fd-41b8-9af6-3cc59dc191cc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:15.826084 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ca7cc-c8fd-41b8-9af6-3cc59dc191cc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:15.826625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ca7cc-c8fd-41b8-9af6-3cc59dc191cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:15.831135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab0d78-e1d4-40d9-bc4e-46943948da90 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:15.831514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab0d78-e1d4-40d9-bc4e-46943948da90 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:15.831794 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab0d78-e1d4-40d9-bc4e-46943948da90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:15.859392 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f2ab0d78-e1d4-40d9-bc4e-46943948da90 None None] MFA Rules not processed for user `4897919923a64881ac5540cc5d58df1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:15.861379 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f2ab0d78-e1d4-40d9-bc4e-46943948da90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:15.866469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d76ca7cc-c8fd-41b8-9af6-3cc59dc191cc None None] MFA Rules not processed for user `b072860c099f4251ab82f1479bfa75e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:15.868939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d76ca7cc-c8fd-41b8-9af6-3cc59dc191cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:16.002934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 854/1702] 10.222.0.73 () {58 vars in 1009 bytes} [Thu May 19 12:09:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:16.042016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab0d78-e1d4-40d9-bc4e-46943948da90 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:16.046581 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f2ab0d78-e1d4-40d9-bc4e-46943948da90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:16.068119 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 849/1703] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:16.082301 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ca7cc-c8fd-41b8-9af6-3cc59dc191cc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:16.083757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab0d78-e1d4-40d9-bc4e-46943948da90 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:16.092859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d79d8-fcc3-4735-8006-3f78827a8986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:16.093745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d79d8-fcc3-4735-8006-3f78827a8986 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:16.094220 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d79d8-fcc3-4735-8006-3f78827a8986 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:16.094698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d79d8-fcc3-4735-8006-3f78827a8986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:16.111624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d79d8-fcc3-4735-8006-3f78827a8986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:16.114249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d79d8-fcc3-4735-8006-3f78827a8986 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:16.149499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 855/1704] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:16.337778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ca7cc-c8fd-41b8-9af6-3cc59dc191cc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:16.349385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32ad5e-6ffa-4846-92a4-4916a0aed49b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:16.351072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32ad5e-6ffa-4846-92a4-4916a0aed49b service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:16.351505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32ad5e-6ffa-4846-92a4-4916a0aed49b service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:16.352579 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32ad5e-6ffa-4846-92a4-4916a0aed49b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:16.389508 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32ad5e-6ffa-4846-92a4-4916a0aed49b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:16.390109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32ad5e-6ffa-4846-92a4-4916a0aed49b service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:16.439406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 850/1705] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:16.576654 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d79d8-fcc3-4735-8006-3f78827a8986 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:16.785301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d79d8-fcc3-4735-8006-3f78827a8986 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:16.796372 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e384cb4-65ce-4e33-8aab-82a85f297f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:16.797474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e384cb4-65ce-4e33-8aab-82a85f297f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:16.797803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e384cb4-65ce-4e33-8aab-82a85f297f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:16.798122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e384cb4-65ce-4e33-8aab-82a85f297f53 admin admin] PATH_INFO: `/v3/users/51425c4d0ec94dc6be9cc37695151350` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:16.800958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e384cb4-65ce-4e33-8aab-82a85f297f53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51425c4d0ec94dc6be9cc37695151350)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:16.805539 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e384cb4-65ce-4e33-8aab-82a85f297f53 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:16.856491 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d66dd-bd71-4c3f-8970-6bfc847f9823 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:16.856828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d66dd-bd71-4c3f-8970-6bfc847f9823 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:16.857417 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d66dd-bd71-4c3f-8970-6bfc847f9823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:16.947204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-014d66dd-bd71-4c3f-8970-6bfc847f9823 None None] MFA Rules not processed for user `dd29391d48434f67894eb8efcec99012`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:16.948969 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-014d66dd-bd71-4c3f-8970-6bfc847f9823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:16.962945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3e384cb4-65ce-4e33-8aab-82a85f297f53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51425c4d0ec94dc6be9cc37695151350'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:16.964506 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3e384cb4-65ce-4e33-8aab-82a85f297f53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51425c4d0ec94dc6be9cc37695151350'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:16.979859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:16.990852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3e384cb4-65ce-4e33-8aab-82a85f297f53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51425c4d0ec94dc6be9cc37695151350'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:17.021261 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3e384cb4-65ce-4e33-8aab-82a85f297f53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51425c4d0ec94dc6be9cc37695151350'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:17.059339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3e384cb4-65ce-4e33-8aab-82a85f297f53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51425c4d0ec94dc6be9cc37695151350'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:17.095428 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 856/1706] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:16 2022] DELETE /identity/v3/users/51425c4d0ec94dc6be9cc37695151350 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:17.100951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5506f0-5535-4614-a152-456f71d754a3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:17.101293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5506f0-5535-4614-a152-456f71d754a3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:17.101774 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5506f0-5535-4614-a152-456f71d754a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:17.144014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1b5506f0-5535-4614-a152-456f71d754a3 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:17.149883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:17.150341 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1b5506f0-5535-4614-a152-456f71d754a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:17.179039 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 851/1707] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:09:17.183372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24061-93a9-4c15-9970-2aea2dddebbd None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:17.183668 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24061-93a9-4c15-9970-2aea2dddebbd None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:17.184241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24061-93a9-4c15-9970-2aea2dddebbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:17.230867 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d2d24061-93a9-4c15-9970-2aea2dddebbd None None] MFA Rules not processed for user `b6c5da324ab2405a84036db91a1366a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:17.233706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d2d24061-93a9-4c15-9970-2aea2dddebbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:17.281233 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 857/1708] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:09:17.323593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5506f0-5535-4614-a152-456f71d754a3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:17.325495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1b5506f0-5535-4614-a152-456f71d754a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:17.406363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 852/1709] 10.222.0.73 () {58 vars in 1009 bytes} [Thu May 19 12:09:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:17.408270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d24061-93a9-4c15-9970-2aea2dddebbd None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:17.410069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d2d24061-93a9-4c15-9970-2aea2dddebbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:17.532131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5506f0-5535-4614-a152-456f71d754a3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:17.542675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f225-fed2-4e83-979c-3a240afea5e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:17.546172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f225-fed2-4e83-979c-3a240afea5e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:17.546484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f225-fed2-4e83-979c-3a240afea5e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:17.547414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f225-fed2-4e83-979c-3a240afea5e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:17.598905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815f225-fed2-4e83-979c-3a240afea5e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:17.605338 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815f225-fed2-4e83-979c-3a240afea5e6 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:17.647951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 858/1710] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:17.650616 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f225-fed2-4e83-979c-3a240afea5e6 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:17.653133 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a815f225-fed2-4e83-979c-3a240afea5e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:17.661467 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d24061-93a9-4c15-9970-2aea2dddebbd None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:17.687295 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f225-fed2-4e83-979c-3a240afea5e6 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:17.693906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81ea5f-ca0c-4269-a824-91cacb39dfb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:17.694592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81ea5f-ca0c-4269-a824-91cacb39dfb9 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:17.694878 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81ea5f-ca0c-4269-a824-91cacb39dfb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:17.695497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81ea5f-ca0c-4269-a824-91cacb39dfb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:17.711176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc5f73-cab0-48f4-8366-47909311cf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:17.712355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc5f73-cab0-48f4-8366-47909311cf5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:17.712682 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc5f73-cab0-48f4-8366-47909311cf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:17.712931 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc5f73-cab0-48f4-8366-47909311cf5c admin admin] PATH_INFO: `/v3/users/7fe7faa84d8847a6a11e9ae379e4b15d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:17.714441 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc5f73-cab0-48f4-8366-47909311cf5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe7faa84d8847a6a11e9ae379e4b15d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:17.716277 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc5f73-cab0-48f4-8366-47909311cf5c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:17.855282 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81ea5f-ca0c-4269-a824-91cacb39dfb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:17.857404 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81ea5f-ca0c-4269-a824-91cacb39dfb9 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:17.870636 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 853/1711] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:17.872121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81ea5f-ca0c-4269-a824-91cacb39dfb9 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:17.875639 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6c81ea5f-ca0c-4269-a824-91cacb39dfb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:17.920417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4fbc5f73-cab0-48f4-8366-47909311cf5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe7faa84d8847a6a11e9ae379e4b15d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:17.922872 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4fbc5f73-cab0-48f4-8366-47909311cf5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe7faa84d8847a6a11e9ae379e4b15d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:17.948408 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4fbc5f73-cab0-48f4-8366-47909311cf5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe7faa84d8847a6a11e9ae379e4b15d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:17.967448 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4fbc5f73-cab0-48f4-8366-47909311cf5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe7faa84d8847a6a11e9ae379e4b15d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:17.982429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:17.990166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:18.036585 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4fbc5f73-cab0-48f4-8366-47909311cf5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe7faa84d8847a6a11e9ae379e4b15d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:18.041996 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81ea5f-ca0c-4269-a824-91cacb39dfb9 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:18.050998 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86bcac-86e9-4099-9181-396ef0c29677 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371dae58e95d403b97e311c6616adab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:18.051675 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86bcac-86e9-4099-9181-396ef0c29677 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:18.052025 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86bcac-86e9-4099-9181-396ef0c29677 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:18.052391 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86bcac-86e9-4099-9181-396ef0c29677 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:18.054309 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2f86bcac-86e9-4099-9181-396ef0c29677 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:18.056123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 859/1712] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:17 2022] DELETE /identity/v3/users/7fe7faa84d8847a6a11e9ae379e4b15d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:18.088515 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86bcac-86e9-4099-9181-396ef0c29677 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:18.090150 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86bcac-86e9-4099-9181-396ef0c29677 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:18.138194 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 854/1713] 10.222.0.73 () {60 vars in 1384 bytes} [Thu May 19 12:09:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:09:19.060558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc5f73-cab0-48f4-8366-47909311cf5c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:19.062991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4fbc5f73-cab0-48f4-8366-47909311cf5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:19.270809 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc5f73-cab0-48f4-8366-47909311cf5c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:19.287551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:19.288540 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:19.288776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:19.289063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322 admin admin] PATH_INFO: `/v3/projects/dbfe2a2d9cbe4c9091c9f44db24eea22` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:19.290669 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbfe2a2d9cbe4c9091c9f44db24eea22)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:19.292670 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:19.429324 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbfe2a2d9cbe4c9091c9f44db24eea22', 'request_id': 'req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:19.447519 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbfe2a2d9cbe4c9091c9f44db24eea22', 'request_id': 'req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:19.480970 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbfe2a2d9cbe4c9091c9f44db24eea22', 'request_id': 'req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:19.524343 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322 admin admin] The token cache is being invalidate because project dbfe2a2d9cbe4c9091c9f44db24eea22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:19.526529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:19.528917 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:19.540431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 860/1714] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:19 2022] DELETE /identity/v3/projects/dbfe2a2d9cbe4c9091c9f44db24eea22 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:19.541796 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86bcac-86e9-4099-9181-396ef0c29677 service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:19.559044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86bcac-86e9-4099-9181-396ef0c29677 service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:19.686749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b375c-360b-42ae-96e7-e687257484f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:19.695267 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b375c-360b-42ae-96e7-e687257484f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:19.695611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b375c-360b-42ae-96e7-e687257484f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:19.695894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b375c-360b-42ae-96e7-e687257484f5 admin admin] PATH_INFO: `/v3/users/b072860c099f4251ab82f1479bfa75e6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:19.697492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b375c-360b-42ae-96e7-e687257484f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b072860c099f4251ab82f1479bfa75e6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:19.699639 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b375c-360b-42ae-96e7-e687257484f5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:19.881584 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1d9b375c-360b-42ae-96e7-e687257484f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b072860c099f4251ab82f1479bfa75e6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:19.913893 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1d9b375c-360b-42ae-96e7-e687257484f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b072860c099f4251ab82f1479bfa75e6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:19.932469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1d9b375c-360b-42ae-96e7-e687257484f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b072860c099f4251ab82f1479bfa75e6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:19.933473 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1d9b375c-360b-42ae-96e7-e687257484f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b072860c099f4251ab82f1479bfa75e6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:19.934306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1d9b375c-360b-42ae-96e7-e687257484f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b072860c099f4251ab82f1479bfa75e6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:20.000248 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 855/1715] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:19 2022] DELETE /identity/v3/users/b072860c099f4251ab82f1479bfa75e6 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:20.480643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:20.482146 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:20.537583 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849c09f-d1bd-4f1f-8e3a-01d155fd3322 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:20.560036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b375c-360b-42ae-96e7-e687257484f5 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:20.563621 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1d9b375c-360b-42ae-96e7-e687257484f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:20.743640 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567dc7f6-c434-424b-8a7b-9b0808aa178c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:20.747594 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dc7f6-c434-424b-8a7b-9b0808aa178c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:20.748432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dc7f6-c434-424b-8a7b-9b0808aa178c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:20.749402 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dc7f6-c434-424b-8a7b-9b0808aa178c admin admin] PATH_INFO: `/v3/users/7243c90de66d4f11bbe9f2854b00fb82` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:20.752443 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567dc7f6-c434-424b-8a7b-9b0808aa178c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7243c90de66d4f11bbe9f2854b00fb82)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:20.756148 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567dc7f6-c434-424b-8a7b-9b0808aa178c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:20.761457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:20.836025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:20.853577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b375c-360b-42ae-96e7-e687257484f5 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:20.882751 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92520f19-0485-41a9-b0ec-979cf19b1dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:20.883664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92520f19-0485-41a9-b0ec-979cf19b1dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:20.883971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92520f19-0485-41a9-b0ec-979cf19b1dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:20.884252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92520f19-0485-41a9-b0ec-979cf19b1dba admin admin] PATH_INFO: `/v3/projects/913f339d469d47358b667d307dfa17c8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:20.890103 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92520f19-0485-41a9-b0ec-979cf19b1dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=913f339d469d47358b667d307dfa17c8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:20.900610 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92520f19-0485-41a9-b0ec-979cf19b1dba admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:20.933402 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-567dc7f6-c434-424b-8a7b-9b0808aa178c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7243c90de66d4f11bbe9f2854b00fb82'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:20.934113 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-567dc7f6-c434-424b-8a7b-9b0808aa178c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7243c90de66d4f11bbe9f2854b00fb82'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:20.951125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-567dc7f6-c434-424b-8a7b-9b0808aa178c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7243c90de66d4f11bbe9f2854b00fb82'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:20.968317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-567dc7f6-c434-424b-8a7b-9b0808aa178c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7243c90de66d4f11bbe9f2854b00fb82'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:21.009857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-567dc7f6-c434-424b-8a7b-9b0808aa178c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7243c90de66d4f11bbe9f2854b00fb82'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:21.040445 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 861/1716] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:20 2022] DELETE /identity/v3/users/7243c90de66d4f11bbe9f2854b00fb82 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:21.041551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567dc7f6-c434-424b-8a7b-9b0808aa178c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:21.044783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-92520f19-0485-41a9-b0ec-979cf19b1dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913f339d469d47358b667d307dfa17c8', 'request_id': 'req-92520f19-0485-41a9-b0ec-979cf19b1dba'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:21.047675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-567dc7f6-c434-424b-8a7b-9b0808aa178c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:21.057007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-92520f19-0485-41a9-b0ec-979cf19b1dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913f339d469d47358b667d307dfa17c8', 'request_id': 'req-92520f19-0485-41a9-b0ec-979cf19b1dba'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:21.069152 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-92520f19-0485-41a9-b0ec-979cf19b1dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913f339d469d47358b667d307dfa17c8', 'request_id': 'req-92520f19-0485-41a9-b0ec-979cf19b1dba'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:21.100331 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-92520f19-0485-41a9-b0ec-979cf19b1dba admin admin] The token cache is being invalidate because project 913f339d469d47358b667d307dfa17c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:21.100713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-92520f19-0485-41a9-b0ec-979cf19b1dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:21.103222 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-92520f19-0485-41a9-b0ec-979cf19b1dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:21.106429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 856/1717] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:20 2022] DELETE /identity/v3/projects/913f339d469d47358b667d307dfa17c8 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:21.108007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfca88-454b-4fe4-99f6-ac81013d35dd None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:21.108316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfca88-454b-4fe4-99f6-ac81013d35dd None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:21.108910 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfca88-454b-4fe4-99f6-ac81013d35dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:21.164274 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-aecfca88-454b-4fe4-99f6-ac81013d35dd None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:21.169304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-aecfca88-454b-4fe4-99f6-ac81013d35dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:21.212202 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567dc7f6-c434-424b-8a7b-9b0808aa178c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:21.227658 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef548b-38f4-4797-b7b7-e71aeb992bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:21.228889 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef548b-38f4-4797-b7b7-e71aeb992bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:21.229501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef548b-38f4-4797-b7b7-e71aeb992bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:21.229923 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef548b-38f4-4797-b7b7-e71aeb992bbc admin admin] PATH_INFO: `/v3/users/41d129f3abda4ed4a24720f6662ac5f2` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:21.237910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef548b-38f4-4797-b7b7-e71aeb992bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=41d129f3abda4ed4a24720f6662ac5f2)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:21.240327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef548b-38f4-4797-b7b7-e71aeb992bbc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:21.357781 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4bef548b-38f4-4797-b7b7-e71aeb992bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41d129f3abda4ed4a24720f6662ac5f2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:21.358602 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4bef548b-38f4-4797-b7b7-e71aeb992bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41d129f3abda4ed4a24720f6662ac5f2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:21.376692 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4bef548b-38f4-4797-b7b7-e71aeb992bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41d129f3abda4ed4a24720f6662ac5f2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:21.391131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4bef548b-38f4-4797-b7b7-e71aeb992bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41d129f3abda4ed4a24720f6662ac5f2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:21.426335 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4bef548b-38f4-4797-b7b7-e71aeb992bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41d129f3abda4ed4a24720f6662ac5f2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:21.446024 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 862/1718] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:21 2022] DELETE /identity/v3/users/41d129f3abda4ed4a24720f6662ac5f2 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:21.454066 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 857/1719] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:21.455455 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef548b-38f4-4797-b7b7-e71aeb992bbc admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:21.456720 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44905e-d205-40a1-807f-29aee400688d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:21.457772 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4bef548b-38f4-4797-b7b7-e71aeb992bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:21.459140 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44905e-d205-40a1-807f-29aee400688d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:21.459428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44905e-d205-40a1-807f-29aee400688d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:21.486832 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:21.502899 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-4b44905e-d205-40a1-807f-29aee400688d None None] MFA Rules not processed for user `4897919923a64881ac5540cc5d58df1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:21.504864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4b44905e-d205-40a1-807f-29aee400688d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:21.656587 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef548b-38f4-4797-b7b7-e71aeb992bbc admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:21.670335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 858/1720] 10.222.0.78 () {58 vars in 1015 bytes} [Thu May 19 12:09:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:21.672846 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178f340-c5f6-43e7-85c9-ceb0b7d536ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:21.673757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178f340-c5f6-43e7-85c9-ceb0b7d536ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:21.674046 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178f340-c5f6-43e7-85c9-ceb0b7d536ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:21.674324 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178f340-c5f6-43e7-85c9-ceb0b7d536ee admin admin] PATH_INFO: `/v3/users/f9964e2d7ecd453dbae3851cad81c5b4` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:21.675100 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84790c03-82fa-4183-aab4-85e621a4ab24 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:21.675416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84790c03-82fa-4183-aab4-85e621a4ab24 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:21.675691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84790c03-82fa-4183-aab4-85e621a4ab24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:21.677741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178f340-c5f6-43e7-85c9-ceb0b7d536ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9964e2d7ecd453dbae3851cad81c5b4)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:21.685357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178f340-c5f6-43e7-85c9-ceb0b7d536ee admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:21.723012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-84790c03-82fa-4183-aab4-85e621a4ab24 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:21.724281 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-84790c03-82fa-4183-aab4-85e621a4ab24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:21.760824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 859/1721] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:21.760824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84790c03-82fa-4183-aab4-85e621a4ab24 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:21.763041 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-84790c03-82fa-4183-aab4-85e621a4ab24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:21.792810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84790c03-82fa-4183-aab4-85e621a4ab24 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:21.816597 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928efaa-3a84-4aef-a2fd-912f7fa68cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:21.817310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928efaa-3a84-4aef-a2fd-912f7fa68cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:21.817607 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928efaa-3a84-4aef-a2fd-912f7fa68cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:21.817913 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928efaa-3a84-4aef-a2fd-912f7fa68cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:21.819126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6178f340-c5f6-43e7-85c9-ceb0b7d536ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9964e2d7ecd453dbae3851cad81c5b4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:21.820114 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6178f340-c5f6-43e7-85c9-ceb0b7d536ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9964e2d7ecd453dbae3851cad81c5b4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:21.831274 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6178f340-c5f6-43e7-85c9-ceb0b7d536ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9964e2d7ecd453dbae3851cad81c5b4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:21.853198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928efaa-3a84-4aef-a2fd-912f7fa68cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:21.859395 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928efaa-3a84-4aef-a2fd-912f7fa68cc7 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:21.861083 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6178f340-c5f6-43e7-85c9-ceb0b7d536ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9964e2d7ecd453dbae3851cad81c5b4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:21.881946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 860/1722] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:21.882595 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928efaa-3a84-4aef-a2fd-912f7fa68cc7 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:21.890110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6178f340-c5f6-43e7-85c9-ceb0b7d536ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9964e2d7ecd453dbae3851cad81c5b4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:21.900791 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:21.905602 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 863/1723] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:21 2022] DELETE /identity/v3/users/f9964e2d7ecd453dbae3851cad81c5b4 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:21.907633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178f340-c5f6-43e7-85c9-ceb0b7d536ee admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:21.909354 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928efaa-3a84-4aef-a2fd-912f7fa68cc7 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:21.913464 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6178f340-c5f6-43e7-85c9-ceb0b7d536ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:22.066048 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb9add-2174-4bf9-9914-47a373f42242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:22.066626 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb9add-2174-4bf9-9914-47a373f42242 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:22.066970 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb9add-2174-4bf9-9914-47a373f42242 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:22.067238 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb9add-2174-4bf9-9914-47a373f42242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:22.104923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-88bb9add-2174-4bf9-9914-47a373f42242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:22.111979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178f340-c5f6-43e7-85c9-ceb0b7d536ee admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:22.130340 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba63ec4-3cd7-4455-9565-120c3b777c8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:22.131036 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63ec4-3cd7-4455-9565-120c3b777c8e service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:22.131518 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63ec4-3cd7-4455-9565-120c3b777c8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:22.131627 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63ec4-3cd7-4455-9565-120c3b777c8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:22.149102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4ba63ec4-3cd7-4455-9565-120c3b777c8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:22.168093 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb9add-2174-4bf9-9914-47a373f42242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:22.169558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb9add-2174-4bf9-9914-47a373f42242 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:22.202284 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 861/1724] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:22.216492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb9add-2174-4bf9-9914-47a373f42242 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:22.220130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-88bb9add-2174-4bf9-9914-47a373f42242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:22.275234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:22.326729 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba63ec4-3cd7-4455-9565-120c3b777c8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:22.328536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba63ec4-3cd7-4455-9565-120c3b777c8e service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:22.357505 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 864/1725] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:22.429307 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb9add-2174-4bf9-9914-47a373f42242 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:22.447355 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22246a36-390d-4f11-9194-904dc906f548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:22.448523 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22246a36-390d-4f11-9194-904dc906f548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:22.448862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22246a36-390d-4f11-9194-904dc906f548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:22.449149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22246a36-390d-4f11-9194-904dc906f548 admin admin] PATH_INFO: `/v3/projects/1126a264af2a4035af9087ad4fd13caf` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:22.450699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22246a36-390d-4f11-9194-904dc906f548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1126a264af2a4035af9087ad4fd13caf)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:22.452726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22246a36-390d-4f11-9194-904dc906f548 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:22.564961 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-22246a36-390d-4f11-9194-904dc906f548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1126a264af2a4035af9087ad4fd13caf', 'request_id': 'req-22246a36-390d-4f11-9194-904dc906f548'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:22.577960 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-22246a36-390d-4f11-9194-904dc906f548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1126a264af2a4035af9087ad4fd13caf', 'request_id': 'req-22246a36-390d-4f11-9194-904dc906f548'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:22.597002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-22246a36-390d-4f11-9194-904dc906f548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1126a264af2a4035af9087ad4fd13caf', 'request_id': 'req-22246a36-390d-4f11-9194-904dc906f548'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:22.625614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-22246a36-390d-4f11-9194-904dc906f548 admin admin] The token cache is being invalidate because project 1126a264af2a4035af9087ad4fd13caf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:22.627884 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-22246a36-390d-4f11-9194-904dc906f548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:22.628695 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-22246a36-390d-4f11-9194-904dc906f548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:22.644902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791211e9-9ff9-4afa-b609-97d073e6db55 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:22.645384 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791211e9-9ff9-4afa-b609-97d073e6db55 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:22.645740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791211e9-9ff9-4afa-b609-97d073e6db55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:22.646092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 862/1726] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:22 2022] DELETE /identity/v3/projects/1126a264af2a4035af9087ad4fd13caf => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:22.693920 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-791211e9-9ff9-4afa-b609-97d073e6db55 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:22.697509 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-791211e9-9ff9-4afa-b609-97d073e6db55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:23.022161 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5526aa-2892-449a-8ff7-b1f4b9256af1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:23.023980 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5526aa-2892-449a-8ff7-b1f4b9256af1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:23.024708 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5526aa-2892-449a-8ff7-b1f4b9256af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:23.039060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 865/1727] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:23.080770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1c5526aa-2892-449a-8ff7-b1f4b9256af1 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:23.083870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1c5526aa-2892-449a-8ff7-b1f4b9256af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:23.111518 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791211e9-9ff9-4afa-b609-97d073e6db55 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:23.112482 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 863/1728] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:23.125313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791211e9-9ff9-4afa-b609-97d073e6db55 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:23.136874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad0c7b-6c2a-4528-a44b-d606900cc517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:23.137839 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad0c7b-6c2a-4528-a44b-d606900cc517 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:23.140945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad0c7b-6c2a-4528-a44b-d606900cc517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:23.143432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad0c7b-6c2a-4528-a44b-d606900cc517 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:23.144848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad0c7b-6c2a-4528-a44b-d606900cc517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:23.147546 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad0c7b-6c2a-4528-a44b-d606900cc517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:23.149440 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad0c7b-6c2a-4528-a44b-d606900cc517 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:23.195015 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5526aa-2892-449a-8ff7-b1f4b9256af1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:23.208013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 866/1729] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:23.210279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5526aa-2892-449a-8ff7-b1f4b9256af1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:23.219836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc038fc-6259-4f1c-a907-26c87840885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:23.220724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc038fc-6259-4f1c-a907-26c87840885d admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:23.221018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc038fc-6259-4f1c-a907-26c87840885d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:23.221308 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc038fc-6259-4f1c-a907-26c87840885d admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:23.222122 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc038fc-6259-4f1c-a907-26c87840885d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:23.225040 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc038fc-6259-4f1c-a907-26c87840885d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:23.273909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad0c7b-6c2a-4528-a44b-d606900cc517 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:23.284363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 864/1730] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:23 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:23.290803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad0c7b-6c2a-4528-a44b-d606900cc517 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:23.431792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e112f5-46df-45e1-993f-8b3776971a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:23.432850 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e112f5-46df-45e1-993f-8b3776971a81 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:23.433238 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e112f5-46df-45e1-993f-8b3776971a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:23.433617 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e112f5-46df-45e1-993f-8b3776971a81 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:23.434427 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e112f5-46df-45e1-993f-8b3776971a81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:23.438730 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e112f5-46df-45e1-993f-8b3776971a81 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:23.488848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 867/1731] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:23 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:23.493074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc038fc-6259-4f1c-a907-26c87840885d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:23.511295 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc038fc-6259-4f1c-a907-26c87840885d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:23.527144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178f283-07eb-4629-b225-ff7fb232c686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:23.528379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178f283-07eb-4629-b225-ff7fb232c686 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:23.529837 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178f283-07eb-4629-b225-ff7fb232c686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:23.530139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178f283-07eb-4629-b225-ff7fb232c686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:23.532121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178f283-07eb-4629-b225-ff7fb232c686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:23.536567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178f283-07eb-4629-b225-ff7fb232c686 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:23.544450 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:23.578992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 865/1732] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:23.579942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e112f5-46df-45e1-993f-8b3776971a81 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:23.596250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e112f5-46df-45e1-993f-8b3776971a81 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:23.615716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78a15a-4f42-41b5-8479-31e595c627bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:23.615716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78a15a-4f42-41b5-8479-31e595c627bf admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:23.615716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78a15a-4f42-41b5-8479-31e595c627bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:23.615716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78a15a-4f42-41b5-8479-31e595c627bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:23.616135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78a15a-4f42-41b5-8479-31e595c627bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:23.616135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78a15a-4f42-41b5-8479-31e595c627bf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:23.642344 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 868/1733] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:23.648563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178f283-07eb-4629-b225-ff7fb232c686 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:23.662612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178f283-07eb-4629-b225-ff7fb232c686 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:23.685359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed790743-e230-4408-a577-bed690f8ca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:23.688117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed790743-e230-4408-a577-bed690f8ca1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:23.688555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed790743-e230-4408-a577-bed690f8ca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:23.688908 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed790743-e230-4408-a577-bed690f8ca1b admin admin] PATH_INFO: `/v3/projects/26bbf557339d4126a5ee7f2c2dbe1cda/users/91a8fe84514b42e69251190caf692d6e/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:23.737482 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed790743-e230-4408-a577-bed690f8ca1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=26bbf557339d4126a5ee7f2c2dbe1cda, user_id=91a8fe84514b42e69251190caf692d6e, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:23.743131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed790743-e230-4408-a577-bed690f8ca1b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:23.791370 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a529d-b557-48be-ba88-f91cde0c2265 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:23.791977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a529d-b557-48be-ba88-f91cde0c2265 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:23.792091 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a529d-b557-48be-ba88-f91cde0c2265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:23.794525 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 866/1734] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:23 2022] PUT /identity/v3/projects/26bbf557339d4126a5ee7f2c2dbe1cda/users/91a8fe84514b42e69251190caf692d6e/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:23.862532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-433a529d-b557-48be-ba88-f91cde0c2265 None None] MFA Rules not processed for user `91a8fe84514b42e69251190caf692d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:23.863860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-433a529d-b557-48be-ba88-f91cde0c2265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:23.939489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:23.981665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed790743-e230-4408-a577-bed690f8ca1b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:23.985081 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 869/1735] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:24.075336 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed790743-e230-4408-a577-bed690f8ca1b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:24.082779 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b20ff-bd12-4bb7-b99d-1317d0fd25e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:24.084488 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b20ff-bd12-4bb7-b99d-1317d0fd25e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:24.084854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b20ff-bd12-4bb7-b99d-1317d0fd25e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:24.085226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b20ff-bd12-4bb7-b99d-1317d0fd25e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:24.086284 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b20ff-bd12-4bb7-b99d-1317d0fd25e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:24.090508 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b20ff-bd12-4bb7-b99d-1317d0fd25e1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:24.148403 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a529d-b557-48be-ba88-f91cde0c2265 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:24.161635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 867/1736] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:23 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:24.166605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a529d-b557-48be-ba88-f91cde0c2265 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:24.253753 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b20ff-bd12-4bb7-b99d-1317d0fd25e1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:24.257483 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-391b20ff-bd12-4bb7-b99d-1317d0fd25e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:24.378434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb116b9-e896-4a0d-9332-d2c64626f59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:24.380963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb116b9-e896-4a0d-9332-d2c64626f59f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:24.381199 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb116b9-e896-4a0d-9332-d2c64626f59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:24.389494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb116b9-e896-4a0d-9332-d2c64626f59f admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:24.390958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb116b9-e896-4a0d-9332-d2c64626f59f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:24.405126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb116b9-e896-4a0d-9332-d2c64626f59f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:24.435612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b20ff-bd12-4bb7-b99d-1317d0fd25e1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:24.444200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114f7f9-d4e3-4e44-a7d6-1c0f8c9cd9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:24.445880 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114f7f9-d4e3-4e44-a7d6-1c0f8c9cd9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:24.446344 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114f7f9-d4e3-4e44-a7d6-1c0f8c9cd9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:24.446832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114f7f9-d4e3-4e44-a7d6-1c0f8c9cd9da admin admin] PATH_INFO: `/v3/users/8f151217dc5d45e694ac22976e821796` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:24.448946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114f7f9-d4e3-4e44-a7d6-1c0f8c9cd9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f151217dc5d45e694ac22976e821796)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:24.456447 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114f7f9-d4e3-4e44-a7d6-1c0f8c9cd9da admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:24.490299 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 870/1737] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:24 2022] POST /identity/v3/users => generated 293 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:24.491342 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb116b9-e896-4a0d-9332-d2c64626f59f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:24.530895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb116b9-e896-4a0d-9332-d2c64626f59f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:24.549027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63db29-be2a-4821-8b60-672231e5418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:24.549788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63db29-be2a-4821-8b60-672231e5418a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:24.550080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63db29-be2a-4821-8b60-672231e5418a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:24.550373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63db29-be2a-4821-8b60-672231e5418a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:24.551118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63db29-be2a-4821-8b60-672231e5418a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:24.552801 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63db29-be2a-4821-8b60-672231e5418a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:24.555395 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7114f7f9-d4e3-4e44-a7d6-1c0f8c9cd9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f151217dc5d45e694ac22976e821796'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:24.580977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7114f7f9-d4e3-4e44-a7d6-1c0f8c9cd9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f151217dc5d45e694ac22976e821796'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:24.586341 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:24.600268 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 871/1738] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:24.600522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7114f7f9-d4e3-4e44-a7d6-1c0f8c9cd9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f151217dc5d45e694ac22976e821796'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:24.601738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7114f7f9-d4e3-4e44-a7d6-1c0f8c9cd9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f151217dc5d45e694ac22976e821796'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:24.602088 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63db29-be2a-4821-8b60-672231e5418a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:24.602763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7114f7f9-d4e3-4e44-a7d6-1c0f8c9cd9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f151217dc5d45e694ac22976e821796'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:24.605954 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0e63db29-be2a-4821-8b60-672231e5418a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:24.642169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 868/1739] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:24 2022] DELETE /identity/v3/users/8f151217dc5d45e694ac22976e821796 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:09:24.646227 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318163b-093c-49ac-87dc-d9f9b66e3e68 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:24.646696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318163b-093c-49ac-87dc-d9f9b66e3e68 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:24.647181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318163b-093c-49ac-87dc-d9f9b66e3e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:24.659298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63db29-be2a-4821-8b60-672231e5418a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:24.697006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3318163b-093c-49ac-87dc-d9f9b66e3e68 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:24.698244 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3318163b-093c-49ac-87dc-d9f9b66e3e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:24.886086 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62de0d2-60e4-4e09-bfb3-bc91cca568e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:24.886807 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62de0d2-60e4-4e09-bfb3-bc91cca568e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:24.887102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62de0d2-60e4-4e09-bfb3-bc91cca568e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:24.887389 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62de0d2-60e4-4e09-bfb3-bc91cca568e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:24.891288 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62de0d2-60e4-4e09-bfb3-bc91cca568e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:24.893026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62de0d2-60e4-4e09-bfb3-bc91cca568e6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:24.913296 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 869/1740] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:09:24.944914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318163b-093c-49ac-87dc-d9f9b66e3e68 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:24.945641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 872/1741] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:24.960940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62de0d2-60e4-4e09-bfb3-bc91cca568e6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:24.962739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318163b-093c-49ac-87dc-d9f9b66e3e68 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:24.965888 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a62de0d2-60e4-4e09-bfb3-bc91cca568e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:24.997506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f498e6f-b136-4093-be3b-ec85c457effd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:24.998907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f498e6f-b136-4093-be3b-ec85c457effd admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:25.000439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f498e6f-b136-4093-be3b-ec85c457effd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:25.000975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f498e6f-b136-4093-be3b-ec85c457effd admin admin] PATH_INFO: `/v3/projects/da16569927ad4839800b2fe14d278ff8/users/ee2bcbb3c5584e2b9bc17cb861ec7490/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:25.055071 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f498e6f-b136-4093-be3b-ec85c457effd admin admin] RBAC: Authorizing `identity:create_grant(project_id=da16569927ad4839800b2fe14d278ff8, user_id=ee2bcbb3c5584e2b9bc17cb861ec7490, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:25.058274 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f498e6f-b136-4093-be3b-ec85c457effd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:25.099986 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 870/1742] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:24 2022] PUT /identity/v3/projects/da16569927ad4839800b2fe14d278ff8/users/ee2bcbb3c5584e2b9bc17cb861ec7490/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:25.101614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f498e6f-b136-4093-be3b-ec85c457effd admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:25.112926 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5f498e6f-b136-4093-be3b-ec85c457effd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:25.160819 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62de0d2-60e4-4e09-bfb3-bc91cca568e6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:25.192478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:25.335147 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce45a32-a4c5-4763-aba8-e8cdd44172e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:25.335839 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce45a32-a4c5-4763-aba8-e8cdd44172e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:25.336404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce45a32-a4c5-4763-aba8-e8cdd44172e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:25.338449 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce45a32-a4c5-4763-aba8-e8cdd44172e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:25.362648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce45a32-a4c5-4763-aba8-e8cdd44172e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:25.362765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f498e6f-b136-4093-be3b-ec85c457effd admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:25.364545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce45a32-a4c5-4763-aba8-e8cdd44172e9 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:25.377804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07d6a9-a416-4f8c-8954-a221ba6a5c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:25.379533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07d6a9-a416-4f8c-8954-a221ba6a5c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:25.379792 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07d6a9-a416-4f8c-8954-a221ba6a5c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:25.380108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07d6a9-a416-4f8c-8954-a221ba6a5c5f admin admin] PATH_INFO: `/v3/projects/94d561027acf49129b8878131fdd100d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:25.388476 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07d6a9-a416-4f8c-8954-a221ba6a5c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d561027acf49129b8878131fdd100d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:25.396785 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07d6a9-a416-4f8c-8954-a221ba6a5c5f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:25.399368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 873/1743] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:25.402415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7e3f0-a5d7-4f27-9fd7-a0a407d82650 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:25.402415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7e3f0-a5d7-4f27-9fd7-a0a407d82650 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:25.402657 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7e3f0-a5d7-4f27-9fd7-a0a407d82650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:25.479199 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-cbb7e3f0-a5d7-4f27-9fd7-a0a407d82650 None None] MFA Rules not processed for user `ee2bcbb3c5584e2b9bc17cb861ec7490`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:25.482253 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cbb7e3f0-a5d7-4f27-9fd7-a0a407d82650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:25.552177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8a07d6a9-a416-4f8c-8954-a221ba6a5c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d561027acf49129b8878131fdd100d', 'request_id': 'req-8a07d6a9-a416-4f8c-8954-a221ba6a5c5f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:25.565251 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:25.570492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8a07d6a9-a416-4f8c-8954-a221ba6a5c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d561027acf49129b8878131fdd100d', 'request_id': 'req-8a07d6a9-a416-4f8c-8954-a221ba6a5c5f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:25.596895 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8a07d6a9-a416-4f8c-8954-a221ba6a5c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d561027acf49129b8878131fdd100d', 'request_id': 'req-8a07d6a9-a416-4f8c-8954-a221ba6a5c5f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:25.630885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8a07d6a9-a416-4f8c-8954-a221ba6a5c5f admin admin] The token cache is being invalidate because project 94d561027acf49129b8878131fdd100d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:25.632327 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8a07d6a9-a416-4f8c-8954-a221ba6a5c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:25.634177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8a07d6a9-a416-4f8c-8954-a221ba6a5c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:25.644289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 871/1744] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:25 2022] DELETE /identity/v3/projects/94d561027acf49129b8878131fdd100d => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:25.645980 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ff8d-657a-407d-b7bc-08f561c7c85b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:25.648281 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ff8d-657a-407d-b7bc-08f561c7c85b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:25.651971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ff8d-657a-407d-b7bc-08f561c7c85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:25.704556 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-7839ff8d-657a-407d-b7bc-08f561c7c85b None None] MFA Rules not processed for user `dd29391d48434f67894eb8efcec99012`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:25.705146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7839ff8d-657a-407d-b7bc-08f561c7c85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:25.734936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 874/1745] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:25.735858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7e3f0-a5d7-4f27-9fd7-a0a407d82650 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:25.756528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cbb7e3f0-a5d7-4f27-9fd7-a0a407d82650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:25.876258 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 872/1746] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:25.879580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e22e2-900a-4711-b2da-cb01d6035f54 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:25.879752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e22e2-900a-4711-b2da-cb01d6035f54 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:25.895375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e22e2-900a-4711-b2da-cb01d6035f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:25.988464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6b8e22e2-900a-4711-b2da-cb01d6035f54 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:25.992347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6b8e22e2-900a-4711-b2da-cb01d6035f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:26.015163 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7e3f0-a5d7-4f27-9fd7-a0a407d82650 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:26.035742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 873/1747] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:26.057614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55726db8-989a-4411-9e45-f3486e7067c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:26.060316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e22e2-900a-4711-b2da-cb01d6035f54 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:26.061917 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55726db8-989a-4411-9e45-f3486e7067c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:26.062550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55726db8-989a-4411-9e45-f3486e7067c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:26.063410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6b8e22e2-900a-4711-b2da-cb01d6035f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:26.063868 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55726db8-989a-4411-9e45-f3486e7067c5 admin admin] PATH_INFO: `/v3/projects/935a1552f46d411ba42c973634af2cc8` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:26.067402 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55726db8-989a-4411-9e45-f3486e7067c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=935a1552f46d411ba42c973634af2cc8)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:26.074773 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55726db8-989a-4411-9e45-f3486e7067c5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:26.096809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e22e2-900a-4711-b2da-cb01d6035f54 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:26.109837 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdc7d5-2ca0-4581-9a1d-3de33ab42ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:26.110584 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdc7d5-2ca0-4581-9a1d-3de33ab42ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:26.111305 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdc7d5-2ca0-4581-9a1d-3de33ab42ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:26.112602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdc7d5-2ca0-4581-9a1d-3de33ab42ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:26.113444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdc7d5-2ca0-4581-9a1d-3de33ab42ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:26.118703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdc7d5-2ca0-4581-9a1d-3de33ab42ec2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:26.231277 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 874/1748] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:26 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:26.237235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2f99-5b0e-47d9-b0f6-1dad97a96127 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:26.237602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2f99-5b0e-47d9-b0f6-1dad97a96127 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:26.237895 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2f99-5b0e-47d9-b0f6-1dad97a96127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:26.239125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:26.253313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-55726db8-989a-4411-9e45-f3486e7067c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935a1552f46d411ba42c973634af2cc8', 'request_id': 'req-55726db8-989a-4411-9e45-f3486e7067c5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:26.283375 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-55726db8-989a-4411-9e45-f3486e7067c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935a1552f46d411ba42c973634af2cc8', 'request_id': 'req-55726db8-989a-4411-9e45-f3486e7067c5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:26.299051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-55726db8-989a-4411-9e45-f3486e7067c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935a1552f46d411ba42c973634af2cc8', 'request_id': 'req-55726db8-989a-4411-9e45-f3486e7067c5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:26.309041 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-7dbf2f99-5b0e-47d9-b0f6-1dad97a96127 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:26.313359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7dbf2f99-5b0e-47d9-b0f6-1dad97a96127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:26.343131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-55726db8-989a-4411-9e45-f3486e7067c5 admin admin] The token cache is being invalidate because project 935a1552f46d411ba42c973634af2cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:26.343471 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-55726db8-989a-4411-9e45-f3486e7067c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:26.348226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-55726db8-989a-4411-9e45-f3486e7067c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:26.360416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 875/1749] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:25 2022] DELETE /identity/v3/projects/935a1552f46d411ba42c973634af2cc8 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:26.361142 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f00a67-f307-45dd-8e36-2500cc007cbd None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:26.361452 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f00a67-f307-45dd-8e36-2500cc007cbd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:26.361764 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f00a67-f307-45dd-8e36-2500cc007cbd None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:26.369107 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 876/1750] 10.222.0.73 () {54 vars in 921 bytes} [Thu May 19 12:09:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:09:26.370854 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f00a67-f307-45dd-8e36-2500cc007cbd None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:26.378711 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f0f00a67-f307-45dd-8e36-2500cc007cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:26.522173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 875/1751] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:26.524601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf2f99-5b0e-47d9-b0f6-1dad97a96127 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:26.536904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7dbf2f99-5b0e-47d9-b0f6-1dad97a96127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:26.566454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf2f99-5b0e-47d9-b0f6-1dad97a96127 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:26.580859 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcaad0-71c5-4f72-8b41-2849d69bba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:26.581769 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcaad0-71c5-4f72-8b41-2849d69bba07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:26.582059 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcaad0-71c5-4f72-8b41-2849d69bba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:26.582343 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcaad0-71c5-4f72-8b41-2849d69bba07 admin admin] PATH_INFO: `/v3/users/5fd4acfbe4b747b6bb1ba2baae7be57b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:26.584683 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcaad0-71c5-4f72-8b41-2849d69bba07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fd4acfbe4b747b6bb1ba2baae7be57b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:26.586680 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcaad0-71c5-4f72-8b41-2849d69bba07 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:26.596770 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f00a67-f307-45dd-8e36-2500cc007cbd None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:26.614422 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68834c72-98fc-415b-9277-115b3ee5f022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:26.615128 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68834c72-98fc-415b-9277-115b3ee5f022 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:26.615423 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68834c72-98fc-415b-9277-115b3ee5f022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:26.615707 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68834c72-98fc-415b-9277-115b3ee5f022 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:26.619575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68834c72-98fc-415b-9277-115b3ee5f022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:26.624828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68834c72-98fc-415b-9277-115b3ee5f022 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:26.715433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 877/1752] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:26 2022] POST /identity/v3/users => generated 300 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:26.719488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504c908-79af-4511-86ee-5eeeef262120 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:26.719779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504c908-79af-4511-86ee-5eeeef262120 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:26.720588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504c908-79af-4511-86ee-5eeeef262120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:26.720709 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f3dcaad0-71c5-4f72-8b41-2849d69bba07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fd4acfbe4b747b6bb1ba2baae7be57b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:26.737986 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f3dcaad0-71c5-4f72-8b41-2849d69bba07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fd4acfbe4b747b6bb1ba2baae7be57b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:26.740482 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:26.757511 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f3dcaad0-71c5-4f72-8b41-2849d69bba07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fd4acfbe4b747b6bb1ba2baae7be57b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:26.758239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f3dcaad0-71c5-4f72-8b41-2849d69bba07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fd4acfbe4b747b6bb1ba2baae7be57b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:26.760207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f3dcaad0-71c5-4f72-8b41-2849d69bba07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fd4acfbe4b747b6bb1ba2baae7be57b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:26.767234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f504c908-79af-4511-86ee-5eeeef262120 None None] MFA Rules not processed for user `bd0c1f0710f3447d94e67048a508781e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:26.769114 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f504c908-79af-4511-86ee-5eeeef262120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:26.803946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 876/1753] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:26 2022] DELETE /identity/v3/users/5fd4acfbe4b747b6bb1ba2baae7be57b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:26.803946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcaad0-71c5-4f72-8b41-2849d69bba07 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:26.818693 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f3dcaad0-71c5-4f72-8b41-2849d69bba07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:27.032666 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 878/1754] 10.222.0.73 () {58 vars in 1018 bytes} [Thu May 19 12:09:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:27.033681 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504c908-79af-4511-86ee-5eeeef262120 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:27.038972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f504c908-79af-4511-86ee-5eeeef262120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:27.072707 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcaad0-71c5-4f72-8b41-2849d69bba07 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:27.074368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504c908-79af-4511-86ee-5eeeef262120 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:27.086275 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4b49c-334c-4cac-8378-374a171ab61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:27.087203 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4b49c-334c-4cac-8378-374a171ab61a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:27.087500 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4b49c-334c-4cac-8378-374a171ab61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:27.087784 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4b49c-334c-4cac-8378-374a171ab61a admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:27.090885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4b49c-334c-4cac-8378-374a171ab61a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:27.091249 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4b49c-334c-4cac-8378-374a171ab61a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:27.094643 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4b49c-334c-4cac-8378-374a171ab61a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:27.101420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fef9f-c31a-441d-bbeb-49717b090d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:27.103784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fef9f-c31a-441d-bbeb-49717b090d5c admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:27.105147 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fef9f-c31a-441d-bbeb-49717b090d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:27.105500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fef9f-c31a-441d-bbeb-49717b090d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:27.107767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fef9f-c31a-441d-bbeb-49717b090d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:27.111359 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fef9f-c31a-441d-bbeb-49717b090d5c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:27.122882 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 877/1755] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:27.124128 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4b49c-334c-4cac-8378-374a171ab61a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:27.137716 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4b49c-334c-4cac-8378-374a171ab61a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:27.144318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 879/1756] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:27.146708 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fef9f-c31a-441d-bbeb-49717b090d5c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:27.149870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fd730-d3b5-446c-b994-7ad85fd7469f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:27.150961 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fd730-d3b5-446c-b994-7ad85fd7469f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:27.151393 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fd730-d3b5-446c-b994-7ad85fd7469f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:27.151864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fd730-d3b5-446c-b994-7ad85fd7469f admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:27.154804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fd730-d3b5-446c-b994-7ad85fd7469f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:27.158546 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fd730-d3b5-446c-b994-7ad85fd7469f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:27.178872 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fef9f-c31a-441d-bbeb-49717b090d5c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:27.192973 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb9500-a200-44cb-8321-c77da3810d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:27.194815 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb9500-a200-44cb-8321-c77da3810d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:27.195111 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb9500-a200-44cb-8321-c77da3810d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:27.196569 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb9500-a200-44cb-8321-c77da3810d88 admin admin] PATH_INFO: `/v3/projects/a937200d84a042e78848f8d6cde8b10a/users/0eb0106b47a2405abf65e906feab2e12/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:27.245266 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 878/1757] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:27 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:27.245506 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb9500-a200-44cb-8321-c77da3810d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a937200d84a042e78848f8d6cde8b10a, user_id=0eb0106b47a2405abf65e906feab2e12, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:27.247393 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fd730-d3b5-446c-b994-7ad85fd7469f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:27.251308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb9500-a200-44cb-8321-c77da3810d88 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:27.284634 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 880/1758] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:27 2022] PUT /identity/v3/projects/a937200d84a042e78848f8d6cde8b10a/users/0eb0106b47a2405abf65e906feab2e12/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:27.289269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb9500-a200-44cb-8321-c77da3810d88 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:27.347194 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:27.457712 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fd730-d3b5-446c-b994-7ad85fd7469f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:27.501042 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb9500-a200-44cb-8321-c77da3810d88 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:27.506972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559b82a-f667-4b1e-9a0e-f63c81a7a431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:27.507516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559b82a-f667-4b1e-9a0e-f63c81a7a431 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:27.507889 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559b82a-f667-4b1e-9a0e-f63c81a7a431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:27.508364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559b82a-f667-4b1e-9a0e-f63c81a7a431 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:27.509256 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559b82a-f667-4b1e-9a0e-f63c81a7a431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:27.511165 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559b82a-f667-4b1e-9a0e-f63c81a7a431 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:27.533091 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 881/1759] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:27.533091 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559b82a-f667-4b1e-9a0e-f63c81a7a431 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:27.533532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8559b82a-f667-4b1e-9a0e-f63c81a7a431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:27.564359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:27.574681 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559b82a-f667-4b1e-9a0e-f63c81a7a431 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:27.585642 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edd1b6-a5b8-4a3b-8049-d2ff2fdb47cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:27.588657 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edd1b6-a5b8-4a3b-8049-d2ff2fdb47cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:27.589077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edd1b6-a5b8-4a3b-8049-d2ff2fdb47cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:27.589490 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edd1b6-a5b8-4a3b-8049-d2ff2fdb47cb admin admin] PATH_INFO: `/v3/projects/3da28f5e361c4e03badc1253b2dd9c01` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:27.591366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56edd1b6-a5b8-4a3b-8049-d2ff2fdb47cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da28f5e361c4e03badc1253b2dd9c01)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:27.593493 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fa21a-86ef-42ce-9b56-3ffff0907feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:27.594920 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fa21a-86ef-42ce-9b56-3ffff0907feb admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:27.595242 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fa21a-86ef-42ce-9b56-3ffff0907feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:27.595436 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56edd1b6-a5b8-4a3b-8049-d2ff2fdb47cb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:27.595549 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fa21a-86ef-42ce-9b56-3ffff0907feb admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:27.596295 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fa21a-86ef-42ce-9b56-3ffff0907feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:27.598214 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fa21a-86ef-42ce-9b56-3ffff0907feb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:27.659904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 879/1760] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:27 2022] POST /identity/v3/users => generated 285 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:09:27.660852 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fa21a-86ef-42ce-9b56-3ffff0907feb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:27.690167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fa21a-86ef-42ce-9b56-3ffff0907feb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:27.705682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcee28-ac89-4846-931a-fbdd81290222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:27.707163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcee28-ac89-4846-931a-fbdd81290222 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:27.707667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcee28-ac89-4846-931a-fbdd81290222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:27.708053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcee28-ac89-4846-931a-fbdd81290222 admin admin] PATH_INFO: `/v3/projects/a937200d84a042e78848f8d6cde8b10a/users/0eb0106b47a2405abf65e906feab2e12/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:27.714477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcee28-ac89-4846-931a-fbdd81290222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a937200d84a042e78848f8d6cde8b10a, user_id=0eb0106b47a2405abf65e906feab2e12, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:27.718367 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcee28-ac89-4846-931a-fbdd81290222 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:27.738636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-56edd1b6-a5b8-4a3b-8049-d2ff2fdb47cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da28f5e361c4e03badc1253b2dd9c01', 'request_id': 'req-56edd1b6-a5b8-4a3b-8049-d2ff2fdb47cb'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:27.764513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 880/1761] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:27 2022] PUT /identity/v3/projects/a937200d84a042e78848f8d6cde8b10a/users/0eb0106b47a2405abf65e906feab2e12/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:27.764513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcee28-ac89-4846-931a-fbdd81290222 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:27.776814 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-56edd1b6-a5b8-4a3b-8049-d2ff2fdb47cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da28f5e361c4e03badc1253b2dd9c01', 'request_id': 'req-56edd1b6-a5b8-4a3b-8049-d2ff2fdb47cb'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:27.789368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-56edd1b6-a5b8-4a3b-8049-d2ff2fdb47cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da28f5e361c4e03badc1253b2dd9c01', 'request_id': 'req-56edd1b6-a5b8-4a3b-8049-d2ff2fdb47cb'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:27.805136 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-56edd1b6-a5b8-4a3b-8049-d2ff2fdb47cb admin admin] The token cache is being invalidate because project 3da28f5e361c4e03badc1253b2dd9c01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:27.806105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-56edd1b6-a5b8-4a3b-8049-d2ff2fdb47cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:27.807750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-56edd1b6-a5b8-4a3b-8049-d2ff2fdb47cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:27.810537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 882/1762] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:27 2022] DELETE /identity/v3/projects/3da28f5e361c4e03badc1253b2dd9c01 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:27.813321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecc779-6c91-4ee0-9993-f3a2cc9a510c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:27.813927 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecc779-6c91-4ee0-9993-f3a2cc9a510c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:27.814952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecc779-6c91-4ee0-9993-f3a2cc9a510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:27.911497 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-39ecc779-6c91-4ee0-9993-f3a2cc9a510c None None] MFA Rules not processed for user `0eb0106b47a2405abf65e906feab2e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:27.913401 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-39ecc779-6c91-4ee0-9993-f3a2cc9a510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:28.030988 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcee28-ac89-4846-931a-fbdd81290222 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:28.042611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b6a9d-9e49-4072-b7aa-59e149556301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:28.043698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b6a9d-9e49-4072-b7aa-59e149556301 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:28.044219 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b6a9d-9e49-4072-b7aa-59e149556301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:28.044718 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b6a9d-9e49-4072-b7aa-59e149556301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:28.045689 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b6a9d-9e49-4072-b7aa-59e149556301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:28.050886 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b6a9d-9e49-4072-b7aa-59e149556301 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:28.104843 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 881/1763] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:28.107116 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d88b8b-8144-4289-883a-50920c806ad1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:28.107645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d88b8b-8144-4289-883a-50920c806ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:28.108224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d88b8b-8144-4289-883a-50920c806ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:28.143781 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-71d88b8b-8144-4289-883a-50920c806ad1 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:28.146089 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-71d88b8b-8144-4289-883a-50920c806ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:28.146597 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 883/1764] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:28.150738 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecc779-6c91-4ee0-9993-f3a2cc9a510c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:28.150738 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-39ecc779-6c91-4ee0-9993-f3a2cc9a510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:28.161712 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 882/1765] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:28.163265 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d88b8b-8144-4289-883a-50920c806ad1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:28.164925 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-71d88b8b-8144-4289-883a-50920c806ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:28.201217 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecc779-6c91-4ee0-9993-f3a2cc9a510c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:28.210900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f61725-4dce-4938-97ff-5519e7265e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:28.211473 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61725-4dce-4938-97ff-5519e7265e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:28.211852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61725-4dce-4938-97ff-5519e7265e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:28.212177 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61725-4dce-4938-97ff-5519e7265e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:28.212895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f61725-4dce-4938-97ff-5519e7265e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:28.214509 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f61725-4dce-4938-97ff-5519e7265e12 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:28.242541 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 884/1766] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:28.244239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46bb00-de2c-4c12-9932-0a5b4d24b049 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:28.244633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46bb00-de2c-4c12-9932-0a5b4d24b049 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:28.245029 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46bb00-de2c-4c12-9932-0a5b4d24b049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:28.290891 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3a46bb00-de2c-4c12-9932-0a5b4d24b049 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:28.292504 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3a46bb00-de2c-4c12-9932-0a5b4d24b049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:28.292789 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d88b8b-8144-4289-883a-50920c806ad1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:28.300933 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed2827-de2d-4edd-965b-fcda37ddd518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:28.301669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed2827-de2d-4edd-965b-fcda37ddd518 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:28.301963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed2827-de2d-4edd-965b-fcda37ddd518 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:28.302512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed2827-de2d-4edd-965b-fcda37ddd518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:28.318614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed2827-de2d-4edd-965b-fcda37ddd518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:28.320766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed2827-de2d-4edd-965b-fcda37ddd518 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:28.325858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 885/1767] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:28.326599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46bb00-de2c-4c12-9932-0a5b4d24b049 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:28.338421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:28.343854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 883/1768] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:28.345333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46bb00-de2c-4c12-9932-0a5b4d24b049 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:28.347706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed2827-de2d-4edd-965b-fcda37ddd518 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:28.368361 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03445d03-a78e-49a2-9ba5-77eeada8ed78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:28.369562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445d03-a78e-49a2-9ba5-77eeada8ed78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:28.369951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445d03-a78e-49a2-9ba5-77eeada8ed78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:28.370444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445d03-a78e-49a2-9ba5-77eeada8ed78 admin admin] PATH_INFO: `/v3/projects/d36f30d8ed3a40ad9132f046f575d3bf/users/ea83719503194c079416dfb8845bd0ca/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:28.391031 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed2827-de2d-4edd-965b-fcda37ddd518 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:28.415678 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec95cbe-b35b-4a6c-8028-4e411bc1cad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:28.416508 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec95cbe-b35b-4a6c-8028-4e411bc1cad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:28.423557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec95cbe-b35b-4a6c-8028-4e411bc1cad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:28.423891 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec95cbe-b35b-4a6c-8028-4e411bc1cad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:28.427393 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec95cbe-b35b-4a6c-8028-4e411bc1cad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:28.427725 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec95cbe-b35b-4a6c-8028-4e411bc1cad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:28.438055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03445d03-a78e-49a2-9ba5-77eeada8ed78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36f30d8ed3a40ad9132f046f575d3bf, user_id=ea83719503194c079416dfb8845bd0ca, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:28.438607 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec95cbe-b35b-4a6c-8028-4e411bc1cad1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:28.441721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03445d03-a78e-49a2-9ba5-77eeada8ed78 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:28.491028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 886/1769] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:28 2022] PUT /identity/v3/projects/d36f30d8ed3a40ad9132f046f575d3bf/users/ea83719503194c079416dfb8845bd0ca/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:28.492752 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8a7f-70c0-4be5-9f3b-3972eb98ddc9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:28.493090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8a7f-70c0-4be5-9f3b-3972eb98ddc9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:28.493368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8a7f-70c0-4be5-9f3b-3972eb98ddc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:28.500513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 884/1770] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:28.504957 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec95cbe-b35b-4a6c-8028-4e411bc1cad1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:28.560653 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec95cbe-b35b-4a6c-8028-4e411bc1cad1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:28.639701 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ac8f8a7f-70c0-4be5-9f3b-3972eb98ddc9 None None] MFA Rules not processed for user `ea83719503194c079416dfb8845bd0ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:28.645037 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ac8f8a7f-70c0-4be5-9f3b-3972eb98ddc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:28.748702 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:28.783203 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de688460-ff80-4d3e-800f-29ad2f601ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:28.783748 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de688460-ff80-4d3e-800f-29ad2f601ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:28.784259 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de688460-ff80-4d3e-800f-29ad2f601ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:28.784529 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de688460-ff80-4d3e-800f-29ad2f601ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:28.785260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de688460-ff80-4d3e-800f-29ad2f601ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:28.799197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de688460-ff80-4d3e-800f-29ad2f601ee4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:28.825941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 887/1771] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:28.825941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f8a7f-70c0-4be5-9f3b-3972eb98ddc9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:28.825941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ac8f8a7f-70c0-4be5-9f3b-3972eb98ddc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:28.869871 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 885/1772] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:28 2022] POST /identity/v3/projects => generated 363 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:28.871327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f8a7f-70c0-4be5-9f3b-3972eb98ddc9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:28.871438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de688460-ff80-4d3e-800f-29ad2f601ee4 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:29.033004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448461b0-1731-4e73-ae5d-999168b632ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:29.036488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448461b0-1731-4e73-ae5d-999168b632ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:29.036488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448461b0-1731-4e73-ae5d-999168b632ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:29.036488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448461b0-1731-4e73-ae5d-999168b632ce admin admin] PATH_INFO: `/v3/projects/c5fcb6104ac148b7b077d0a098a57c55` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:29.038407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448461b0-1731-4e73-ae5d-999168b632ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5fcb6104ac148b7b077d0a098a57c55)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:29.041127 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448461b0-1731-4e73-ae5d-999168b632ce admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:29.137906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de688460-ff80-4d3e-800f-29ad2f601ee4 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:29.160476 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfcadd-f37e-44dc-85d2-f7861a02d966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:29.162291 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfcadd-f37e-44dc-85d2-f7861a02d966 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:29.162590 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfcadd-f37e-44dc-85d2-f7861a02d966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:29.162874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfcadd-f37e-44dc-85d2-f7861a02d966 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:29.163588 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfcadd-f37e-44dc-85d2-f7861a02d966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:29.170014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfcadd-f37e-44dc-85d2-f7861a02d966 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:29.222422 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-448461b0-1731-4e73-ae5d-999168b632ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5fcb6104ac148b7b077d0a098a57c55', 'request_id': 'req-448461b0-1731-4e73-ae5d-999168b632ce'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:29.250195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 886/1773] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:28 2022] POST /identity/v3/projects => generated 367 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:29.250999 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfcadd-f37e-44dc-85d2-f7861a02d966 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:29.252068 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-448461b0-1731-4e73-ae5d-999168b632ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5fcb6104ac148b7b077d0a098a57c55', 'request_id': 'req-448461b0-1731-4e73-ae5d-999168b632ce'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:29.262387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-448461b0-1731-4e73-ae5d-999168b632ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5fcb6104ac148b7b077d0a098a57c55', 'request_id': 'req-448461b0-1731-4e73-ae5d-999168b632ce'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:29.274935 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:29.282181 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-448461b0-1731-4e73-ae5d-999168b632ce admin admin] The token cache is being invalidate because project c5fcb6104ac148b7b077d0a098a57c55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:29.282905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-448461b0-1731-4e73-ae5d-999168b632ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:29.288274 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-448461b0-1731-4e73-ae5d-999168b632ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:29.291191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 888/1774] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:28 2022] DELETE /identity/v3/projects/c5fcb6104ac148b7b077d0a098a57c55 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:29.292224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448461b0-1731-4e73-ae5d-999168b632ce admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:29.294496 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-448461b0-1731-4e73-ae5d-999168b632ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:29.433087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfcadd-f37e-44dc-85d2-f7861a02d966 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:29.438643 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c07f1-1ac1-425a-8f92-349aa14eb0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:29.439331 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c07f1-1ac1-425a-8f92-349aa14eb0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:29.439614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c07f1-1ac1-425a-8f92-349aa14eb0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:29.439892 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c07f1-1ac1-425a-8f92-349aa14eb0c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:29.440623 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c07f1-1ac1-425a-8f92-349aa14eb0c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:29.442579 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c07f1-1ac1-425a-8f92-349aa14eb0c2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:29.473635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 887/1775] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:29 2022] POST /identity/v3/users => generated 282 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:29.474601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c07f1-1ac1-425a-8f92-349aa14eb0c2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:29.496310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cd7c07f1-1ac1-425a-8f92-349aa14eb0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:29.506931 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448461b0-1731-4e73-ae5d-999168b632ce admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:29.533443 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c07f1-1ac1-425a-8f92-349aa14eb0c2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:29.563429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c745c6-dbc2-4a1b-89bc-d8d192c6d786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:29.563429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c745c6-dbc2-4a1b-89bc-d8d192c6d786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:29.563429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c745c6-dbc2-4a1b-89bc-d8d192c6d786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:29.563429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c745c6-dbc2-4a1b-89bc-d8d192c6d786 admin admin] PATH_INFO: `/v3/projects/ab7fff4f8fc24493a4ba0010c071b8b7` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:29.563996 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c745c6-dbc2-4a1b-89bc-d8d192c6d786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7fff4f8fc24493a4ba0010c071b8b7)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:29.563996 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c745c6-dbc2-4a1b-89bc-d8d192c6d786 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:29.610848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56618df-36cf-4972-9681-840db2ebbacd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:29.613294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56618df-36cf-4972-9681-840db2ebbacd service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:29.614151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56618df-36cf-4972-9681-840db2ebbacd service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:29.614880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56618df-36cf-4972-9681-840db2ebbacd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:29.617320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a56618df-36cf-4972-9681-840db2ebbacd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:29.650424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:29.653964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56618df-36cf-4972-9681-840db2ebbacd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:29.657413 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56618df-36cf-4972-9681-840db2ebbacd service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:29.657550 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-22c745c6-dbc2-4a1b-89bc-d8d192c6d786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7fff4f8fc24493a4ba0010c071b8b7', 'request_id': 'req-22c745c6-dbc2-4a1b-89bc-d8d192c6d786'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:29.670287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-22c745c6-dbc2-4a1b-89bc-d8d192c6d786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7fff4f8fc24493a4ba0010c071b8b7', 'request_id': 'req-22c745c6-dbc2-4a1b-89bc-d8d192c6d786'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:29.684622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 889/1776] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:29.684867 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-22c745c6-dbc2-4a1b-89bc-d8d192c6d786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7fff4f8fc24493a4ba0010c071b8b7', 'request_id': 'req-22c745c6-dbc2-4a1b-89bc-d8d192c6d786'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:29.686137 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56618df-36cf-4972-9681-840db2ebbacd service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:29.688721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a56618df-36cf-4972-9681-840db2ebbacd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:29.704358 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56618df-36cf-4972-9681-840db2ebbacd service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:29.721510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-22c745c6-dbc2-4a1b-89bc-d8d192c6d786 admin admin] The token cache is being invalidate because project ab7fff4f8fc24493a4ba0010c071b8b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:29.722438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-22c745c6-dbc2-4a1b-89bc-d8d192c6d786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:29.724500 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-22c745c6-dbc2-4a1b-89bc-d8d192c6d786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:29.748057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 888/1777] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:29 2022] DELETE /identity/v3/projects/ab7fff4f8fc24493a4ba0010c071b8b7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:29.754251 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefec7a-0e9d-4c9d-bc76-61dbf8e4e463 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:29.755323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefec7a-0e9d-4c9d-bc76-61dbf8e4e463 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:29.756297 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefec7a-0e9d-4c9d-bc76-61dbf8e4e463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:29.780539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2eefec7a-0e9d-4c9d-bc76-61dbf8e4e463 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:29.782715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2eefec7a-0e9d-4c9d-bc76-61dbf8e4e463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:29.881020 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8c3f0-1f95-45a6-89ba-2b23f2a991e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:29.895568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c3f0-1f95-45a6-89ba-2b23f2a991e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:29.895568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c3f0-1f95-45a6-89ba-2b23f2a991e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:29.895568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c3f0-1f95-45a6-89ba-2b23f2a991e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:29.895568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8c3f0-1f95-45a6-89ba-2b23f2a991e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:29.904034 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8c3f0-1f95-45a6-89ba-2b23f2a991e8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:29.983072 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 890/1778] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:29 2022] POST /identity/v3/users => generated 290 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:29.983072 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8c3f0-1f95-45a6-89ba-2b23f2a991e8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:29.983072 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-52e8c3f0-1f95-45a6-89ba-2b23f2a991e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:29.998835 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 889/1779] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:30.001827 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefec7a-0e9d-4c9d-bc76-61dbf8e4e463 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:30.007310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2eefec7a-0e9d-4c9d-bc76-61dbf8e4e463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:30.041323 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8c3f0-1f95-45a6-89ba-2b23f2a991e8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:30.062668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547eaf8-4488-4e4c-ac57-4109b353f889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:30.063468 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547eaf8-4488-4e4c-ac57-4109b353f889 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:30.063654 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547eaf8-4488-4e4c-ac57-4109b353f889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:30.063979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547eaf8-4488-4e4c-ac57-4109b353f889 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:30.064820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547eaf8-4488-4e4c-ac57-4109b353f889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:30.074335 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547eaf8-4488-4e4c-ac57-4109b353f889 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:30.098813 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 891/1780] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:30.101783 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f0652-ba8a-4ea6-9b17-6f121f106397 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:30.103763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f0652-ba8a-4ea6-9b17-6f121f106397 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:30.104279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f0652-ba8a-4ea6-9b17-6f121f106397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:30.150595 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:30.181691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefec7a-0e9d-4c9d-bc76-61dbf8e4e463 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:30.196097 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331fcc2-7027-4d76-8523-a502ea88c84a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:30.196783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331fcc2-7027-4d76-8523-a502ea88c84a service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:30.197116 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331fcc2-7027-4d76-8523-a502ea88c84a service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:30.197403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331fcc2-7027-4d76-8523-a502ea88c84a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:30.197713 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8e3f0652-ba8a-4ea6-9b17-6f121f106397 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:30.199080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8e3f0652-ba8a-4ea6-9b17-6f121f106397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:30.202242 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d331fcc2-7027-4d76-8523-a502ea88c84a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:30.239712 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 892/1781] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:30.244425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f0652-ba8a-4ea6-9b17-6f121f106397 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:30.248736 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8e3f0652-ba8a-4ea6-9b17-6f121f106397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:30.278307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f0652-ba8a-4ea6-9b17-6f121f106397 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:30.292549 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdbde7-7bbe-4085-9eab-c4b4d1122f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:30.293963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdbde7-7bbe-4085-9eab-c4b4d1122f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:30.293963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdbde7-7bbe-4085-9eab-c4b4d1122f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:30.293963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdbde7-7bbe-4085-9eab-c4b4d1122f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:30.294956 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdbde7-7bbe-4085-9eab-c4b4d1122f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:30.297372 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdbde7-7bbe-4085-9eab-c4b4d1122f82 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:30.323792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 893/1782] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:30.325228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95404b-fee9-4360-a045-794afa0e8957 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:30.325623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95404b-fee9-4360-a045-794afa0e8957 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:30.326004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95404b-fee9-4360-a045-794afa0e8957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:30.358447 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331fcc2-7027-4d76-8523-a502ea88c84a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:30.360125 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331fcc2-7027-4d76-8523-a502ea88c84a service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:30.376415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 890/1783] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:30.388015 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331fcc2-7027-4d76-8523-a502ea88c84a service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:30.407184 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3b95404b-fee9-4360-a045-794afa0e8957 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:30.409224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331fcc2-7027-4d76-8523-a502ea88c84a service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:30.412257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3b95404b-fee9-4360-a045-794afa0e8957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:30.414515 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b14e0-547d-4f92-a34e-3778e777a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:30.415485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b14e0-547d-4f92-a34e-3778e777a411 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:30.415825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b14e0-547d-4f92-a34e-3778e777a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:30.416141 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b14e0-547d-4f92-a34e-3778e777a411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:30.420467 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b14e0-547d-4f92-a34e-3778e777a411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:30.428009 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b14e0-547d-4f92-a34e-3778e777a411 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:30.446600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 894/1784] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:30.447290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 891/1785] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:30.448307 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b14e0-547d-4f92-a34e-3778e777a411 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:30.449600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea8d91-55c2-4670-90b0-4a6df6258cd9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:30.450125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea8d91-55c2-4670-90b0-4a6df6258cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:30.456684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea8d91-55c2-4670-90b0-4a6df6258cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:30.471636 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b14e0-547d-4f92-a34e-3778e777a411 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:30.490527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69a587-2056-4b18-96e5-c7271a8ae2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:30.491469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69a587-2056-4b18-96e5-c7271a8ae2c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:30.491802 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69a587-2056-4b18-96e5-c7271a8ae2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:30.492127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69a587-2056-4b18-96e5-c7271a8ae2c9 admin admin] PATH_INFO: `/v3/projects/a0c501e54c6f4eea8e9066791066476a/users/2823bff9cd6c47158842c24fbc4d7b1e/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:30.512995 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-bdea8d91-55c2-4670-90b0-4a6df6258cd9 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:30.514357 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:30.517518 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bdea8d91-55c2-4670-90b0-4a6df6258cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:30.522703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69a587-2056-4b18-96e5-c7271a8ae2c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c501e54c6f4eea8e9066791066476a, user_id=2823bff9cd6c47158842c24fbc4d7b1e, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:30.525776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69a587-2056-4b18-96e5-c7271a8ae2c9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:30.554101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 892/1786] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:30 2022] PUT /identity/v3/projects/a0c501e54c6f4eea8e9066791066476a/users/2823bff9cd6c47158842c24fbc4d7b1e/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:30.555137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69a587-2056-4b18-96e5-c7271a8ae2c9 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:30.559219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 895/1787] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:30.560314 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea8d91-55c2-4670-90b0-4a6df6258cd9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:30.586423 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea8d91-55c2-4670-90b0-4a6df6258cd9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:30.692457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69a587-2056-4b18-96e5-c7271a8ae2c9 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:30.707512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bd9f6-6692-45fe-a7a9-a246dfe32464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:30.708477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bd9f6-6692-45fe-a7a9-a246dfe32464 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:30.708768 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bd9f6-6692-45fe-a7a9-a246dfe32464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:30.709052 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bd9f6-6692-45fe-a7a9-a246dfe32464 admin admin] PATH_INFO: `/v3/projects/8badc71441ac451f87463526981e4910/users/99c4dd7013614b3ba85ed83bbf7279ad/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:30.751595 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bd9f6-6692-45fe-a7a9-a246dfe32464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8badc71441ac451f87463526981e4910, user_id=99c4dd7013614b3ba85ed83bbf7279ad, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:30.754921 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bd9f6-6692-45fe-a7a9-a246dfe32464 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:30.791225 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b3a08-424d-4c67-b63a-d915fffc7036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:30.792887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 893/1788] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:30 2022] PUT /identity/v3/projects/8badc71441ac451f87463526981e4910/users/99c4dd7013614b3ba85ed83bbf7279ad/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:30.803673 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bd9f6-6692-45fe-a7a9-a246dfe32464 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:30.805678 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b3a08-424d-4c67-b63a-d915fffc7036 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:30.808246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b3a08-424d-4c67-b63a-d915fffc7036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:30.808806 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b3a08-424d-4c67-b63a-d915fffc7036 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:30.811426 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b3a08-424d-4c67-b63a-d915fffc7036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:30.813163 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b3a08-424d-4c67-b63a-d915fffc7036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:30.817598 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b3a08-424d-4c67-b63a-d915fffc7036 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:30.856207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 896/1789] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:30.858052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b3a08-424d-4c67-b63a-d915fffc7036 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:30.884710 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b3a08-424d-4c67-b63a-d915fffc7036 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:30.893228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bd9f6-6692-45fe-a7a9-a246dfe32464 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:30.898950 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff061530-4a79-4ff6-a3d8-6fe9e7e7a8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:30.899981 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff061530-4a79-4ff6-a3d8-6fe9e7e7a8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:30.900225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4678af-0226-48cc-a1f6-24651b40dcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:30.900790 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff061530-4a79-4ff6-a3d8-6fe9e7e7a8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:30.900904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4678af-0226-48cc-a1f6-24651b40dcad admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:30.901192 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4678af-0226-48cc-a1f6-24651b40dcad admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:30.901466 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4678af-0226-48cc-a1f6-24651b40dcad admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:30.901889 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff061530-4a79-4ff6-a3d8-6fe9e7e7a8e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:30.902346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4678af-0226-48cc-a1f6-24651b40dcad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:30.903061 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff061530-4a79-4ff6-a3d8-6fe9e7e7a8e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:30.903613 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff061530-4a79-4ff6-a3d8-6fe9e7e7a8e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:30.911255 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4678af-0226-48cc-a1f6-24651b40dcad admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:30.912201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff061530-4a79-4ff6-a3d8-6fe9e7e7a8e1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:30.927634 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 894/1790] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:30.929145 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f32e26-cafe-43bd-beeb-2a578a4287b8 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:30.929452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f32e26-cafe-43bd-beeb-2a578a4287b8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:30.930047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f32e26-cafe-43bd-beeb-2a578a4287b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:30.939665 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 897/1791] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:30.941239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff061530-4a79-4ff6-a3d8-6fe9e7e7a8e1 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:30.957913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff061530-4a79-4ff6-a3d8-6fe9e7e7a8e1 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:30.965267 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba17349-d0f7-4cd1-82ca-2c875eba2eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:30.966143 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba17349-d0f7-4cd1-82ca-2c875eba2eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:30.969995 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba17349-d0f7-4cd1-82ca-2c875eba2eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:30.970433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba17349-d0f7-4cd1-82ca-2c875eba2eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:30.974232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-74f32e26-cafe-43bd-beeb-2a578a4287b8 None None] MFA Rules not processed for user `99c4dd7013614b3ba85ed83bbf7279ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:30.975281 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba17349-d0f7-4cd1-82ca-2c875eba2eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:30.975772 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-74f32e26-cafe-43bd-beeb-2a578a4287b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:30.982404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba17349-d0f7-4cd1-82ca-2c875eba2eb7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:31.028644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 898/1792] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:30 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:31.029483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba17349-d0f7-4cd1-82ca-2c875eba2eb7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:31.096685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:31.103983 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 895/1793] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:30 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:31.103983 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f32e26-cafe-43bd-beeb-2a578a4287b8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:31.121677 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f32e26-cafe-43bd-beeb-2a578a4287b8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:31.149180 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba17349-d0f7-4cd1-82ca-2c875eba2eb7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:31.154717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d6524-87f5-4070-be5f-464f32a737c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:31.155779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d6524-87f5-4070-be5f-464f32a737c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.155951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d6524-87f5-4070-be5f-464f32a737c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.156355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d6524-87f5-4070-be5f-464f32a737c7 admin admin] PATH_INFO: `/v3/projects/a0c501e54c6f4eea8e9066791066476a/users/2823bff9cd6c47158842c24fbc4d7b1e/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.158461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d6524-87f5-4070-be5f-464f32a737c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c501e54c6f4eea8e9066791066476a, user_id=2823bff9cd6c47158842c24fbc4d7b1e, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:31.161154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d6524-87f5-4070-be5f-464f32a737c7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:31.174284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 899/1794] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:31 2022] PUT /identity/v3/projects/a0c501e54c6f4eea8e9066791066476a/users/2823bff9cd6c47158842c24fbc4d7b1e/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:31.175424 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d6524-87f5-4070-be5f-464f32a737c7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:31.193718 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d56d15-6727-4501-9884-3aa5a8bfdddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:31.194552 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56d15-6727-4501-9884-3aa5a8bfdddd admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.195255 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56d15-6727-4501-9884-3aa5a8bfdddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.195255 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56d15-6727-4501-9884-3aa5a8bfdddd admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.195931 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d56d15-6727-4501-9884-3aa5a8bfdddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:31.197855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d56d15-6727-4501-9884-3aa5a8bfdddd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:31.216935 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:31.239745 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 896/1795] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:31 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:31.240732 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d56d15-6727-4501-9884-3aa5a8bfdddd admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:31.264167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d6524-87f5-4070-be5f-464f32a737c7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:31.328979 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d56d15-6727-4501-9884-3aa5a8bfdddd admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:31.335864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a352c-c334-4ec9-b109-edd32279785e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:31.336395 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49660284-d256-4055-9126-4ebf85f84037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:31.337088 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a352c-c334-4ec9-b109-edd32279785e admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.337363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49660284-d256-4055-9126-4ebf85f84037 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.337654 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49660284-d256-4055-9126-4ebf85f84037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.337913 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a352c-c334-4ec9-b109-edd32279785e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.338046 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49660284-d256-4055-9126-4ebf85f84037 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.338728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49660284-d256-4055-9126-4ebf85f84037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:31.339181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a352c-c334-4ec9-b109-edd32279785e admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.340122 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a352c-c334-4ec9-b109-edd32279785e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:31.340935 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49660284-d256-4055-9126-4ebf85f84037 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:31.342713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a352c-c334-4ec9-b109-edd32279785e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:31.376554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 900/1796] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:31 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:31.376554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c16364-943b-4817-8ffb-93c922e8bf52 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.376554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c16364-943b-4817-8ffb-93c922e8bf52 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.376554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c16364-943b-4817-8ffb-93c922e8bf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.399739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 897/1797] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:31 2022] POST /identity/v3/projects => generated 363 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:31.400654 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a352c-c334-4ec9-b109-edd32279785e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:31.406847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-19c16364-943b-4817-8ffb-93c922e8bf52 None None] MFA Rules not processed for user `2823bff9cd6c47158842c24fbc4d7b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:31.408067 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-19c16364-943b-4817-8ffb-93c922e8bf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:31.480289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a352c-c334-4ec9-b109-edd32279785e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:31.486017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf6cc0-d5ca-4cd8-bee7-9cdf8e842b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:31.486790 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 901/1798] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:31.487036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf6cc0-d5ca-4cd8-bee7-9cdf8e842b2f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.487371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf6cc0-d5ca-4cd8-bee7-9cdf8e842b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.487677 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf6cc0-d5ca-4cd8-bee7-9cdf8e842b2f admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.488045 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34efdb-f1c0-4d18-a373-e87dcf52010d None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.488273 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34efdb-f1c0-4d18-a373-e87dcf52010d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.488554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34efdb-f1c0-4d18-a373-e87dcf52010d None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.488728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf6cc0-d5ca-4cd8-bee7-9cdf8e842b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:31.490309 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 902/1799] 10.222.0.73 () {54 vars in 921 bytes} [Thu May 19 12:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:09:31.491077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34efdb-f1c0-4d18-a373-e87dcf52010d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:31.491286 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf6cc0-d5ca-4cd8-bee7-9cdf8e842b2f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:31.504454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34efdb-f1c0-4d18-a373-e87dcf52010d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:31.509297 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:31.509481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc97aa-8c58-419e-955f-247db4ef813b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:31.510450 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc97aa-8c58-419e-955f-247db4ef813b admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.510572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc97aa-8c58-419e-955f-247db4ef813b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.510873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc97aa-8c58-419e-955f-247db4ef813b admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.511580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc97aa-8c58-419e-955f-247db4ef813b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:31.513209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc97aa-8c58-419e-955f-247db4ef813b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:31.518693 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 898/1800] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:31 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:31.518693 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf6cc0-d5ca-4cd8-bee7-9cdf8e842b2f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:31.527275 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf6cc0-d5ca-4cd8-bee7-9cdf8e842b2f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:31.530197 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 903/1801] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:31.532194 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384d6be-31d8-4462-b951-112c4dfb7462 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.532616 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384d6be-31d8-4462-b951-112c4dfb7462 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.532913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384d6be-31d8-4462-b951-112c4dfb7462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.533160 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19517679-7d52-4600-8838-9f71b1689dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:31.533830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19517679-7d52-4600-8838-9f71b1689dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.534110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19517679-7d52-4600-8838-9f71b1689dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.534388 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19517679-7d52-4600-8838-9f71b1689dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.535072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19517679-7d52-4600-8838-9f71b1689dc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:31.537087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19517679-7d52-4600-8838-9f71b1689dc1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:31.551870 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0384d6be-31d8-4462-b951-112c4dfb7462 None None] MFA Rules not processed for user `bd0c1f0710f3447d94e67048a508781e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:31.553133 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0384d6be-31d8-4462-b951-112c4dfb7462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:31.557626 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 899/1802] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:31 2022] POST /identity/v3/users => generated 288 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:31.558856 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19517679-7d52-4600-8838-9f71b1689dc1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:31.585749 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:31.616786 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19517679-7d52-4600-8838-9f71b1689dc1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:31.620442 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fbdfa-22ed-4216-b590-ad2c4d7c6370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:31.621097 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fbdfa-22ed-4216-b590-ad2c4d7c6370 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.621390 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fbdfa-22ed-4216-b590-ad2c4d7c6370 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.621668 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fbdfa-22ed-4216-b590-ad2c4d7c6370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.625639 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 904/1803] 10.222.0.73 () {58 vars in 1018 bytes} [Thu May 19 12:09:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:31.629044 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384d6be-31d8-4462-b951-112c4dfb7462 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:31.633447 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fbdfa-22ed-4216-b590-ad2c4d7c6370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:31.634883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fbdfa-22ed-4216-b590-ad2c4d7c6370 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:31.641948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384d6be-31d8-4462-b951-112c4dfb7462 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:31.645235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 900/1804] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:31.646129 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fbdfa-22ed-4216-b590-ad2c4d7c6370 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:31.647140 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323a948-5474-4b31-8352-72fd41532f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:31.647805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323a948-5474-4b31-8352-72fd41532f81 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.648184 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323a948-5474-4b31-8352-72fd41532f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.648464 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323a948-5474-4b31-8352-72fd41532f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.649219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323a948-5474-4b31-8352-72fd41532f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:31.650812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323a948-5474-4b31-8352-72fd41532f81 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:31.659077 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fbdfa-22ed-4216-b590-ad2c4d7c6370 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:31.666558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 905/1805] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:31.666715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dec675-0075-49bf-96b9-e6ae604fff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:31.666835 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323a948-5474-4b31-8352-72fd41532f81 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:31.666925 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dec675-0075-49bf-96b9-e6ae604fff7a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.666925 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dec675-0075-49bf-96b9-e6ae604fff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.666925 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dec675-0075-49bf-96b9-e6ae604fff7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.666925 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dec675-0075-49bf-96b9-e6ae604fff7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:31.668294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dec675-0075-49bf-96b9-e6ae604fff7a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:31.679004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323a948-5474-4b31-8352-72fd41532f81 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:31.684185 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 901/1806] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:31.684185 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dec675-0075-49bf-96b9-e6ae604fff7a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:31.685672 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-67dec675-0075-49bf-96b9-e6ae604fff7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:31.690941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5c77f-d939-47c5-9aba-8c1534a83a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:31.691775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5c77f-d939-47c5-9aba-8c1534a83a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.692096 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5c77f-d939-47c5-9aba-8c1534a83a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.692378 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5c77f-d939-47c5-9aba-8c1534a83a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.693113 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5c77f-d939-47c5-9aba-8c1534a83a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:31.694702 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5c77f-d939-47c5-9aba-8c1534a83a4b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:31.702576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dec675-0075-49bf-96b9-e6ae604fff7a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:31.707124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 906/1807] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:31.707822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5c77f-d939-47c5-9aba-8c1534a83a4b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:31.709010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebf69d-c754-4dc1-b51b-6b84adb7b06a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:31.709669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebf69d-c754-4dc1-b51b-6b84adb7b06a service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.710098 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebf69d-c754-4dc1-b51b-6b84adb7b06a service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.710242 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebf69d-c754-4dc1-b51b-6b84adb7b06a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.717620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5c77f-d939-47c5-9aba-8c1534a83a4b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:31.721144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebf69d-c754-4dc1-b51b-6b84adb7b06a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:31.722877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebf69d-c754-4dc1-b51b-6b84adb7b06a service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:31.723093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760d873-d41f-42c7-95e3-b9cfc12cc1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:31.729363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760d873-d41f-42c7-95e3-b9cfc12cc1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.729363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760d873-d41f-42c7-95e3-b9cfc12cc1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.729363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760d873-d41f-42c7-95e3-b9cfc12cc1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.729363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760d873-d41f-42c7-95e3-b9cfc12cc1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:31.729363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760d873-d41f-42c7-95e3-b9cfc12cc1d6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:31.736692 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 902/1808] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:31.737364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebf69d-c754-4dc1-b51b-6b84adb7b06a service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:31.743559 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 907/1809] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:31.743559 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760d873-d41f-42c7-95e3-b9cfc12cc1d6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:31.749957 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebf69d-c754-4dc1-b51b-6b84adb7b06a service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:31.756266 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760d873-d41f-42c7-95e3-b9cfc12cc1d6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:31.756485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e8077-63b2-45b2-a9b3-3f42159fa5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:31.757379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e8077-63b2-45b2-a9b3-3f42159fa5b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.757664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e8077-63b2-45b2-a9b3-3f42159fa5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.757943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e8077-63b2-45b2-a9b3-3f42159fa5b2 admin admin] PATH_INFO: `/v3/projects/389ca4b427e645848f074325d8011152/users/f223cadd809c4b63b9a360607cb96f4b/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.764266 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a4553-7333-487e-8f87-ec921ec71746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:31.765838 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a4553-7333-487e-8f87-ec921ec71746 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.766662 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a4553-7333-487e-8f87-ec921ec71746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.766951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a4553-7333-487e-8f87-ec921ec71746 admin admin] PATH_INFO: `/v3/projects/58a21d162d0c49fc9f7b0399c617c41f/users/a4cc7fda2b01474eabfc2bd7a2307c50/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.782198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e8077-63b2-45b2-a9b3-3f42159fa5b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389ca4b427e645848f074325d8011152, user_id=f223cadd809c4b63b9a360607cb96f4b, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:31.785405 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e8077-63b2-45b2-a9b3-3f42159fa5b2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:31.787041 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a4553-7333-487e-8f87-ec921ec71746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58a21d162d0c49fc9f7b0399c617c41f, user_id=a4cc7fda2b01474eabfc2bd7a2307c50, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:31.791025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a4553-7333-487e-8f87-ec921ec71746 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:31.811673 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 908/1810] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:31 2022] PUT /identity/v3/projects/58a21d162d0c49fc9f7b0399c617c41f/users/a4cc7fda2b01474eabfc2bd7a2307c50/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:31.814152 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 903/1811] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:31 2022] PUT /identity/v3/projects/389ca4b427e645848f074325d8011152/users/f223cadd809c4b63b9a360607cb96f4b/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:31.816220 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a4553-7333-487e-8f87-ec921ec71746 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:31.816369 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e8077-63b2-45b2-a9b3-3f42159fa5b2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:31.942052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a4553-7333-487e-8f87-ec921ec71746 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:31.948070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a6953-38e9-47e0-92c7-0f675e002635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:31.948857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a6953-38e9-47e0-92c7-0f675e002635 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.950557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e8077-63b2-45b2-a9b3-3f42159fa5b2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:31.952146 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a6953-38e9-47e0-92c7-0f675e002635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.952996 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a6953-38e9-47e0-92c7-0f675e002635 admin admin] PATH_INFO: `/v3/projects/c3d167eadb2d48f4957e2cf54e88072e/users/7b968a2a3ed3459188f5aa8e8b216180/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.970915 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422314cf-f508-4faa-a0c4-4b170d897f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:31.971852 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422314cf-f508-4faa-a0c4-4b170d897f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:31.972660 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422314cf-f508-4faa-a0c4-4b170d897f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:31.972660 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422314cf-f508-4faa-a0c4-4b170d897f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:31.973892 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422314cf-f508-4faa-a0c4-4b170d897f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:31.977437 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422314cf-f508-4faa-a0c4-4b170d897f43 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:31.987670 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a6953-38e9-47e0-92c7-0f675e002635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d167eadb2d48f4957e2cf54e88072e, user_id=7b968a2a3ed3459188f5aa8e8b216180, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:31.991792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a6953-38e9-47e0-92c7-0f675e002635 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:32.000180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 904/1812] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:32.000180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df7324-0cdd-45b1-88a2-807bdfedb99e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:32.000180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df7324-0cdd-45b1-88a2-807bdfedb99e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:32.000180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df7324-0cdd-45b1-88a2-807bdfedb99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:32.031783 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 909/1813] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:31 2022] PUT /identity/v3/projects/c3d167eadb2d48f4957e2cf54e88072e/users/7b968a2a3ed3459188f5aa8e8b216180/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:32.041657 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a6953-38e9-47e0-92c7-0f675e002635 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:32.062545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-23df7324-0cdd-45b1-88a2-807bdfedb99e None None] MFA Rules not processed for user `f223cadd809c4b63b9a360607cb96f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:32.064007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-23df7324-0cdd-45b1-88a2-807bdfedb99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:32.115364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:32.130731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:32.147688 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a6953-38e9-47e0-92c7-0f675e002635 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:32.156805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c5af5-c3ba-4c0d-a9bb-1dd0c1ec64a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:32.157786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c5af5-c3ba-4c0d-a9bb-1dd0c1ec64a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:32.158083 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c5af5-c3ba-4c0d-a9bb-1dd0c1ec64a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:32.158418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c5af5-c3ba-4c0d-a9bb-1dd0c1ec64a8 admin admin] PATH_INFO: `/v3/projects/58a21d162d0c49fc9f7b0399c617c41f/users/a4cc7fda2b01474eabfc2bd7a2307c50/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:32.160805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c5af5-c3ba-4c0d-a9bb-1dd0c1ec64a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58a21d162d0c49fc9f7b0399c617c41f, user_id=a4cc7fda2b01474eabfc2bd7a2307c50, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:32.164277 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c5af5-c3ba-4c0d-a9bb-1dd0c1ec64a8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:32.179821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 910/1814] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:32 2022] PUT /identity/v3/projects/58a21d162d0c49fc9f7b0399c617c41f/users/a4cc7fda2b01474eabfc2bd7a2307c50/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:32.181208 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc5b60-516e-4128-af2d-b23e823c63c5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:32.181506 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc5b60-516e-4128-af2d-b23e823c63c5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:32.181793 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc5b60-516e-4128-af2d-b23e823c63c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:32.193271 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 905/1815] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:32.194692 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2510e1-fd1c-484e-8ee0-ee892a8457e6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:32.195253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2510e1-fd1c-484e-8ee0-ee892a8457e6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:32.195253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2510e1-fd1c-484e-8ee0-ee892a8457e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:32.214157 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-21dc5b60-516e-4128-af2d-b23e823c63c5 None None] MFA Rules not processed for user `7b968a2a3ed3459188f5aa8e8b216180`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:32.215386 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-21dc5b60-516e-4128-af2d-b23e823c63c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:32.227072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-fe2510e1-fd1c-484e-8ee0-ee892a8457e6 None None] MFA Rules not processed for user `a4cc7fda2b01474eabfc2bd7a2307c50`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:32.228359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-fe2510e1-fd1c-484e-8ee0-ee892a8457e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:32.294909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 911/1816] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:32.296198 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc5b60-516e-4128-af2d-b23e823c63c5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:32.334688 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 906/1817] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:32 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:32.335671 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2510e1-fd1c-484e-8ee0-ee892a8457e6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:32.385724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc5b60-516e-4128-af2d-b23e823c63c5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:32.394039 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b77e5-8e1a-452d-8a34-619d2fea7950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:32.395179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b77e5-8e1a-452d-8a34-619d2fea7950 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:32.395512 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b77e5-8e1a-452d-8a34-619d2fea7950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:32.395795 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b77e5-8e1a-452d-8a34-619d2fea7950 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:32.396652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b77e5-8e1a-452d-8a34-619d2fea7950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:32.398764 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b77e5-8e1a-452d-8a34-619d2fea7950 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:32.428736 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 912/1818] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:32 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:32.430239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b77e5-8e1a-452d-8a34-619d2fea7950 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:32.436179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2510e1-fd1c-484e-8ee0-ee892a8457e6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:32.494169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:32.497363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b77e5-8e1a-452d-8a34-619d2fea7950 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:32.501849 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6790be-2500-4a3a-a140-e27b8cd18b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:32.502570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6790be-2500-4a3a-a140-e27b8cd18b3e service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:32.503176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6790be-2500-4a3a-a140-e27b8cd18b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:32.503525 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6790be-2500-4a3a-a140-e27b8cd18b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:32.504397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1add6d-f3a0-4b5b-8b27-8bd067b58a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:32.505070 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1add6d-f3a0-4b5b-8b27-8bd067b58a85 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:32.505359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1add6d-f3a0-4b5b-8b27-8bd067b58a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:32.505680 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1add6d-f3a0-4b5b-8b27-8bd067b58a85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:32.506392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1add6d-f3a0-4b5b-8b27-8bd067b58a85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:32.508271 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1add6d-f3a0-4b5b-8b27-8bd067b58a85 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:32.520166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:32.555819 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 907/1819] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:32 2022] POST /identity/v3/projects => generated 381 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:32.556737 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1add6d-f3a0-4b5b-8b27-8bd067b58a85 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:32.579816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6790be-2500-4a3a-a140-e27b8cd18b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:32.581362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6790be-2500-4a3a-a140-e27b8cd18b3e service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:32.591830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 913/1820] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:32 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:32.594590 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6790be-2500-4a3a-a140-e27b8cd18b3e service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:32.608085 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6790be-2500-4a3a-a140-e27b8cd18b3e service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:32.648023 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1add6d-f3a0-4b5b-8b27-8bd067b58a85 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:32.662430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed6bb6-621e-48bc-9ec0-148789c6b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:32.663227 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6bb6-621e-48bc-9ec0-148789c6b3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:32.663531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6bb6-621e-48bc-9ec0-148789c6b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:32.663825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6bb6-621e-48bc-9ec0-148789c6b3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:32.666002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed6bb6-621e-48bc-9ec0-148789c6b3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:32.668031 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed6bb6-621e-48bc-9ec0-148789c6b3a0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:32.681663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b16820-b3b2-40ac-90d9-4db2f20917e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:32.682334 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b16820-b3b2-40ac-90d9-4db2f20917e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:32.682572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b16820-b3b2-40ac-90d9-4db2f20917e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:32.682855 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b16820-b3b2-40ac-90d9-4db2f20917e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:32.683563 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b16820-b3b2-40ac-90d9-4db2f20917e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:32.686216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b16820-b3b2-40ac-90d9-4db2f20917e9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:32.710291 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 908/1821] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:32 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:32.712938 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 914/1822] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:32 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:32.714761 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed6bb6-621e-48bc-9ec0-148789c6b3a0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:32.719187 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b16820-b3b2-40ac-90d9-4db2f20917e9 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:32.727053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed6bb6-621e-48bc-9ec0-148789c6b3a0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:32.730834 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b16820-b3b2-40ac-90d9-4db2f20917e9 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:32.733312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fa325-9c88-4247-a251-c9f6e21a1c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:32.734600 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fa325-9c88-4247-a251-c9f6e21a1c38 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:32.734803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fa325-9c88-4247-a251-c9f6e21a1c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:32.735130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fa325-9c88-4247-a251-c9f6e21a1c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:32.739245 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579fa325-9c88-4247-a251-c9f6e21a1c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:32.739245 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579fa325-9c88-4247-a251-c9f6e21a1c38 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:32.740699 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b004401-3bee-4d4d-be2b-e82ad7ffe29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:32.741421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b004401-3bee-4d4d-be2b-e82ad7ffe29d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:32.741740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b004401-3bee-4d4d-be2b-e82ad7ffe29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:32.742029 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b004401-3bee-4d4d-be2b-e82ad7ffe29d admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:32.742777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b004401-3bee-4d4d-be2b-e82ad7ffe29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:32.745467 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b004401-3bee-4d4d-be2b-e82ad7ffe29d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:32.749327 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 909/1823] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:09:32.754866 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fa325-9c88-4247-a251-c9f6e21a1c38 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:32.756059 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 915/1824] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:32.756898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b004401-3bee-4d4d-be2b-e82ad7ffe29d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:32.767240 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b004401-3bee-4d4d-be2b-e82ad7ffe29d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:32.773934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90738de-a5e7-495d-a02b-3ce3f1fc2f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:32.775484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90738de-a5e7-495d-a02b-3ce3f1fc2f49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:32.775832 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90738de-a5e7-495d-a02b-3ce3f1fc2f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:32.776254 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90738de-a5e7-495d-a02b-3ce3f1fc2f49 admin admin] PATH_INFO: `/v3/projects/1f2c787dadc84b73b650ec8d85f411ac/users/b3d8bef72e754336b5ebbb6b9f3e904b/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:32.796013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90738de-a5e7-495d-a02b-3ce3f1fc2f49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f2c787dadc84b73b650ec8d85f411ac, user_id=b3d8bef72e754336b5ebbb6b9f3e904b, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:32.799249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90738de-a5e7-495d-a02b-3ce3f1fc2f49 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:32.816960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 916/1825] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:32 2022] PUT /identity/v3/projects/1f2c787dadc84b73b650ec8d85f411ac/users/b3d8bef72e754336b5ebbb6b9f3e904b/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:32.818151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90738de-a5e7-495d-a02b-3ce3f1fc2f49 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:32.839929 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fa325-9c88-4247-a251-c9f6e21a1c38 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:32.893003 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90738de-a5e7-495d-a02b-3ce3f1fc2f49 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:32.898298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe51dbd-ba31-4911-9ea9-2f948022b727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:32.899379 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe51dbd-ba31-4911-9ea9-2f948022b727 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:32.899667 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe51dbd-ba31-4911-9ea9-2f948022b727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:32.900007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe51dbd-ba31-4911-9ea9-2f948022b727 admin admin] PATH_INFO: `/v3/projects/18cea87f474f4ff2b194df96d4cebd3a/users/8b429597bfb2429396b61838d4cfea24/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:32.913627 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:32.914304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698f78d-eca6-4346-ad85-9642e0c1984e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:32.915290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f78d-eca6-4346-ad85-9642e0c1984e service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:32.915654 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f78d-eca6-4346-ad85-9642e0c1984e service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:32.916049 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f78d-eca6-4346-ad85-9642e0c1984e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:32.920116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe51dbd-ba31-4911-9ea9-2f948022b727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18cea87f474f4ff2b194df96d4cebd3a, user_id=8b429597bfb2429396b61838d4cfea24, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:32.924413 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe51dbd-ba31-4911-9ea9-2f948022b727 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:32.940437 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 917/1826] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:32 2022] PUT /identity/v3/projects/18cea87f474f4ff2b194df96d4cebd3a/users/8b429597bfb2429396b61838d4cfea24/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:32.944057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe51dbd-ba31-4911-9ea9-2f948022b727 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:32.953520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:32.992688 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698f78d-eca6-4346-ad85-9642e0c1984e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:32.994323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698f78d-eca6-4346-ad85-9642e0c1984e service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:33.004368 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 910/1827] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:33.005065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698f78d-eca6-4346-ad85-9642e0c1984e service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:33.016219 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698f78d-eca6-4346-ad85-9642e0c1984e service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:33.021533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed0d0a-1d33-4205-a20f-7bfdcce1052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:33.022354 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed0d0a-1d33-4205-a20f-7bfdcce1052e admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:33.022710 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed0d0a-1d33-4205-a20f-7bfdcce1052e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:33.023162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed0d0a-1d33-4205-a20f-7bfdcce1052e admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:33.023936 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed0d0a-1d33-4205-a20f-7bfdcce1052e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:33.025602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed0d0a-1d33-4205-a20f-7bfdcce1052e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:33.027502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe51dbd-ba31-4911-9ea9-2f948022b727 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:33.040714 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8b4ff-87d2-46be-878e-497b99828039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:33.041655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8b4ff-87d2-46be-878e-497b99828039 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:33.044479 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8b4ff-87d2-46be-878e-497b99828039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:33.044960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8b4ff-87d2-46be-878e-497b99828039 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:33.046818 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8b4ff-87d2-46be-878e-497b99828039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:33.050438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 911/1828] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:33.050780 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8b4ff-87d2-46be-878e-497b99828039 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:33.051790 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed0d0a-1d33-4205-a20f-7bfdcce1052e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:33.069206 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed0d0a-1d33-4205-a20f-7bfdcce1052e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:33.074882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 918/1829] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:33.077487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff08ca-156b-48da-89ab-aa452e2d4e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:33.078566 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff08ca-156b-48da-89ab-aa452e2d4e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:33.078857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff08ca-156b-48da-89ab-aa452e2d4e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:33.078972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8b4ff-87d2-46be-878e-497b99828039 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:33.079155 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff08ca-156b-48da-89ab-aa452e2d4e70 admin admin] PATH_INFO: `/v3/projects/18cea87f474f4ff2b194df96d4cebd3a/users/8b429597bfb2429396b61838d4cfea24/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:33.081340 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff08ca-156b-48da-89ab-aa452e2d4e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18cea87f474f4ff2b194df96d4cebd3a, user_id=8b429597bfb2429396b61838d4cfea24, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:33.084934 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff08ca-156b-48da-89ab-aa452e2d4e70 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:33.088971 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8b4ff-87d2-46be-878e-497b99828039 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:33.094396 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a087b-183b-4585-83c8-0dbb415728f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:33.095291 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a087b-183b-4585-83c8-0dbb415728f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:33.095574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a087b-183b-4585-83c8-0dbb415728f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:33.095855 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a087b-183b-4585-83c8-0dbb415728f1 admin admin] PATH_INFO: `/v3/projects/1f2c787dadc84b73b650ec8d85f411ac/users/b3d8bef72e754336b5ebbb6b9f3e904b/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:33.098225 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a087b-183b-4585-83c8-0dbb415728f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f2c787dadc84b73b650ec8d85f411ac, user_id=b3d8bef72e754336b5ebbb6b9f3e904b, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:33.099991 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 912/1830] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:33 2022] PUT /identity/v3/projects/18cea87f474f4ff2b194df96d4cebd3a/users/8b429597bfb2429396b61838d4cfea24/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:09:33.101031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a087b-183b-4585-83c8-0dbb415728f1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:33.110519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a295d6-0dfb-4f8d-9f1c-91950190cbb5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:33.111343 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a295d6-0dfb-4f8d-9f1c-91950190cbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:33.111971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a295d6-0dfb-4f8d-9f1c-91950190cbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:33.157862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 919/1831] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:33 2022] PUT /identity/v3/projects/1f2c787dadc84b73b650ec8d85f411ac/users/b3d8bef72e754336b5ebbb6b9f3e904b/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:09:33.168725 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2befce3-a5b7-4865-8888-4cf8fdbe1a3d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:33.169218 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2befce3-a5b7-4865-8888-4cf8fdbe1a3d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:33.169552 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2befce3-a5b7-4865-8888-4cf8fdbe1a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:33.190661 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-44a295d6-0dfb-4f8d-9f1c-91950190cbb5 None None] MFA Rules not processed for user `8b429597bfb2429396b61838d4cfea24`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:33.192073 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-44a295d6-0dfb-4f8d-9f1c-91950190cbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:33.250427 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d2befce3-a5b7-4865-8888-4cf8fdbe1a3d None None] MFA Rules not processed for user `b3d8bef72e754336b5ebbb6b9f3e904b`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:33.254459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d2befce3-a5b7-4865-8888-4cf8fdbe1a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:33.400490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 913/1832] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:09:33.488321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 920/1833] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:33.508857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a295d6-0dfb-4f8d-9f1c-91950190cbb5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:33.510316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-44a295d6-0dfb-4f8d-9f1c-91950190cbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:33.608110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a295d6-0dfb-4f8d-9f1c-91950190cbb5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:33.613878 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26906d-3314-4ae6-bdee-849dd78d7758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:33.614618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26906d-3314-4ae6-bdee-849dd78d7758 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:33.614910 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26906d-3314-4ae6-bdee-849dd78d7758 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:33.615192 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26906d-3314-4ae6-bdee-849dd78d7758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:33.627344 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26906d-3314-4ae6-bdee-849dd78d7758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:33.628904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26906d-3314-4ae6-bdee-849dd78d7758 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:33.644342 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 914/1834] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:33.787018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2befce3-a5b7-4865-8888-4cf8fdbe1a3d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:33.804090 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26906d-3314-4ae6-bdee-849dd78d7758 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:33.820648 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26906d-3314-4ae6-bdee-849dd78d7758 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:33.829010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997ef67-3fae-4ec6-9aac-6cae951d7c6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:33.829916 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997ef67-3fae-4ec6-9aac-6cae951d7c6b service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:33.830215 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997ef67-3fae-4ec6-9aac-6cae951d7c6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:33.830498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997ef67-3fae-4ec6-9aac-6cae951d7c6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:33.881321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:33.882892 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:33.894537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2befce3-a5b7-4865-8888-4cf8fdbe1a3d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:33.900750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11381c09-123c-4c90-b018-86f032e4048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:33.901877 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11381c09-123c-4c90-b018-86f032e4048d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:33.902166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11381c09-123c-4c90-b018-86f032e4048d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:33.902449 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11381c09-123c-4c90-b018-86f032e4048d admin admin] PATH_INFO: `/v3/users/ea83719503194c079416dfb8845bd0ca` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:33.903973 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11381c09-123c-4c90-b018-86f032e4048d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea83719503194c079416dfb8845bd0ca)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:33.906455 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11381c09-123c-4c90-b018-86f032e4048d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:33.913201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997ef67-3fae-4ec6-9aac-6cae951d7c6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:33.914751 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997ef67-3fae-4ec6-9aac-6cae951d7c6b service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:33.925132 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 915/1835] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:09:33.963855 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-11381c09-123c-4c90-b018-86f032e4048d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea83719503194c079416dfb8845bd0ca'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:33.964354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-11381c09-123c-4c90-b018-86f032e4048d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea83719503194c079416dfb8845bd0ca'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:33.972305 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-11381c09-123c-4c90-b018-86f032e4048d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea83719503194c079416dfb8845bd0ca'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:33.979604 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-11381c09-123c-4c90-b018-86f032e4048d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea83719503194c079416dfb8845bd0ca'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:33.993492 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-11381c09-123c-4c90-b018-86f032e4048d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea83719503194c079416dfb8845bd0ca'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:34.000586 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 921/1836] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:33 2022] DELETE /identity/v3/users/ea83719503194c079416dfb8845bd0ca => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:34.005758 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba4e30-9ec3-4438-bd8b-fcde47ef2592 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:34.006064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba4e30-9ec3-4438-bd8b-fcde47ef2592 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:34.006349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba4e30-9ec3-4438-bd8b-fcde47ef2592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:34.027309 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-feba4e30-9ec3-4438-bd8b-fcde47ef2592 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:34.028530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-feba4e30-9ec3-4438-bd8b-fcde47ef2592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:34.098166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 916/1837] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:34.107880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11381c09-123c-4c90-b018-86f032e4048d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:34.109825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-11381c09-123c-4c90-b018-86f032e4048d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:34.174415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11381c09-123c-4c90-b018-86f032e4048d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:34.178001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dc380-4539-4c1f-80ac-3e3961fe1842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:34.178674 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dc380-4539-4c1f-80ac-3e3961fe1842 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:34.178958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dc380-4539-4c1f-80ac-3e3961fe1842 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:34.179235 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dc380-4539-4c1f-80ac-3e3961fe1842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:34.189388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713dc380-4539-4c1f-80ac-3e3961fe1842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:34.190825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713dc380-4539-4c1f-80ac-3e3961fe1842 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:34.200323 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 922/1838] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:34.459269 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba4e30-9ec3-4438-bd8b-fcde47ef2592 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:34.460873 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-feba4e30-9ec3-4438-bd8b-fcde47ef2592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:34.477036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba4e30-9ec3-4438-bd8b-fcde47ef2592 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:34.486014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182554-64b2-4e40-b22f-b745d77a7c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:34.489418 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182554-64b2-4e40-b22f-b745d77a7c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:34.489707 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182554-64b2-4e40-b22f-b745d77a7c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:34.490005 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182554-64b2-4e40-b22f-b745d77a7c6f admin admin] PATH_INFO: `/v3/projects/d36f30d8ed3a40ad9132f046f575d3bf` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:34.491213 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40182554-64b2-4e40-b22f-b745d77a7c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d36f30d8ed3a40ad9132f046f575d3bf)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:34.493175 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40182554-64b2-4e40-b22f-b745d77a7c6f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:34.547984 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-40182554-64b2-4e40-b22f-b745d77a7c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd36f30d8ed3a40ad9132f046f575d3bf', 'request_id': 'req-40182554-64b2-4e40-b22f-b745d77a7c6f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:34.554071 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-40182554-64b2-4e40-b22f-b745d77a7c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd36f30d8ed3a40ad9132f046f575d3bf', 'request_id': 'req-40182554-64b2-4e40-b22f-b745d77a7c6f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:34.561104 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-40182554-64b2-4e40-b22f-b745d77a7c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd36f30d8ed3a40ad9132f046f575d3bf', 'request_id': 'req-40182554-64b2-4e40-b22f-b745d77a7c6f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:34.573839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-40182554-64b2-4e40-b22f-b745d77a7c6f admin admin] The token cache is being invalidate because project d36f30d8ed3a40ad9132f046f575d3bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:34.574133 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-40182554-64b2-4e40-b22f-b745d77a7c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:34.574770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-40182554-64b2-4e40-b22f-b745d77a7c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:34.576379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 917/1839] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:34 2022] DELETE /identity/v3/projects/d36f30d8ed3a40ad9132f046f575d3bf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:34.580406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dc380-4539-4c1f-80ac-3e3961fe1842 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:34.590266 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dc380-4539-4c1f-80ac-3e3961fe1842 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:34.647890 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092a8d5-93dd-41fb-84a4-754edd5300b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:34.648798 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092a8d5-93dd-41fb-84a4-754edd5300b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:34.649083 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092a8d5-93dd-41fb-84a4-754edd5300b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:34.649354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092a8d5-93dd-41fb-84a4-754edd5300b5 admin admin] PATH_INFO: `/v3/users/2823bff9cd6c47158842c24fbc4d7b1e` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:34.650590 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092a8d5-93dd-41fb-84a4-754edd5300b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2823bff9cd6c47158842c24fbc4d7b1e)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:34.652673 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092a8d5-93dd-41fb-84a4-754edd5300b5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:34.677914 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:34.724544 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5092a8d5-93dd-41fb-84a4-754edd5300b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2823bff9cd6c47158842c24fbc4d7b1e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:34.726266 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5092a8d5-93dd-41fb-84a4-754edd5300b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2823bff9cd6c47158842c24fbc4d7b1e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:34.738581 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5092a8d5-93dd-41fb-84a4-754edd5300b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2823bff9cd6c47158842c24fbc4d7b1e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:34.750669 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5092a8d5-93dd-41fb-84a4-754edd5300b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2823bff9cd6c47158842c24fbc4d7b1e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:34.788449 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5092a8d5-93dd-41fb-84a4-754edd5300b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2823bff9cd6c47158842c24fbc4d7b1e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:34.800906 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 923/1840] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:34 2022] DELETE /identity/v3/users/2823bff9cd6c47158842c24fbc4d7b1e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:35.327715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182554-64b2-4e40-b22f-b745d77a7c6f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:35.329253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-40182554-64b2-4e40-b22f-b745d77a7c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:35.357140 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182554-64b2-4e40-b22f-b745d77a7c6f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:35.412118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:35.420248 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d9c3e-899c-47ab-acad-35069c808229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:35.421248 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d9c3e-899c-47ab-acad-35069c808229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:35.422041 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d9c3e-899c-47ab-acad-35069c808229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:35.422316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d9c3e-899c-47ab-acad-35069c808229 admin admin] PATH_INFO: `/v3/projects/a0c501e54c6f4eea8e9066791066476a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:35.423689 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d9c3e-899c-47ab-acad-35069c808229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0c501e54c6f4eea8e9066791066476a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:35.425625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d9c3e-899c-47ab-acad-35069c808229 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:35.486212 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ce7d9c3e-899c-47ab-acad-35069c808229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0c501e54c6f4eea8e9066791066476a', 'request_id': 'req-ce7d9c3e-899c-47ab-acad-35069c808229'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:35.492025 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ce7d9c3e-899c-47ab-acad-35069c808229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0c501e54c6f4eea8e9066791066476a', 'request_id': 'req-ce7d9c3e-899c-47ab-acad-35069c808229'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:35.501449 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ce7d9c3e-899c-47ab-acad-35069c808229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0c501e54c6f4eea8e9066791066476a', 'request_id': 'req-ce7d9c3e-899c-47ab-acad-35069c808229'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:35.516240 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ce7d9c3e-899c-47ab-acad-35069c808229 admin admin] The token cache is being invalidate because project a0c501e54c6f4eea8e9066791066476a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:35.516550 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ce7d9c3e-899c-47ab-acad-35069c808229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:35.517212 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ce7d9c3e-899c-47ab-acad-35069c808229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:35.518786 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 918/1841] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:35 2022] DELETE /identity/v3/projects/a0c501e54c6f4eea8e9066791066476a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:35.523652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6032ee6-0ec4-4bd0-957b-1141bda9906e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:35.524080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6032ee6-0ec4-4bd0-957b-1141bda9906e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:35.524363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6032ee6-0ec4-4bd0-957b-1141bda9906e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:35.544092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b6032ee6-0ec4-4bd0-957b-1141bda9906e None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:35.545375 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b6032ee6-0ec4-4bd0-957b-1141bda9906e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:35.605225 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 924/1842] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:35.612978 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49d3cc-4031-478f-87b3-642292dfd778 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:35.613274 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49d3cc-4031-478f-87b3-642292dfd778 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:35.613560 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49d3cc-4031-478f-87b3-642292dfd778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:35.631631 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6e49d3cc-4031-478f-87b3-642292dfd778 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:35.632884 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6e49d3cc-4031-478f-87b3-642292dfd778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:35.641260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 919/1843] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:35.645527 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6032ee6-0ec4-4bd0-957b-1141bda9906e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:35.655211 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6032ee6-0ec4-4bd0-957b-1141bda9906e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:35.660390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b567c7-ae64-429d-8db9-ec3e72c68121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:35.661100 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b567c7-ae64-429d-8db9-ec3e72c68121 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:35.661395 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b567c7-ae64-429d-8db9-ec3e72c68121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:35.661681 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b567c7-ae64-429d-8db9-ec3e72c68121 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:35.662403 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b567c7-ae64-429d-8db9-ec3e72c68121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:35.662752 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b567c7-ae64-429d-8db9-ec3e72c68121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:35.664443 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b567c7-ae64-429d-8db9-ec3e72c68121 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:35.676898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 925/1844] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:09:35.681100 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49d3cc-4031-478f-87b3-642292dfd778 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:35.690240 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49d3cc-4031-478f-87b3-642292dfd778 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:35.694894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242abd26-0e94-4627-ad53-53c6ef8e74e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:35.695548 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242abd26-0e94-4627-ad53-53c6ef8e74e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:35.695835 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242abd26-0e94-4627-ad53-53c6ef8e74e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:35.696148 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242abd26-0e94-4627-ad53-53c6ef8e74e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:35.696839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242abd26-0e94-4627-ad53-53c6ef8e74e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:35.698767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242abd26-0e94-4627-ad53-53c6ef8e74e0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:35.725338 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 920/1845] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:35 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:35.728815 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b567c7-ae64-429d-8db9-ec3e72c68121 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:35.739182 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b567c7-ae64-429d-8db9-ec3e72c68121 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:35.795966 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87071892-b183-4ad8-a6a8-b983c7191c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:35.796642 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87071892-b183-4ad8-a6a8-b983c7191c4e admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:35.796933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87071892-b183-4ad8-a6a8-b983c7191c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:35.797217 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87071892-b183-4ad8-a6a8-b983c7191c4e admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:35.797915 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87071892-b183-4ad8-a6a8-b983c7191c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:35.799837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87071892-b183-4ad8-a6a8-b983c7191c4e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:35.823281 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 926/1846] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:35 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:35.828200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242abd26-0e94-4627-ad53-53c6ef8e74e0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:35.838420 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242abd26-0e94-4627-ad53-53c6ef8e74e0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:35.843992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2d08a-df88-4904-8b5e-3900caa1ad70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:35.844958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2d08a-df88-4904-8b5e-3900caa1ad70 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:35.845248 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2d08a-df88-4904-8b5e-3900caa1ad70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:35.845528 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2d08a-df88-4904-8b5e-3900caa1ad70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:35.846268 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2d08a-df88-4904-8b5e-3900caa1ad70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:35.847860 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2d08a-df88-4904-8b5e-3900caa1ad70 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:35.858234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 921/1847] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:35.862099 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87071892-b183-4ad8-a6a8-b983c7191c4e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:35.872171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87071892-b183-4ad8-a6a8-b983c7191c4e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:35.877437 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb6c9b-bfee-4f25-9b4c-3cb974397125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:35.878158 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb6c9b-bfee-4f25-9b4c-3cb974397125 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:35.878448 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb6c9b-bfee-4f25-9b4c-3cb974397125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:35.878760 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb6c9b-bfee-4f25-9b4c-3cb974397125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:35.879491 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb6c9b-bfee-4f25-9b4c-3cb974397125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:35.881117 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb6c9b-bfee-4f25-9b4c-3cb974397125 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:35.891963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 927/1848] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:09:35.895817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2d08a-df88-4904-8b5e-3900caa1ad70 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:35.905639 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2d08a-df88-4904-8b5e-3900caa1ad70 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:35.910261 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f289e2-b901-4862-af21-902d73f54728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:35.911139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f289e2-b901-4862-af21-902d73f54728 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:35.911431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f289e2-b901-4862-af21-902d73f54728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:35.911717 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f289e2-b901-4862-af21-902d73f54728 admin admin] PATH_INFO: `/v3/projects/3c8990e6f1fc48af988617f3ceb3a80a/users/81d7ce97e4ba4d42b0fa87527442cd3a/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:35.927813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f289e2-b901-4862-af21-902d73f54728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8990e6f1fc48af988617f3ceb3a80a, user_id=81d7ce97e4ba4d42b0fa87527442cd3a, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:35.929908 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f289e2-b901-4862-af21-902d73f54728 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:35.945030 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 922/1849] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:35 2022] PUT /identity/v3/projects/3c8990e6f1fc48af988617f3ceb3a80a/users/81d7ce97e4ba4d42b0fa87527442cd3a/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:35.955948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd2b07-cc48-4084-ad3c-a8d266aa2ccd None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:35.956263 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd2b07-cc48-4084-ad3c-a8d266aa2ccd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:35.956567 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd2b07-cc48-4084-ad3c-a8d266aa2ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:35.964008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:35.987958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-91dd2b07-cc48-4084-ad3c-a8d266aa2ccd None None] MFA Rules not processed for user `81d7ce97e4ba4d42b0fa87527442cd3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:35.989406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-91dd2b07-cc48-4084-ad3c-a8d266aa2ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:36.078031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 928/1850] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:36.082431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f289e2-b901-4862-af21-902d73f54728 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:36.160230 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f289e2-b901-4862-af21-902d73f54728 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:36.165838 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c9758-5bb9-43da-b2cd-f61412727b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:36.166656 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c9758-5bb9-43da-b2cd-f61412727b66 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:36.167069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c9758-5bb9-43da-b2cd-f61412727b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:36.167896 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c9758-5bb9-43da-b2cd-f61412727b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:36.168160 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c9758-5bb9-43da-b2cd-f61412727b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:36.170436 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c9758-5bb9-43da-b2cd-f61412727b66 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:36.212958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 923/1851] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:36 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:36.217166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd2b07-cc48-4084-ad3c-a8d266aa2ccd None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:36.231462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd2b07-cc48-4084-ad3c-a8d266aa2ccd None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:36.303307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361359d-f815-473f-a3c9-2de160779ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:36.304025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361359d-f815-473f-a3c9-2de160779ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:36.304418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361359d-f815-473f-a3c9-2de160779ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:36.304594 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361359d-f815-473f-a3c9-2de160779ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:36.305313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361359d-f815-473f-a3c9-2de160779ee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:36.307416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361359d-f815-473f-a3c9-2de160779ee2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:36.351162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 929/1852] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:36 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:36.352715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c9758-5bb9-43da-b2cd-f61412727b66 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:36.370911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c9758-5bb9-43da-b2cd-f61412727b66 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:36.383166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621001a7-0f6e-4145-be5d-6f1f478a0ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:36.383863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621001a7-0f6e-4145-be5d-6f1f478a0ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:36.384185 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621001a7-0f6e-4145-be5d-6f1f478a0ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:36.384465 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621001a7-0f6e-4145-be5d-6f1f478a0ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:36.385207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621001a7-0f6e-4145-be5d-6f1f478a0ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:36.386819 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621001a7-0f6e-4145-be5d-6f1f478a0ac5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:36.388336 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:36.398924 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 924/1853] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:36.403599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361359d-f815-473f-a3c9-2de160779ee2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:36.414399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361359d-f815-473f-a3c9-2de160779ee2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:36.421007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a22ea-9070-404c-a8b3-b2f0884dc6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:36.422431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a22ea-9070-404c-a8b3-b2f0884dc6a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:36.422720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a22ea-9070-404c-a8b3-b2f0884dc6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:36.423007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a22ea-9070-404c-a8b3-b2f0884dc6a6 admin admin] PATH_INFO: `/v3/projects/975178dcb0fe4cf5b462938c55b1c073/users/c7dcbbe6e58a405981b733bdbd8a98dc/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:36.440371 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a22ea-9070-404c-a8b3-b2f0884dc6a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=975178dcb0fe4cf5b462938c55b1c073, user_id=c7dcbbe6e58a405981b733bdbd8a98dc, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:36.443219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a22ea-9070-404c-a8b3-b2f0884dc6a6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:36.457066 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 930/1854] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:36 2022] PUT /identity/v3/projects/975178dcb0fe4cf5b462938c55b1c073/users/c7dcbbe6e58a405981b733bdbd8a98dc/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:36.461503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621001a7-0f6e-4145-be5d-6f1f478a0ac5 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:36.473021 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621001a7-0f6e-4145-be5d-6f1f478a0ac5 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:36.543556 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40a810-cb2a-46e8-ad02-bd6abfd1b8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:36.544310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a810-cb2a-46e8-ad02-bd6abfd1b8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:36.544558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a810-cb2a-46e8-ad02-bd6abfd1b8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:36.544840 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a810-cb2a-46e8-ad02-bd6abfd1b8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:36.545573 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40a810-cb2a-46e8-ad02-bd6abfd1b8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:36.547698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40a810-cb2a-46e8-ad02-bd6abfd1b8e5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:36.558559 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 925/1855] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:36.563416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a22ea-9070-404c-a8b3-b2f0884dc6a6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:36.575047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a22ea-9070-404c-a8b3-b2f0884dc6a6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:36.580097 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938318fb-5b15-4620-b20e-efe32cc78f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:36.580998 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938318fb-5b15-4620-b20e-efe32cc78f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:36.581292 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938318fb-5b15-4620-b20e-efe32cc78f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:36.581576 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938318fb-5b15-4620-b20e-efe32cc78f1c admin admin] PATH_INFO: `/v3/projects/975178dcb0fe4cf5b462938c55b1c073/users/c7dcbbe6e58a405981b733bdbd8a98dc/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:36.583878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938318fb-5b15-4620-b20e-efe32cc78f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=975178dcb0fe4cf5b462938c55b1c073, user_id=c7dcbbe6e58a405981b733bdbd8a98dc, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:36.586603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938318fb-5b15-4620-b20e-efe32cc78f1c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:36.600480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 931/1856] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:36 2022] PUT /identity/v3/projects/975178dcb0fe4cf5b462938c55b1c073/users/c7dcbbe6e58a405981b733bdbd8a98dc/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:09:36.612263 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea808b-350b-456b-8bda-0dd55a4769d7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:36.612556 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea808b-350b-456b-8bda-0dd55a4769d7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:36.612828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea808b-350b-456b-8bda-0dd55a4769d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:36.640308 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b3ea808b-350b-456b-8bda-0dd55a4769d7 None None] MFA Rules not processed for user `c7dcbbe6e58a405981b733bdbd8a98dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:36.641532 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b3ea808b-350b-456b-8bda-0dd55a4769d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:36.710940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 926/1857] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:36.722497 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938318fb-5b15-4620-b20e-efe32cc78f1c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:36.724257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-938318fb-5b15-4620-b20e-efe32cc78f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:36.778637 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:36.785290 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938318fb-5b15-4620-b20e-efe32cc78f1c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:36.789172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174be185-b8e9-4a19-bc5c-a786d6cf7f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:36.789807 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174be185-b8e9-4a19-bc5c-a786d6cf7f9c service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:36.790355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174be185-b8e9-4a19-bc5c-a786d6cf7f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:36.790644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174be185-b8e9-4a19-bc5c-a786d6cf7f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:36.846133 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174be185-b8e9-4a19-bc5c-a786d6cf7f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:36.847571 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174be185-b8e9-4a19-bc5c-a786d6cf7f9c service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:36.856435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 932/1858] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:37.360559 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea808b-350b-456b-8bda-0dd55a4769d7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:37.370771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea808b-350b-456b-8bda-0dd55a4769d7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:37.375335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e858f-a422-413d-8238-1af24c8e0120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:37.376116 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e858f-a422-413d-8238-1af24c8e0120 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:37.376596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e858f-a422-413d-8238-1af24c8e0120 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:37.377085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e858f-a422-413d-8238-1af24c8e0120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:37.379231 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-966e858f-a422-413d-8238-1af24c8e0120 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:37.467585 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e858f-a422-413d-8238-1af24c8e0120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:37.469195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e858f-a422-413d-8238-1af24c8e0120 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:37.479710 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 927/1859] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:46.612265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcfc3e-8e81-4d37-84c4-964bc9478284 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:46.612885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcfc3e-8e81-4d37-84c4-964bc9478284 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:46.612885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcfc3e-8e81-4d37-84c4-964bc9478284 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:46.614937 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 933/1860] 10.222.0.73 () {54 vars in 921 bytes} [Thu May 19 12:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:09:46.628524 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49e518-826d-4f18-88a8-44affd23a521 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:46.629075 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49e518-826d-4f18-88a8-44affd23a521 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:46.629075 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49e518-826d-4f18-88a8-44affd23a521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:46.650794 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0d49e518-826d-4f18-88a8-44affd23a521 None None] MFA Rules not processed for user `bd0c1f0710f3447d94e67048a508781e`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:46.652063 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0d49e518-826d-4f18-88a8-44affd23a521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:46.663076 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:46.758969 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 928/1861] 10.222.0.73 () {58 vars in 1018 bytes} [Thu May 19 12:09:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:46.777771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcfc3e-8e81-4d37-84c4-964bc9478284 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:46.779628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a6bcfc3e-8e81-4d37-84c4-964bc9478284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:46.798477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcfc3e-8e81-4d37-84c4-964bc9478284 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:46.809699 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdce2d-a293-437a-ab7c-4cc73a465c0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:46.810373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdce2d-a293-437a-ab7c-4cc73a465c0e service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:46.810658 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdce2d-a293-437a-ab7c-4cc73a465c0e service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:46.810941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdce2d-a293-437a-ab7c-4cc73a465c0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:46.822861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdce2d-a293-437a-ab7c-4cc73a465c0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:46.824534 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdce2d-a293-437a-ab7c-4cc73a465c0e service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:46.836949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 934/1862] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:51.899060 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49e518-826d-4f18-88a8-44affd23a521 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:51.910156 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49e518-826d-4f18-88a8-44affd23a521 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:51.914199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77419f5-34b0-47a5-b52b-6942df797e78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:51.914882 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77419f5-34b0-47a5-b52b-6942df797e78 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:51.915387 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77419f5-34b0-47a5-b52b-6942df797e78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:51.915659 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77419f5-34b0-47a5-b52b-6942df797e78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:51.928069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77419f5-34b0-47a5-b52b-6942df797e78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:51.929618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77419f5-34b0-47a5-b52b-6942df797e78 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:51.941133 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 929/1863] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:53.313521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdce2d-a293-437a-ab7c-4cc73a465c0e service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:53.317831 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77419f5-34b0-47a5-b52b-6942df797e78 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:53.319347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-94fdce2d-a293-437a-ab7c-4cc73a465c0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:53.330365 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77419f5-34b0-47a5-b52b-6942df797e78 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:53.330782 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee793e-0ded-4d7c-b660-95066056af73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:53.331606 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee793e-0ded-4d7c-b660-95066056af73 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:53.331896 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee793e-0ded-4d7c-b660-95066056af73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:53.332231 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee793e-0ded-4d7c-b660-95066056af73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:53.334263 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7bee793e-0ded-4d7c-b660-95066056af73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:53.396741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdce2d-a293-437a-ab7c-4cc73a465c0e service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:53.401815 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360ae28-bf32-458d-a814-d7feb6ff9bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:53.402794 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360ae28-bf32-458d-a814-d7feb6ff9bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:53.403302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360ae28-bf32-458d-a814-d7feb6ff9bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:53.403754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360ae28-bf32-458d-a814-d7feb6ff9bc8 admin admin] PATH_INFO: `/v3/users/91a8fe84514b42e69251190caf692d6e` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:53.405563 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360ae28-bf32-458d-a814-d7feb6ff9bc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a8fe84514b42e69251190caf692d6e)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:53.407563 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360ae28-bf32-458d-a814-d7feb6ff9bc8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:53.410108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee793e-0ded-4d7c-b660-95066056af73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:53.411644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee793e-0ded-4d7c-b660-95066056af73 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:53.423953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 930/1864] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:09:53.481377 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7360ae28-bf32-458d-a814-d7feb6ff9bc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a8fe84514b42e69251190caf692d6e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:53.482327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7360ae28-bf32-458d-a814-d7feb6ff9bc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a8fe84514b42e69251190caf692d6e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:53.494855 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7360ae28-bf32-458d-a814-d7feb6ff9bc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a8fe84514b42e69251190caf692d6e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:53.515038 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7360ae28-bf32-458d-a814-d7feb6ff9bc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a8fe84514b42e69251190caf692d6e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:53.533272 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7360ae28-bf32-458d-a814-d7feb6ff9bc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a8fe84514b42e69251190caf692d6e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:53.541553 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 935/1865] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:53 2022] DELETE /identity/v3/users/91a8fe84514b42e69251190caf692d6e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:53.546100 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5692b14-808c-4d8a-971a-afb9646fa49e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:53.546407 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5692b14-808c-4d8a-971a-afb9646fa49e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:53.546680 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5692b14-808c-4d8a-971a-afb9646fa49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:53.566818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e5692b14-808c-4d8a-971a-afb9646fa49e None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:53.568411 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e5692b14-808c-4d8a-971a-afb9646fa49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:53.636603 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 931/1866] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:53.646999 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360ae28-bf32-458d-a814-d7feb6ff9bc8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:53.648586 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7360ae28-bf32-458d-a814-d7feb6ff9bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:53.659612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:53.712284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360ae28-bf32-458d-a814-d7feb6ff9bc8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:53.716080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4ba5a-b2ad-499f-8cea-b1b3fd6e0ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:53.716746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4ba5a-b2ad-499f-8cea-b1b3fd6e0ecb service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:53.717035 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4ba5a-b2ad-499f-8cea-b1b3fd6e0ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:53.717344 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4ba5a-b2ad-499f-8cea-b1b3fd6e0ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:53.726957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4ba5a-b2ad-499f-8cea-b1b3fd6e0ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:53.729058 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4ba5a-b2ad-499f-8cea-b1b3fd6e0ecb service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:53.745112 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 936/1867] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:53.774641 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5692b14-808c-4d8a-971a-afb9646fa49e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:53.776113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e5692b14-808c-4d8a-971a-afb9646fa49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:53.811852 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:53.853251 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5692b14-808c-4d8a-971a-afb9646fa49e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:53.863255 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f4c3f-afcd-4a8a-8dd1-e3ff2e415dee tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b429597bfb2429396b61838d4cfea24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18cea87f474f4ff2b194df96d4cebd3a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:53.864576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f4c3f-afcd-4a8a-8dd1-e3ff2e415dee tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:53.865106 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f4c3f-afcd-4a8a-8dd1-e3ff2e415dee tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:53.865623 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f4c3f-afcd-4a8a-8dd1-e3ff2e415dee tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:53.867037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f4c3f-afcd-4a8a-8dd1-e3ff2e415dee tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:53.877293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f4c3f-afcd-4a8a-8dd1-e3ff2e415dee tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:53.880476 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f4c3f-afcd-4a8a-8dd1-e3ff2e415dee tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:53.894977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 932/1868] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:53.899002 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4ba5a-b2ad-499f-8cea-b1b3fd6e0ecb service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:53.909341 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4ba5a-b2ad-499f-8cea-b1b3fd6e0ecb service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:53.913868 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33500b-5724-49f3-a39c-b55d3a3cd8c8 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b429597bfb2429396b61838d4cfea24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18cea87f474f4ff2b194df96d4cebd3a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:53.914514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33500b-5724-49f3-a39c-b55d3a3cd8c8 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:53.914806 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33500b-5724-49f3-a39c-b55d3a3cd8c8 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:53.915350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33500b-5724-49f3-a39c-b55d3a3cd8c8 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:53.916470 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33500b-5724-49f3-a39c-b55d3a3cd8c8 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:53.918017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33500b-5724-49f3-a39c-b55d3a3cd8c8 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:53.947951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 937/1869] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:53 2022] POST /identity/v3/projects => generated 354 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:53.952471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f4c3f-afcd-4a8a-8dd1-e3ff2e415dee tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:53.963306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f4c3f-afcd-4a8a-8dd1-e3ff2e415dee tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:54.024209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17fd8b-35ba-4b10-9526-348d81d9ee8d tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b429597bfb2429396b61838d4cfea24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18cea87f474f4ff2b194df96d4cebd3a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:54.024803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17fd8b-35ba-4b10-9526-348d81d9ee8d tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:54.025096 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17fd8b-35ba-4b10-9526-348d81d9ee8d tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:54.025379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17fd8b-35ba-4b10-9526-348d81d9ee8d tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:54.026125 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17fd8b-35ba-4b10-9526-348d81d9ee8d tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:54.026436 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17fd8b-35ba-4b10-9526-348d81d9ee8d tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:54.028087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17fd8b-35ba-4b10-9526-348d81d9ee8d tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:54.044548 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 933/1870] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:54.081347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33500b-5724-49f3-a39c-b55d3a3cd8c8 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:54.091779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33500b-5724-49f3-a39c-b55d3a3cd8c8 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:54.096500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cbb77-f864-4657-8a9e-3d69dad3bca6 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b429597bfb2429396b61838d4cfea24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18cea87f474f4ff2b194df96d4cebd3a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:54.097360 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cbb77-f864-4657-8a9e-3d69dad3bca6 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:54.097647 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cbb77-f864-4657-8a9e-3d69dad3bca6 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:54.097924 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cbb77-f864-4657-8a9e-3d69dad3bca6 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] PATH_INFO: `/v3/projects/08966def67cd4709981f281404929c68` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:54.099159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677cbb77-f864-4657-8a9e-3d69dad3bca6 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] RBAC: Authorizing `identity:delete_project(project_id=08966def67cd4709981f281404929c68)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:54.101113 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677cbb77-f864-4657-8a9e-3d69dad3bca6 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:54.167430 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-677cbb77-f864-4657-8a9e-3d69dad3bca6 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08966def67cd4709981f281404929c68', 'request_id': 'req-677cbb77-f864-4657-8a9e-3d69dad3bca6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.177192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-677cbb77-f864-4657-8a9e-3d69dad3bca6 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08966def67cd4709981f281404929c68', 'request_id': 'req-677cbb77-f864-4657-8a9e-3d69dad3bca6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.187303 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-677cbb77-f864-4657-8a9e-3d69dad3bca6 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08966def67cd4709981f281404929c68', 'request_id': 'req-677cbb77-f864-4657-8a9e-3d69dad3bca6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.199195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-677cbb77-f864-4657-8a9e-3d69dad3bca6 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] The token cache is being invalidate because project 08966def67cd4709981f281404929c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:54.199567 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-677cbb77-f864-4657-8a9e-3d69dad3bca6 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.200334 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-677cbb77-f864-4657-8a9e-3d69dad3bca6 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.202769 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 938/1871] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:54 2022] DELETE /identity/v3/projects/08966def67cd4709981f281404929c68 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:54.388916 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17fd8b-35ba-4b10-9526-348d81d9ee8d tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:54.391191 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6e17fd8b-35ba-4b10-9526-348d81d9ee8d tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:54.426113 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cbb77-f864-4657-8a9e-3d69dad3bca6 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:54.427548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-677cbb77-f864-4657-8a9e-3d69dad3bca6 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:54.477314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17fd8b-35ba-4b10-9526-348d81d9ee8d tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:54.501548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cbb77-f864-4657-8a9e-3d69dad3bca6 tempest-VolumeQuotaClassesTest-2085432726 tempest-VolumeQuotaClassesTest-2085432726-project-admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:54.506711 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292bacd-e548-4ab1-b37e-0a3b4eaaa3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:54.507672 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292bacd-e548-4ab1-b37e-0a3b4eaaa3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:54.508100 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292bacd-e548-4ab1-b37e-0a3b4eaaa3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:54.508444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292bacd-e548-4ab1-b37e-0a3b4eaaa3ec admin admin] PATH_INFO: `/v3/users/7b968a2a3ed3459188f5aa8e8b216180` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:54.509969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292bacd-e548-4ab1-b37e-0a3b4eaaa3ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b968a2a3ed3459188f5aa8e8b216180)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:54.511895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292bacd-e548-4ab1-b37e-0a3b4eaaa3ec admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:54.528068 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:54.563030 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e077d-0849-4dac-9916-3f4b6b4292b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:54.564203 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e077d-0849-4dac-9916-3f4b6b4292b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:54.564519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e077d-0849-4dac-9916-3f4b6b4292b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:54.564820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e077d-0849-4dac-9916-3f4b6b4292b3 admin admin] PATH_INFO: `/v3/projects/26bbf557339d4126a5ee7f2c2dbe1cda` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:54.566185 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e077d-0849-4dac-9916-3f4b6b4292b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26bbf557339d4126a5ee7f2c2dbe1cda)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:54.568538 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e077d-0849-4dac-9916-3f4b6b4292b3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:54.576555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:54.588494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6292bacd-e548-4ab1-b37e-0a3b4eaaa3ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b968a2a3ed3459188f5aa8e8b216180'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.589464 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6292bacd-e548-4ab1-b37e-0a3b4eaaa3ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b968a2a3ed3459188f5aa8e8b216180'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.599365 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6292bacd-e548-4ab1-b37e-0a3b4eaaa3ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b968a2a3ed3459188f5aa8e8b216180'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.609212 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6292bacd-e548-4ab1-b37e-0a3b4eaaa3ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b968a2a3ed3459188f5aa8e8b216180'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.625804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b00e077d-0849-4dac-9916-3f4b6b4292b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26bbf557339d4126a5ee7f2c2dbe1cda', 'request_id': 'req-b00e077d-0849-4dac-9916-3f4b6b4292b3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.629416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6292bacd-e548-4ab1-b37e-0a3b4eaaa3ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b968a2a3ed3459188f5aa8e8b216180'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.636538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 939/1872] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:54 2022] DELETE /identity/v3/users/7b968a2a3ed3459188f5aa8e8b216180 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:09:54.641136 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff593868-db20-4d1d-8526-aff541f66f6d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:54.641540 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff593868-db20-4d1d-8526-aff541f66f6d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:54.641916 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff593868-db20-4d1d-8526-aff541f66f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:54.654298 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b00e077d-0849-4dac-9916-3f4b6b4292b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26bbf557339d4126a5ee7f2c2dbe1cda', 'request_id': 'req-b00e077d-0849-4dac-9916-3f4b6b4292b3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.666375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b00e077d-0849-4dac-9916-3f4b6b4292b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26bbf557339d4126a5ee7f2c2dbe1cda', 'request_id': 'req-b00e077d-0849-4dac-9916-3f4b6b4292b3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.666797 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ff593868-db20-4d1d-8526-aff541f66f6d None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:54.668424 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ff593868-db20-4d1d-8526-aff541f66f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:54.687799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b00e077d-0849-4dac-9916-3f4b6b4292b3 admin admin] The token cache is being invalidate because project 26bbf557339d4126a5ee7f2c2dbe1cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:54.688138 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b00e077d-0849-4dac-9916-3f4b6b4292b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.688810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b00e077d-0849-4dac-9916-3f4b6b4292b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.690695 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 934/1873] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:54 2022] DELETE /identity/v3/projects/26bbf557339d4126a5ee7f2c2dbe1cda => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:54.694706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e077d-0849-4dac-9916-3f4b6b4292b3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:54.697952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b00e077d-0849-4dac-9916-3f4b6b4292b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:54.747461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 940/1874] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:54.764972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff593868-db20-4d1d-8526-aff541f66f6d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:54.766699 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ff593868-db20-4d1d-8526-aff541f66f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:54.773771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e077d-0849-4dac-9916-3f4b6b4292b3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:54.782788 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14732ba4-d473-4be0-8853-480100475b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:54.783736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14732ba4-d473-4be0-8853-480100475b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:54.784142 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14732ba4-d473-4be0-8853-480100475b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:54.784517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14732ba4-d473-4be0-8853-480100475b06 admin admin] PATH_INFO: `/v3/users/ee2bcbb3c5584e2b9bc17cb861ec7490` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:54.786035 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14732ba4-d473-4be0-8853-480100475b06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee2bcbb3c5584e2b9bc17cb861ec7490)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:54.788310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14732ba4-d473-4be0-8853-480100475b06 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:54.836367 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff593868-db20-4d1d-8526-aff541f66f6d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:54.837700 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-14732ba4-d473-4be0-8853-480100475b06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee2bcbb3c5584e2b9bc17cb861ec7490'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.840023 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54967e3e-a704-49df-9e7f-3b3ff8dbe7bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:54.840669 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54967e3e-a704-49df-9e7f-3b3ff8dbe7bc service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:54.840956 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54967e3e-a704-49df-9e7f-3b3ff8dbe7bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:54.841238 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54967e3e-a704-49df-9e7f-3b3ff8dbe7bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:54.845457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-14732ba4-d473-4be0-8853-480100475b06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee2bcbb3c5584e2b9bc17cb861ec7490'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.850600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54967e3e-a704-49df-9e7f-3b3ff8dbe7bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:54.852075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54967e3e-a704-49df-9e7f-3b3ff8dbe7bc service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:54.852801 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-14732ba4-d473-4be0-8853-480100475b06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee2bcbb3c5584e2b9bc17cb861ec7490'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.853436 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-14732ba4-d473-4be0-8853-480100475b06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee2bcbb3c5584e2b9bc17cb861ec7490'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.854097 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-14732ba4-d473-4be0-8853-480100475b06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee2bcbb3c5584e2b9bc17cb861ec7490'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:54.862161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 941/1875] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:09:54.872704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 935/1876] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:54 2022] DELETE /identity/v3/users/ee2bcbb3c5584e2b9bc17cb861ec7490 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:09:55.137526 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54967e3e-a704-49df-9e7f-3b3ff8dbe7bc service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:55.139192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-54967e3e-a704-49df-9e7f-3b3ff8dbe7bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:55.148318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14732ba4-d473-4be0-8853-480100475b06 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:55.150184 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-14732ba4-d473-4be0-8853-480100475b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:55.154005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54967e3e-a704-49df-9e7f-3b3ff8dbe7bc service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:55.166492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:55.209479 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:55.238832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14732ba4-d473-4be0-8853-480100475b06 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:55.245703 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:55.246557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3fba2-ff50-4a8f-9064-21c834ac2e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:55.246693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:55.246866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:55.247138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9 admin admin] PATH_INFO: `/v3/projects/c3d167eadb2d48f4957e2cf54e88072e` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:55.247806 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3fba2-ff50-4a8f-9064-21c834ac2e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:55.248179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3fba2-ff50-4a8f-9064-21c834ac2e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:55.248369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d167eadb2d48f4957e2cf54e88072e)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:55.249173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3fba2-ff50-4a8f-9064-21c834ac2e02 admin admin] PATH_INFO: `/v3/projects/da16569927ad4839800b2fe14d278ff8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:55.250795 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3fba2-ff50-4a8f-9064-21c834ac2e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da16569927ad4839800b2fe14d278ff8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:55.250902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:55.255341 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3fba2-ff50-4a8f-9064-21c834ac2e02 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:55.315097 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-04f3fba2-ff50-4a8f-9064-21c834ac2e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da16569927ad4839800b2fe14d278ff8', 'request_id': 'req-04f3fba2-ff50-4a8f-9064-21c834ac2e02'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.321757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-04f3fba2-ff50-4a8f-9064-21c834ac2e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da16569927ad4839800b2fe14d278ff8', 'request_id': 'req-04f3fba2-ff50-4a8f-9064-21c834ac2e02'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.325735 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d167eadb2d48f4957e2cf54e88072e', 'request_id': 'req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.333647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-04f3fba2-ff50-4a8f-9064-21c834ac2e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da16569927ad4839800b2fe14d278ff8', 'request_id': 'req-04f3fba2-ff50-4a8f-9064-21c834ac2e02'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.338377 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d167eadb2d48f4957e2cf54e88072e', 'request_id': 'req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.346102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d167eadb2d48f4957e2cf54e88072e', 'request_id': 'req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.354144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-04f3fba2-ff50-4a8f-9064-21c834ac2e02 admin admin] The token cache is being invalidate because project da16569927ad4839800b2fe14d278ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:55.354444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-04f3fba2-ff50-4a8f-9064-21c834ac2e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.355112 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-04f3fba2-ff50-4a8f-9064-21c834ac2e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.356879 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 936/1877] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:55 2022] DELETE /identity/v3/projects/da16569927ad4839800b2fe14d278ff8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:09:55.361401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3fba2-ff50-4a8f-9064-21c834ac2e02 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:55.363644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-04f3fba2-ff50-4a8f-9064-21c834ac2e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:55.364266 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9 admin admin] The token cache is being invalidate because project c3d167eadb2d48f4957e2cf54e88072e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:55.364568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.365236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.377071 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 942/1878] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:55 2022] DELETE /identity/v3/projects/c3d167eadb2d48f4957e2cf54e88072e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:55.379154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:55.384528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:55.456587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3fba2-ff50-4a8f-9064-21c834ac2e02 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:55.461370 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8ee4d-f1ae-4c07-8338-bfb3fc2c3d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:55.462255 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8ee4d-f1ae-4c07-8338-bfb3fc2c3d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:55.462537 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8ee4d-f1ae-4c07-8338-bfb3fc2c3d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:55.462839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8ee4d-f1ae-4c07-8338-bfb3fc2c3d4d admin admin] PATH_INFO: `/v3/users/0eb0106b47a2405abf65e906feab2e12` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:55.464177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8ee4d-f1ae-4c07-8338-bfb3fc2c3d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eb0106b47a2405abf65e906feab2e12)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:55.466243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8ee4d-f1ae-4c07-8338-bfb3fc2c3d4d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:55.478229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbe7c2-ec05-46b8-985a-2b474a153bc9 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:55.483011 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43378c48-8619-4eb4-8eed-1e67db77147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:55.484436 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43378c48-8619-4eb4-8eed-1e67db77147a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:55.484718 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43378c48-8619-4eb4-8eed-1e67db77147a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:55.485116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43378c48-8619-4eb4-8eed-1e67db77147a admin admin] PATH_INFO: `/v3/users/8b429597bfb2429396b61838d4cfea24` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:55.486447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43378c48-8619-4eb4-8eed-1e67db77147a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b429597bfb2429396b61838d4cfea24)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:55.488572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43378c48-8619-4eb4-8eed-1e67db77147a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:55.523432 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:55.524885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-14d8ee4d-f1ae-4c07-8338-bfb3fc2c3d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb0106b47a2405abf65e906feab2e12'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.536059 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-14d8ee4d-f1ae-4c07-8338-bfb3fc2c3d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb0106b47a2405abf65e906feab2e12'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.544568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-43378c48-8619-4eb4-8eed-1e67db77147a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b429597bfb2429396b61838d4cfea24'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.546232 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-43378c48-8619-4eb4-8eed-1e67db77147a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b429597bfb2429396b61838d4cfea24'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.546367 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-14d8ee4d-f1ae-4c07-8338-bfb3fc2c3d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb0106b47a2405abf65e906feab2e12'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.547032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-14d8ee4d-f1ae-4c07-8338-bfb3fc2c3d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb0106b47a2405abf65e906feab2e12'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.547694 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-14d8ee4d-f1ae-4c07-8338-bfb3fc2c3d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb0106b47a2405abf65e906feab2e12'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.555141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-43378c48-8619-4eb4-8eed-1e67db77147a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b429597bfb2429396b61838d4cfea24'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.562914 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-43378c48-8619-4eb4-8eed-1e67db77147a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b429597bfb2429396b61838d4cfea24'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.565006 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:55.569926 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 937/1879] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:55 2022] DELETE /identity/v3/users/0eb0106b47a2405abf65e906feab2e12 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:55.578938 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-43378c48-8619-4eb4-8eed-1e67db77147a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b429597bfb2429396b61838d4cfea24'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:55.585706 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 943/1880] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:55 2022] DELETE /identity/v3/users/8b429597bfb2429396b61838d4cfea24 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:55.854378 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8ee4d-f1ae-4c07-8338-bfb3fc2c3d4d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:55.856099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-14d8ee4d-f1ae-4c07-8338-bfb3fc2c3d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:55.880420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43378c48-8619-4eb4-8eed-1e67db77147a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:55.881868 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-43378c48-8619-4eb4-8eed-1e67db77147a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:56.008173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43378c48-8619-4eb4-8eed-1e67db77147a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:56.013574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5877f-5d2a-450a-883f-edccc52730b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:56.015007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5877f-5d2a-450a-883f-edccc52730b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.015294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5877f-5d2a-450a-883f-edccc52730b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.015578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5877f-5d2a-450a-883f-edccc52730b7 admin admin] PATH_INFO: `/v3/projects/18cea87f474f4ff2b194df96d4cebd3a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.016843 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5877f-5d2a-450a-883f-edccc52730b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18cea87f474f4ff2b194df96d4cebd3a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:56.018795 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5877f-5d2a-450a-883f-edccc52730b7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:56.068660 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-84e5877f-5d2a-450a-883f-edccc52730b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18cea87f474f4ff2b194df96d4cebd3a', 'request_id': 'req-84e5877f-5d2a-450a-883f-edccc52730b7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:56.077217 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-84e5877f-5d2a-450a-883f-edccc52730b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18cea87f474f4ff2b194df96d4cebd3a', 'request_id': 'req-84e5877f-5d2a-450a-883f-edccc52730b7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:56.083606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-84e5877f-5d2a-450a-883f-edccc52730b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18cea87f474f4ff2b194df96d4cebd3a', 'request_id': 'req-84e5877f-5d2a-450a-883f-edccc52730b7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:56.092278 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8ee4d-f1ae-4c07-8338-bfb3fc2c3d4d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:56.094532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-84e5877f-5d2a-450a-883f-edccc52730b7 admin admin] The token cache is being invalidate because project 18cea87f474f4ff2b194df96d4cebd3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:56.094830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-84e5877f-5d2a-450a-883f-edccc52730b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:56.095456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-84e5877f-5d2a-450a-883f-edccc52730b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:56.097033 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 944/1881] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:55 2022] DELETE /identity/v3/projects/18cea87f474f4ff2b194df96d4cebd3a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:09:56.103152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e7d7e-ad9c-43e5-980c-8c65467e4150 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.103444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e7d7e-ad9c-43e5-980c-8c65467e4150 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.103728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e7d7e-ad9c-43e5-980c-8c65467e4150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.121213 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1d0e7d7e-ad9c-43e5-980c-8c65467e4150 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:56.122414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1d0e7d7e-ad9c-43e5-980c-8c65467e4150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:56.153068 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e339c-ad06-4a4e-a2fb-db63bb733a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:56.153927 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e339c-ad06-4a4e-a2fb-db63bb733a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.154204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e339c-ad06-4a4e-a2fb-db63bb733a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.154474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e339c-ad06-4a4e-a2fb-db63bb733a50 admin admin] PATH_INFO: `/v3/projects/a937200d84a042e78848f8d6cde8b10a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.156300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e339c-ad06-4a4e-a2fb-db63bb733a50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a937200d84a042e78848f8d6cde8b10a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:56.159791 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e339c-ad06-4a4e-a2fb-db63bb733a50 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:56.184478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 945/1882] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:09:56.196132 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00c71c-7b54-4c45-8a95-22a50a168e6b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.196491 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00c71c-7b54-4c45-8a95-22a50a168e6b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.196781 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00c71c-7b54-4c45-8a95-22a50a168e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.211300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-779e339c-ad06-4a4e-a2fb-db63bb733a50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a937200d84a042e78848f8d6cde8b10a', 'request_id': 'req-779e339c-ad06-4a4e-a2fb-db63bb733a50'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:56.215483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2d00c71c-7b54-4c45-8a95-22a50a168e6b None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:56.216838 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2d00c71c-7b54-4c45-8a95-22a50a168e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:56.216953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-779e339c-ad06-4a4e-a2fb-db63bb733a50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a937200d84a042e78848f8d6cde8b10a', 'request_id': 'req-779e339c-ad06-4a4e-a2fb-db63bb733a50'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:56.224829 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-779e339c-ad06-4a4e-a2fb-db63bb733a50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a937200d84a042e78848f8d6cde8b10a', 'request_id': 'req-779e339c-ad06-4a4e-a2fb-db63bb733a50'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:56.226093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:56.233228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:56.237939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-779e339c-ad06-4a4e-a2fb-db63bb733a50 admin admin] The token cache is being invalidate because project a937200d84a042e78848f8d6cde8b10a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:09:56.238409 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-779e339c-ad06-4a4e-a2fb-db63bb733a50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:56.239266 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-779e339c-ad06-4a4e-a2fb-db63bb733a50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:56.241641 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 938/1883] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:55 2022] DELETE /identity/v3/projects/a937200d84a042e78848f8d6cde8b10a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:56.249940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb2d37-d89a-4cc7-b4a3-146f7611af12 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.250228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb2d37-d89a-4cc7-b4a3-146f7611af12 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.250508 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb2d37-d89a-4cc7-b4a3-146f7611af12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.268788 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-98fb2d37-d89a-4cc7-b4a3-146f7611af12 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:56.269988 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-98fb2d37-d89a-4cc7-b4a3-146f7611af12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:56.282279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 946/1884] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:56.286491 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00c71c-7b54-4c45-8a95-22a50a168e6b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:56.295436 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00c71c-7b54-4c45-8a95-22a50a168e6b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:56.300036 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d176751-20d3-4c39-9749-4c6ac5ba2224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:56.300680 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d176751-20d3-4c39-9749-4c6ac5ba2224 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.300970 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d176751-20d3-4c39-9749-4c6ac5ba2224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.301252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d176751-20d3-4c39-9749-4c6ac5ba2224 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.301970 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d176751-20d3-4c39-9749-4c6ac5ba2224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:56.302280 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d176751-20d3-4c39-9749-4c6ac5ba2224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:56.303867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d176751-20d3-4c39-9749-4c6ac5ba2224 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:56.315861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 947/1885] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:09:56.320088 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d176751-20d3-4c39-9749-4c6ac5ba2224 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:56.330572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d176751-20d3-4c39-9749-4c6ac5ba2224 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:56.331545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 939/1886] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:09:56.335400 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26727884-eb17-4ab0-b9a8-35c040143eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:56.336069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26727884-eb17-4ab0-b9a8-35c040143eff admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.336358 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26727884-eb17-4ab0-b9a8-35c040143eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.336639 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26727884-eb17-4ab0-b9a8-35c040143eff admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.337334 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26727884-eb17-4ab0-b9a8-35c040143eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:56.339307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26727884-eb17-4ab0-b9a8-35c040143eff admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:56.340852 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1309d0-2824-4eb1-a91e-3418012d7f5c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.341141 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1309d0-2824-4eb1-a91e-3418012d7f5c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.341413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1309d0-2824-4eb1-a91e-3418012d7f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.359504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ba1309d0-2824-4eb1-a91e-3418012d7f5c None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:56.360718 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ba1309d0-2824-4eb1-a91e-3418012d7f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:56.369005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 948/1887] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:56 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:09:56.369993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26727884-eb17-4ab0-b9a8-35c040143eff admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:56.371942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 940/1888] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:09:56.376435 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1309d0-2824-4eb1-a91e-3418012d7f5c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:56.386966 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1309d0-2824-4eb1-a91e-3418012d7f5c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:56.447997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26727884-eb17-4ab0-b9a8-35c040143eff admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:56.453765 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96af3cd-f0aa-4ecb-b0fb-b361a9b78fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:56.454459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96af3cd-f0aa-4ecb-b0fb-b361a9b78fef admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.454836 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96af3cd-f0aa-4ecb-b0fb-b361a9b78fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.455014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96af3cd-f0aa-4ecb-b0fb-b361a9b78fef admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.463676 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96af3cd-f0aa-4ecb-b0fb-b361a9b78fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:56.463676 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96af3cd-f0aa-4ecb-b0fb-b361a9b78fef admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:56.477307 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520d3eb-e68f-49da-bf44-53298b9c343a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:56.478192 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520d3eb-e68f-49da-bf44-53298b9c343a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.478487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520d3eb-e68f-49da-bf44-53298b9c343a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.478766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520d3eb-e68f-49da-bf44-53298b9c343a admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.479689 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520d3eb-e68f-49da-bf44-53298b9c343a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:09:56.480037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520d3eb-e68f-49da-bf44-53298b9c343a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:56.481759 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520d3eb-e68f-49da-bf44-53298b9c343a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:56.482461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 949/1889] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:56 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:56.486785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96af3cd-f0aa-4ecb-b0fb-b361a9b78fef admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:56.496512 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96af3cd-f0aa-4ecb-b0fb-b361a9b78fef admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:56.496993 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 941/1890] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:09:56.501186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520d3eb-e68f-49da-bf44-53298b9c343a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:56.504272 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c8c93-b764-434a-adc1-da713753bd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:56.505030 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c8c93-b764-434a-adc1-da713753bd26 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.505383 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c8c93-b764-434a-adc1-da713753bd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.505731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c8c93-b764-434a-adc1-da713753bd26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.506545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c8c93-b764-434a-adc1-da713753bd26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:56.508575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c8c93-b764-434a-adc1-da713753bd26 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:56.511966 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520d3eb-e68f-49da-bf44-53298b9c343a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:56.519522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe4cd2-7a8a-4127-9143-191ca3c6ce6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:56.520330 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe4cd2-7a8a-4127-9143-191ca3c6ce6e admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.520731 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe4cd2-7a8a-4127-9143-191ca3c6ce6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.521076 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe4cd2-7a8a-4127-9143-191ca3c6ce6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.521852 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe4cd2-7a8a-4127-9143-191ca3c6ce6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:56.523832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe4cd2-7a8a-4127-9143-191ca3c6ce6e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:56.524016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 950/1891] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:09:56.524930 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c8c93-b764-434a-adc1-da713753bd26 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:56.545903 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c8c93-b764-434a-adc1-da713753bd26 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:56.553531 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7a2f1-a129-4461-94d9-eba9c8e76413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:56.554578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7a2f1-a129-4461-94d9-eba9c8e76413 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.555091 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7a2f1-a129-4461-94d9-eba9c8e76413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.555439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7a2f1-a129-4461-94d9-eba9c8e76413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.556290 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7a2f1-a129-4461-94d9-eba9c8e76413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:56.558029 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7a2f1-a129-4461-94d9-eba9c8e76413 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:56.564426 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 942/1892] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:56 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:56.565710 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe4cd2-7a8a-4127-9143-191ca3c6ce6e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:56.569690 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 951/1893] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:56.573705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7a2f1-a129-4461-94d9-eba9c8e76413 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:56.599421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7a2f1-a129-4461-94d9-eba9c8e76413 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:56.657574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:56.662212 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe4cd2-7a8a-4127-9143-191ca3c6ce6e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:56.668716 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263f6b1-f493-4217-b460-8e20935ec2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:56.669481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263f6b1-f493-4217-b460-8e20935ec2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.669843 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263f6b1-f493-4217-b460-8e20935ec2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.670304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263f6b1-f493-4217-b460-8e20935ec2e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.671504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263f6b1-f493-4217-b460-8e20935ec2e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:56.673451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263f6b1-f493-4217-b460-8e20935ec2e1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:56.675524 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d406b18-e70b-45c1-81fe-3ad111f44ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:56.676635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d406b18-e70b-45c1-81fe-3ad111f44ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.676985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d406b18-e70b-45c1-81fe-3ad111f44ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.677331 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d406b18-e70b-45c1-81fe-3ad111f44ce5 admin admin] PATH_INFO: `/v3/projects/1513d130f2ab450db8a12bd76757313c/users/c515e9590b744362bf15c8f23020c9a9/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.687085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:56.696097 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d406b18-e70b-45c1-81fe-3ad111f44ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1513d130f2ab450db8a12bd76757313c, user_id=c515e9590b744362bf15c8f23020c9a9, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:56.699036 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d406b18-e70b-45c1-81fe-3ad111f44ce5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:56.701799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 943/1894] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:56 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:09:56.706191 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263f6b1-f493-4217-b460-8e20935ec2e1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:56.715482 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 952/1895] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:56 2022] PUT /identity/v3/projects/1513d130f2ab450db8a12bd76757313c/users/c515e9590b744362bf15c8f23020c9a9/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:09:56.721003 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d23fd2-57a5-4dcf-b35c-bc87919c09bb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.721368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d23fd2-57a5-4dcf-b35c-bc87919c09bb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.721479 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263f6b1-f493-4217-b460-8e20935ec2e1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:56.721662 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d23fd2-57a5-4dcf-b35c-bc87919c09bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.751178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-58d23fd2-57a5-4dcf-b35c-bc87919c09bb None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:56.753227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-58d23fd2-57a5-4dcf-b35c-bc87919c09bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:56.800148 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c8509-de0c-45ce-83e5-40b571728163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:56.800834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c8509-de0c-45ce-83e5-40b571728163 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.801117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c8509-de0c-45ce-83e5-40b571728163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.801396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c8509-de0c-45ce-83e5-40b571728163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.802133 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c8509-de0c-45ce-83e5-40b571728163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:56.803734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c8509-de0c-45ce-83e5-40b571728163 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:56.814269 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 944/1896] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:56.818187 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c8509-de0c-45ce-83e5-40b571728163 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:56.825600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 953/1897] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:56.828414 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c8509-de0c-45ce-83e5-40b571728163 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:56.833140 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638033ba-14bf-42cb-8ed6-54b043f1c9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:56.834236 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638033ba-14bf-42cb-8ed6-54b043f1c9cc admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.834522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638033ba-14bf-42cb-8ed6-54b043f1c9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.834801 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d23fd2-57a5-4dcf-b35c-bc87919c09bb None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:56.834893 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638033ba-14bf-42cb-8ed6-54b043f1c9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.835534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638033ba-14bf-42cb-8ed6-54b043f1c9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:56.836634 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-58d23fd2-57a5-4dcf-b35c-bc87919c09bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:56.837148 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638033ba-14bf-42cb-8ed6-54b043f1c9cc admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:56.847406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 945/1898] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:56.851775 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638033ba-14bf-42cb-8ed6-54b043f1c9cc admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:56.861873 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638033ba-14bf-42cb-8ed6-54b043f1c9cc admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:56.867248 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60102d-22c4-48cc-89ec-98f67d3ddb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:56.868146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60102d-22c4-48cc-89ec-98f67d3ddb19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.868434 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60102d-22c4-48cc-89ec-98f67d3ddb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.868710 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60102d-22c4-48cc-89ec-98f67d3ddb19 admin admin] PATH_INFO: `/v3/projects/0014c3b95509435e828efeb66de3fdd4/users/167ad498253b45e6b649e4c232f05a69/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.884994 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60102d-22c4-48cc-89ec-98f67d3ddb19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0014c3b95509435e828efeb66de3fdd4, user_id=167ad498253b45e6b649e4c232f05a69, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:56.887654 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60102d-22c4-48cc-89ec-98f67d3ddb19 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:56.895273 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d23fd2-57a5-4dcf-b35c-bc87919c09bb None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:56.900655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 946/1899] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:56 2022] PUT /identity/v3/projects/0014c3b95509435e828efeb66de3fdd4/users/167ad498253b45e6b649e4c232f05a69/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:09:56.912576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b967803-c5ea-4a03-8230-cb408d7abc4a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.912870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b967803-c5ea-4a03-8230-cb408d7abc4a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.913149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b967803-c5ea-4a03-8230-cb408d7abc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.940878 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8b967803-c5ea-4a03-8230-cb408d7abc4a None None] MFA Rules not processed for user `167ad498253b45e6b649e4c232f05a69`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:56.942175 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8b967803-c5ea-4a03-8230-cb408d7abc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:56.951607 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe57a57-7d26-47ba-bf9d-4c050d1b8f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:56.952983 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe57a57-7d26-47ba-bf9d-4c050d1b8f84 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:56.953295 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe57a57-7d26-47ba-bf9d-4c050d1b8f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:56.953556 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe57a57-7d26-47ba-bf9d-4c050d1b8f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:56.996048 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:57.005728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 947/1900] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:09:57.010132 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b967803-c5ea-4a03-8230-cb408d7abc4a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:57.018887 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe57a57-7d26-47ba-bf9d-4c050d1b8f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:57.020388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe57a57-7d26-47ba-bf9d-4c050d1b8f84 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:57.036207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 954/1901] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:09:57.069268 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:57.086163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b967803-c5ea-4a03-8230-cb408d7abc4a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:57.090753 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c82dd8-2889-4bab-9606-efd33d4a2ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:57.091410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c82dd8-2889-4bab-9606-efd33d4a2ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:57.091690 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c82dd8-2889-4bab-9606-efd33d4a2ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:57.092059 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c82dd8-2889-4bab-9606-efd33d4a2ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:57.092806 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c82dd8-2889-4bab-9606-efd33d4a2ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:57.094696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c82dd8-2889-4bab-9606-efd33d4a2ee5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:57.125756 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 948/1902] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:57 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:09:57.129758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe57a57-7d26-47ba-bf9d-4c050d1b8f84 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:57.140191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe57a57-7d26-47ba-bf9d-4c050d1b8f84 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:57.200329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec89c6-02e5-4f76-b4e6-9fed9b7a958c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:57.201125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec89c6-02e5-4f76-b4e6-9fed9b7a958c admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:57.201465 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec89c6-02e5-4f76-b4e6-9fed9b7a958c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:57.202411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec89c6-02e5-4f76-b4e6-9fed9b7a958c admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:57.203221 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec89c6-02e5-4f76-b4e6-9fed9b7a958c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:57.205267 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec89c6-02e5-4f76-b4e6-9fed9b7a958c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:57.227228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 955/1903] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:57 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:57.231138 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c82dd8-2889-4bab-9606-efd33d4a2ee5 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:57.242342 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c82dd8-2889-4bab-9606-efd33d4a2ee5 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:57.247627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d38776-5435-434a-a0de-23a4e91b8aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:57.248324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d38776-5435-434a-a0de-23a4e91b8aca admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:57.249144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d38776-5435-434a-a0de-23a4e91b8aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:57.249636 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d38776-5435-434a-a0de-23a4e91b8aca admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:57.250439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d38776-5435-434a-a0de-23a4e91b8aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:57.252281 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d38776-5435-434a-a0de-23a4e91b8aca admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:57.263253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 949/1904] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:57.267910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec89c6-02e5-4f76-b4e6-9fed9b7a958c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:57.278861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec89c6-02e5-4f76-b4e6-9fed9b7a958c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:57.284059 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f56498-0153-4494-a5c8-7330b631f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:57.284790 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f56498-0153-4494-a5c8-7330b631f64c admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:57.285078 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f56498-0153-4494-a5c8-7330b631f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:57.285363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f56498-0153-4494-a5c8-7330b631f64c admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:57.286184 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f56498-0153-4494-a5c8-7330b631f64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:57.287780 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f56498-0153-4494-a5c8-7330b631f64c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:57.299854 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 956/1905] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:57.304860 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d38776-5435-434a-a0de-23a4e91b8aca admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:57.315703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d38776-5435-434a-a0de-23a4e91b8aca admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:57.320727 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ddf1e-5dd5-46fd-abfa-a92fec7c0319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:57.321717 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ddf1e-5dd5-46fd-abfa-a92fec7c0319 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:57.322074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ddf1e-5dd5-46fd-abfa-a92fec7c0319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:57.322414 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ddf1e-5dd5-46fd-abfa-a92fec7c0319 admin admin] PATH_INFO: `/v3/projects/69a76c6a138c41caa6c619409b00d125/users/b64cf4e83dda405c81a124e57aa34c7d/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:57.339054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ddf1e-5dd5-46fd-abfa-a92fec7c0319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69a76c6a138c41caa6c619409b00d125, user_id=b64cf4e83dda405c81a124e57aa34c7d, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:57.341929 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ddf1e-5dd5-46fd-abfa-a92fec7c0319 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:57.367794 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 950/1906] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:57 2022] PUT /identity/v3/projects/69a76c6a138c41caa6c619409b00d125/users/b64cf4e83dda405c81a124e57aa34c7d/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:57.386996 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b740576-3192-4dbe-bc9d-93a2f21fddf4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:57.387296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b740576-3192-4dbe-bc9d-93a2f21fddf4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:57.387583 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b740576-3192-4dbe-bc9d-93a2f21fddf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:57.413896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6b740576-3192-4dbe-bc9d-93a2f21fddf4 None None] MFA Rules not processed for user `b64cf4e83dda405c81a124e57aa34c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:57.415674 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6b740576-3192-4dbe-bc9d-93a2f21fddf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:57.510913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 957/1907] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:57.516149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ddf1e-5dd5-46fd-abfa-a92fec7c0319 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:57.638823 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ddf1e-5dd5-46fd-abfa-a92fec7c0319 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:57.645114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4937f02-ae4a-4265-abd4-6b5c23bb1465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:57.645803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4937f02-ae4a-4265-abd4-6b5c23bb1465 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:57.646090 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4937f02-ae4a-4265-abd4-6b5c23bb1465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:57.646356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4937f02-ae4a-4265-abd4-6b5c23bb1465 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:57.647082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4937f02-ae4a-4265-abd4-6b5c23bb1465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:57.649634 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4937f02-ae4a-4265-abd4-6b5c23bb1465 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:57.700538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b740576-3192-4dbe-bc9d-93a2f21fddf4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:57.711125 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 951/1908] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:57 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:57.714630 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b740576-3192-4dbe-bc9d-93a2f21fddf4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:57.773775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:57.810427 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41234b5a-9b20-42d4-a170-eacca6e74b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:57.811781 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41234b5a-9b20-42d4-a170-eacca6e74b20 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:57.812095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41234b5a-9b20-42d4-a170-eacca6e74b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:57.812433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41234b5a-9b20-42d4-a170-eacca6e74b20 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:57.813576 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41234b5a-9b20-42d4-a170-eacca6e74b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:57.816014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41234b5a-9b20-42d4-a170-eacca6e74b20 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:57.857265 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4937f02-ae4a-4265-abd4-6b5c23bb1465 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:57.868215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 958/1909] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:57 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:57.874185 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4937f02-ae4a-4265-abd4-6b5c23bb1465 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:57.888130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a4977-f195-4e1b-aaec-f5b7086ced73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:57.893065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a4977-f195-4e1b-aaec-f5b7086ced73 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:57.893835 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a4977-f195-4e1b-aaec-f5b7086ced73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:57.893835 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a4977-f195-4e1b-aaec-f5b7086ced73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:57.894653 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a4977-f195-4e1b-aaec-f5b7086ced73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:57.896840 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a4977-f195-4e1b-aaec-f5b7086ced73 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:57.917048 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41234b5a-9b20-42d4-a170-eacca6e74b20 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:57.917965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 952/1910] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:09:57.929763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41234b5a-9b20-42d4-a170-eacca6e74b20 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:57.936608 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbd535-18fb-4fac-b0a7-c72fc4998ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:57.937880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbd535-18fb-4fac-b0a7-c72fc4998ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:57.938330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbd535-18fb-4fac-b0a7-c72fc4998ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:57.938804 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbd535-18fb-4fac-b0a7-c72fc4998ddd admin admin] PATH_INFO: `/v3/projects/988dfc6dcae048acb5319324afa96ea8/users/5b5b5bd193c5446aafee0589a65d7fc8/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:57.969400 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbd535-18fb-4fac-b0a7-c72fc4998ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=988dfc6dcae048acb5319324afa96ea8, user_id=5b5b5bd193c5446aafee0589a65d7fc8, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:57.973133 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbd535-18fb-4fac-b0a7-c72fc4998ddd admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:57.990052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 959/1911] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:57 2022] PUT /identity/v3/projects/988dfc6dcae048acb5319324afa96ea8/users/5b5b5bd193c5446aafee0589a65d7fc8/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:09:57.994153 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbd535-18fb-4fac-b0a7-c72fc4998ddd admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:57.995423 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df604f8-6ee6-4821-9eec-ce75d702785c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:57.996134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df604f8-6ee6-4821-9eec-ce75d702785c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:57.996858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df604f8-6ee6-4821-9eec-ce75d702785c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:58.066973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9df604f8-6ee6-4821-9eec-ce75d702785c None None] MFA Rules not processed for user `c515e9590b744362bf15c8f23020c9a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:58.068176 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9df604f8-6ee6-4821-9eec-ce75d702785c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:58.122643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbd535-18fb-4fac-b0a7-c72fc4998ddd admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:58.129283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b464149-3ec5-4fd7-bf57-d5937a6e7aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:58.130217 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b464149-3ec5-4fd7-bf57-d5937a6e7aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:58.130676 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b464149-3ec5-4fd7-bf57-d5937a6e7aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:58.131102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b464149-3ec5-4fd7-bf57-d5937a6e7aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:58.132018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b464149-3ec5-4fd7-bf57-d5937a6e7aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:58.133852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b464149-3ec5-4fd7-bf57-d5937a6e7aa0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:58.152728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 960/1912] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:58.153756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b464149-3ec5-4fd7-bf57-d5937a6e7aa0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:58.164555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b464149-3ec5-4fd7-bf57-d5937a6e7aa0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:58.170135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f402a9a-7854-40d8-a28f-351e090333f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:58.172292 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f402a9a-7854-40d8-a28f-351e090333f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:58.172445 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f402a9a-7854-40d8-a28f-351e090333f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:58.172597 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f402a9a-7854-40d8-a28f-351e090333f1 admin admin] PATH_INFO: `/v3/projects/988dfc6dcae048acb5319324afa96ea8/users/5b5b5bd193c5446aafee0589a65d7fc8/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:58.175343 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f402a9a-7854-40d8-a28f-351e090333f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=988dfc6dcae048acb5319324afa96ea8, user_id=5b5b5bd193c5446aafee0589a65d7fc8, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:58.182015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f402a9a-7854-40d8-a28f-351e090333f1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:58.184392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:58.192758 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 953/1913] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:58.197930 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df604f8-6ee6-4821-9eec-ce75d702785c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:58.214667 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 961/1914] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:58 2022] PUT /identity/v3/projects/988dfc6dcae048acb5319324afa96ea8/users/5b5b5bd193c5446aafee0589a65d7fc8/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:58.217711 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbf69c-a8d2-43f0-8489-6bcdae9c91ac None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:58.218184 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbf69c-a8d2-43f0-8489-6bcdae9c91ac None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:58.218477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbf69c-a8d2-43f0-8489-6bcdae9c91ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:58.220524 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df604f8-6ee6-4821-9eec-ce75d702785c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:58.250164 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a7fbf69c-a8d2-43f0-8489-6bcdae9c91ac None None] MFA Rules not processed for user `5b5b5bd193c5446aafee0589a65d7fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:58.252229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a7fbf69c-a8d2-43f0-8489-6bcdae9c91ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:58.353299 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efd0a6-a015-4614-9e43-2fb3cb9dc729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:58.355139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efd0a6-a015-4614-9e43-2fb3cb9dc729 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:58.355865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efd0a6-a015-4614-9e43-2fb3cb9dc729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:58.356313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efd0a6-a015-4614-9e43-2fb3cb9dc729 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:58.357713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3efd0a6-a015-4614-9e43-2fb3cb9dc729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:58.361820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3efd0a6-a015-4614-9e43-2fb3cb9dc729 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:58.381092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 962/1915] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:58.389822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbf69c-a8d2-43f0-8489-6bcdae9c91ac None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:58.391198 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a7fbf69c-a8d2-43f0-8489-6bcdae9c91ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:58.413346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 954/1916] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:09:58 2022] POST /identity/v3/projects => generated 371 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:09:58.418121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efd0a6-a015-4614-9e43-2fb3cb9dc729 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:58.430681 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:58.490051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbf69c-a8d2-43f0-8489-6bcdae9c91ac None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:58.515806 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efd0a6-a015-4614-9e43-2fb3cb9dc729 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:58.522467 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0df48a-a359-4eaa-8f6c-ed0e1d2a9d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:58.523319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0df48a-a359-4eaa-8f6c-ed0e1d2a9d9f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:58.524308 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0df48a-a359-4eaa-8f6c-ed0e1d2a9d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:58.524700 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0df48a-a359-4eaa-8f6c-ed0e1d2a9d9f admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:58.525510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0df48a-a359-4eaa-8f6c-ed0e1d2a9d9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:58.528567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0df48a-a359-4eaa-8f6c-ed0e1d2a9d9f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:58.551485 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc2e50-c823-4bae-b5bb-5030b801e851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:58.552269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc2e50-c823-4bae-b5bb-5030b801e851 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:58.552657 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc2e50-c823-4bae-b5bb-5030b801e851 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:58.552998 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc2e50-c823-4bae-b5bb-5030b801e851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:58.558002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 955/1917] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:09:58 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:09:58.562121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0df48a-a359-4eaa-8f6c-ed0e1d2a9d9f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:58.586185 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0df48a-a359-4eaa-8f6c-ed0e1d2a9d9f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:58.592920 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c381b-0374-427b-9933-7d5827733d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:58.593707 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c381b-0374-427b-9933-7d5827733d5c admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:58.594069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c381b-0374-427b-9933-7d5827733d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:58.594428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c381b-0374-427b-9933-7d5827733d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:58.595236 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c381b-0374-427b-9933-7d5827733d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:58.596944 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c381b-0374-427b-9933-7d5827733d5c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:58.609604 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 956/1918] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:58.613748 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c381b-0374-427b-9933-7d5827733d5c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:58.623399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc2e50-c823-4bae-b5bb-5030b801e851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:58.624348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c381b-0374-427b-9933-7d5827733d5c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:58.624921 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc2e50-c823-4bae-b5bb-5030b801e851 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:58.629511 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68aa2a3-8e1b-41b4-863b-ba0fc9fcc8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:58.630536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68aa2a3-8e1b-41b4-863b-ba0fc9fcc8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:58.630768 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68aa2a3-8e1b-41b4-863b-ba0fc9fcc8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:58.631151 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68aa2a3-8e1b-41b4-863b-ba0fc9fcc8ff admin admin] PATH_INFO: `/v3/projects/ce7060828e0245caa7fc33a9c7a3d22f/users/8c9650fb01b14a35bf4397e74cb3a23c/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:58.635947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 963/1919] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:09:58.646799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68aa2a3-8e1b-41b4-863b-ba0fc9fcc8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7060828e0245caa7fc33a9c7a3d22f, user_id=8c9650fb01b14a35bf4397e74cb3a23c, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:58.649475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68aa2a3-8e1b-41b4-863b-ba0fc9fcc8ff admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:58.668409 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 957/1920] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:58 2022] PUT /identity/v3/projects/ce7060828e0245caa7fc33a9c7a3d22f/users/8c9650fb01b14a35bf4397e74cb3a23c/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:09:58.673206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc2e50-c823-4bae-b5bb-5030b801e851 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:58.687297 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc2e50-c823-4bae-b5bb-5030b801e851 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:58.768092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfefe93-bd9e-4ab4-8731-88bd27b4b285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:58.768779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfefe93-bd9e-4ab4-8731-88bd27b4b285 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:58.769069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfefe93-bd9e-4ab4-8731-88bd27b4b285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:58.769348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfefe93-bd9e-4ab4-8731-88bd27b4b285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:58.770083 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfefe93-bd9e-4ab4-8731-88bd27b4b285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:58.771670 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfefe93-bd9e-4ab4-8731-88bd27b4b285 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:58.783318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 964/1921] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:09:58.787478 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68aa2a3-8e1b-41b4-863b-ba0fc9fcc8ff admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:58.799125 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68aa2a3-8e1b-41b4-863b-ba0fc9fcc8ff admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:58.806451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8f4d9-786c-4a7d-8643-f3a129347795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:58.807824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8f4d9-786c-4a7d-8643-f3a129347795 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:58.808177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8f4d9-786c-4a7d-8643-f3a129347795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:58.808469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8f4d9-786c-4a7d-8643-f3a129347795 admin admin] PATH_INFO: `/v3/projects/ce7060828e0245caa7fc33a9c7a3d22f/users/8c9650fb01b14a35bf4397e74cb3a23c/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:58.811221 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8f4d9-786c-4a7d-8643-f3a129347795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7060828e0245caa7fc33a9c7a3d22f, user_id=8c9650fb01b14a35bf4397e74cb3a23c, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:58.814926 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8f4d9-786c-4a7d-8643-f3a129347795 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:58.830562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 958/1922] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:09:58 2022] PUT /identity/v3/projects/ce7060828e0245caa7fc33a9c7a3d22f/users/8c9650fb01b14a35bf4397e74cb3a23c/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:58.891835 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfefe93-bd9e-4ab4-8731-88bd27b4b285 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:58.894501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8cfefe93-bd9e-4ab4-8731-88bd27b4b285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:58.935671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfefe93-bd9e-4ab4-8731-88bd27b4b285 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:58.981605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:59.059564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008e8ae-44e5-450b-8ff7-140478f208a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:59.061664 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008e8ae-44e5-450b-8ff7-140478f208a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:59.062186 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008e8ae-44e5-450b-8ff7-140478f208a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:59.062538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008e8ae-44e5-450b-8ff7-140478f208a4 admin admin] PATH_INFO: `/v3/users/f223cadd809c4b63b9a360607cb96f4b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:59.076317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008e8ae-44e5-450b-8ff7-140478f208a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f223cadd809c4b63b9a360607cb96f4b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:59.079499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008e8ae-44e5-450b-8ff7-140478f208a4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:59.203773 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9008e8ae-44e5-450b-8ff7-140478f208a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f223cadd809c4b63b9a360607cb96f4b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:59.204555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9008e8ae-44e5-450b-8ff7-140478f208a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f223cadd809c4b63b9a360607cb96f4b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:59.214050 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9008e8ae-44e5-450b-8ff7-140478f208a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f223cadd809c4b63b9a360607cb96f4b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:59.223653 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9008e8ae-44e5-450b-8ff7-140478f208a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f223cadd809c4b63b9a360607cb96f4b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:59.240487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9008e8ae-44e5-450b-8ff7-140478f208a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f223cadd809c4b63b9a360607cb96f4b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:09:59.251434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 965/1923] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:09:58 2022] DELETE /identity/v3/users/f223cadd809c4b63b9a360607cb96f4b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:09:59.253411 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085ac09-0c99-44eb-91e4-d3e3184a2318 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:59.253706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085ac09-0c99-44eb-91e4-d3e3184a2318 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:59.253981 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085ac09-0c99-44eb-91e4-d3e3184a2318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:59.274004 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2085ac09-0c99-44eb-91e4-d3e3184a2318 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:09:59.275231 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2085ac09-0c99-44eb-91e4-d3e3184a2318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:59.300614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:09:59.353554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 959/1924] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:09:59.360647 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008e8ae-44e5-450b-8ff7-140478f208a4 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:59.363139 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9008e8ae-44e5-450b-8ff7-140478f208a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:59.450959 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008e8ae-44e5-450b-8ff7-140478f208a4 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:59.455211 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9592d-5ee3-4160-b816-6fcadd84cd79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:59.455867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9592d-5ee3-4160-b816-6fcadd84cd79 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:59.456208 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9592d-5ee3-4160-b816-6fcadd84cd79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:59.456489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9592d-5ee3-4160-b816-6fcadd84cd79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:59.466347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9592d-5ee3-4160-b816-6fcadd84cd79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:59.468082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9592d-5ee3-4160-b816-6fcadd84cd79 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:09:59.483082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 966/1925] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:09:59.965619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085ac09-0c99-44eb-91e4-d3e3184a2318 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:09:59.967686 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2085ac09-0c99-44eb-91e4-d3e3184a2318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:09:59.984487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085ac09-0c99-44eb-91e4-d3e3184a2318 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:09:59.990730 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dd7f1-4b94-4193-9b86-ac1863a94ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:09:59.991803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dd7f1-4b94-4193-9b86-ac1863a94ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:09:59.992127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dd7f1-4b94-4193-9b86-ac1863a94ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:09:59.992410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dd7f1-4b94-4193-9b86-ac1863a94ae3 admin admin] PATH_INFO: `/v3/projects/389ca4b427e645848f074325d8011152` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:09:59.994684 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172dd7f1-4b94-4193-9b86-ac1863a94ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=389ca4b427e645848f074325d8011152)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:09:59.997233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172dd7f1-4b94-4193-9b86-ac1863a94ae3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:00.031448 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482e955-79ba-4ed1-affc-ccf53d3b8f37 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:00.031839 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482e955-79ba-4ed1-affc-ccf53d3b8f37 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:00.032280 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482e955-79ba-4ed1-affc-ccf53d3b8f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:00.089585 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f482e955-79ba-4ed1-affc-ccf53d3b8f37 None None] MFA Rules not processed for user `8c9650fb01b14a35bf4397e74cb3a23c`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:00.091234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f482e955-79ba-4ed1-affc-ccf53d3b8f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:00.096734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-172dd7f1-4b94-4193-9b86-ac1863a94ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389ca4b427e645848f074325d8011152', 'request_id': 'req-172dd7f1-4b94-4193-9b86-ac1863a94ae3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:00.104075 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-172dd7f1-4b94-4193-9b86-ac1863a94ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389ca4b427e645848f074325d8011152', 'request_id': 'req-172dd7f1-4b94-4193-9b86-ac1863a94ae3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:00.127942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-172dd7f1-4b94-4193-9b86-ac1863a94ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389ca4b427e645848f074325d8011152', 'request_id': 'req-172dd7f1-4b94-4193-9b86-ac1863a94ae3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:00.147452 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:00.147601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-172dd7f1-4b94-4193-9b86-ac1863a94ae3 admin admin] The token cache is being invalidate because project 389ca4b427e645848f074325d8011152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:00.150859 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-172dd7f1-4b94-4193-9b86-ac1863a94ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:00.151381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-172dd7f1-4b94-4193-9b86-ac1863a94ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:00.153518 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 960/1926] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:09:59 2022] DELETE /identity/v3/projects/389ca4b427e645848f074325d8011152 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:00.159381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dd7f1-4b94-4193-9b86-ac1863a94ae3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:00.161766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-172dd7f1-4b94-4193-9b86-ac1863a94ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:00.209259 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 967/1927] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:00.232301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482e955-79ba-4ed1-affc-ccf53d3b8f37 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:00.237025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f482e955-79ba-4ed1-affc-ccf53d3b8f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:00.276477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dd7f1-4b94-4193-9b86-ac1863a94ae3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:00.284256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3251d7-6d0d-4db6-9631-2d9bfd0787dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:00.285321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3251d7-6d0d-4db6-9631-2d9bfd0787dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:00.286136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3251d7-6d0d-4db6-9631-2d9bfd0787dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:00.286514 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3251d7-6d0d-4db6-9631-2d9bfd0787dd admin admin] PATH_INFO: `/v3/users/b3d8bef72e754336b5ebbb6b9f3e904b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:00.287947 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3251d7-6d0d-4db6-9631-2d9bfd0787dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3d8bef72e754336b5ebbb6b9f3e904b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:00.290273 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3251d7-6d0d-4db6-9631-2d9bfd0787dd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:00.331529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482e955-79ba-4ed1-affc-ccf53d3b8f37 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:00.339648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f2aac-d70e-42ce-86a7-97cf0b3b7980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:00.340572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f2aac-d70e-42ce-86a7-97cf0b3b7980 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:00.340909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f2aac-d70e-42ce-86a7-97cf0b3b7980 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:00.341273 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f2aac-d70e-42ce-86a7-97cf0b3b7980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:00.346968 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b11f2aac-d70e-42ce-86a7-97cf0b3b7980 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:00.377383 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2b3251d7-6d0d-4db6-9631-2d9bfd0787dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3d8bef72e754336b5ebbb6b9f3e904b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:00.384266 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:00.390417 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2b3251d7-6d0d-4db6-9631-2d9bfd0787dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3d8bef72e754336b5ebbb6b9f3e904b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:00.400229 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2b3251d7-6d0d-4db6-9631-2d9bfd0787dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3d8bef72e754336b5ebbb6b9f3e904b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:00.401199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2b3251d7-6d0d-4db6-9631-2d9bfd0787dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3d8bef72e754336b5ebbb6b9f3e904b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:00.401987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2b3251d7-6d0d-4db6-9631-2d9bfd0787dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3d8bef72e754336b5ebbb6b9f3e904b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:00.424108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 961/1928] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:00 2022] DELETE /identity/v3/users/b3d8bef72e754336b5ebbb6b9f3e904b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:00.425230 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3251d7-6d0d-4db6-9631-2d9bfd0787dd admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:00.426748 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2b3251d7-6d0d-4db6-9631-2d9bfd0787dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:00.454629 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f2aac-d70e-42ce-86a7-97cf0b3b7980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:00.456384 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f2aac-d70e-42ce-86a7-97cf0b3b7980 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:00.486295 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 968/1929] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:00.555417 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3251d7-6d0d-4db6-9631-2d9bfd0787dd admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:00.564194 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a402142-1a27-4a4f-9a07-52cae979b656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:00.565454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a402142-1a27-4a4f-9a07-52cae979b656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:00.566080 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a402142-1a27-4a4f-9a07-52cae979b656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:00.566527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a402142-1a27-4a4f-9a07-52cae979b656 admin admin] PATH_INFO: `/v3/users/99c4dd7013614b3ba85ed83bbf7279ad` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:00.568297 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a402142-1a27-4a4f-9a07-52cae979b656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c4dd7013614b3ba85ed83bbf7279ad)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:00.571356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a402142-1a27-4a4f-9a07-52cae979b656 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:00.627734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6a402142-1a27-4a4f-9a07-52cae979b656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c4dd7013614b3ba85ed83bbf7279ad'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:00.636414 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6a402142-1a27-4a4f-9a07-52cae979b656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c4dd7013614b3ba85ed83bbf7279ad'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:00.650303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6a402142-1a27-4a4f-9a07-52cae979b656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c4dd7013614b3ba85ed83bbf7279ad'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:00.651112 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6a402142-1a27-4a4f-9a07-52cae979b656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c4dd7013614b3ba85ed83bbf7279ad'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:00.652127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6a402142-1a27-4a4f-9a07-52cae979b656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c4dd7013614b3ba85ed83bbf7279ad'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:00.679487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 962/1930] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:00 2022] DELETE /identity/v3/users/99c4dd7013614b3ba85ed83bbf7279ad => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:00.683947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14007b-0870-4fae-b6a6-d24cedd77e89 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:00.684371 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14007b-0870-4fae-b6a6-d24cedd77e89 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:00.684747 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14007b-0870-4fae-b6a6-d24cedd77e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:00.705600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5e14007b-0870-4fae-b6a6-d24cedd77e89 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:00.714754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5e14007b-0870-4fae-b6a6-d24cedd77e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:00.800373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 969/1931] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:00.810707 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a402142-1a27-4a4f-9a07-52cae979b656 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:00.813173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6a402142-1a27-4a4f-9a07-52cae979b656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:00.871574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14007b-0870-4fae-b6a6-d24cedd77e89 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:00.873212 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5e14007b-0870-4fae-b6a6-d24cedd77e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:00.892539 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14007b-0870-4fae-b6a6-d24cedd77e89 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:00.899754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe6b79-3e2d-46cf-9326-80b7ef53199d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:00.901052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe6b79-3e2d-46cf-9326-80b7ef53199d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:00.901373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe6b79-3e2d-46cf-9326-80b7ef53199d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:00.901656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe6b79-3e2d-46cf-9326-80b7ef53199d admin admin] PATH_INFO: `/v3/projects/1f2c787dadc84b73b650ec8d85f411ac` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:00.903077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe6b79-3e2d-46cf-9326-80b7ef53199d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f2c787dadc84b73b650ec8d85f411ac)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:00.904981 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe6b79-3e2d-46cf-9326-80b7ef53199d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:00.907635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:00.913844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a402142-1a27-4a4f-9a07-52cae979b656 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:00.919877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b8023-f5bc-4fcd-8033-e5f732fd865c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:00.921197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b8023-f5bc-4fcd-8033-e5f732fd865c service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:00.921816 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b8023-f5bc-4fcd-8033-e5f732fd865c service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:00.922451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b8023-f5bc-4fcd-8033-e5f732fd865c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:00.934117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b8023-f5bc-4fcd-8033-e5f732fd865c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:00.938349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b8023-f5bc-4fcd-8033-e5f732fd865c service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:00.948652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:00.952858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 963/1932] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:00.984748 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b5fe6b79-3e2d-46cf-9326-80b7ef53199d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f2c787dadc84b73b650ec8d85f411ac', 'request_id': 'req-b5fe6b79-3e2d-46cf-9326-80b7ef53199d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:00.992807 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b5fe6b79-3e2d-46cf-9326-80b7ef53199d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f2c787dadc84b73b650ec8d85f411ac', 'request_id': 'req-b5fe6b79-3e2d-46cf-9326-80b7ef53199d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:01.000561 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b5fe6b79-3e2d-46cf-9326-80b7ef53199d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f2c787dadc84b73b650ec8d85f411ac', 'request_id': 'req-b5fe6b79-3e2d-46cf-9326-80b7ef53199d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:01.015522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b5fe6b79-3e2d-46cf-9326-80b7ef53199d admin admin] The token cache is being invalidate because project 1f2c787dadc84b73b650ec8d85f411ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:01.015829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b5fe6b79-3e2d-46cf-9326-80b7ef53199d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:01.016656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b5fe6b79-3e2d-46cf-9326-80b7ef53199d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:01.018502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 970/1933] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:00 2022] DELETE /identity/v3/projects/1f2c787dadc84b73b650ec8d85f411ac => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:01.023108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a049dc-aa70-4d47-b840-4b7e80aa4db3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:01.023661 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a049dc-aa70-4d47-b840-4b7e80aa4db3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:01.023661 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a049dc-aa70-4d47-b840-4b7e80aa4db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:01.050893 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-20a049dc-aa70-4d47-b840-4b7e80aa4db3 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:01.052158 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-20a049dc-aa70-4d47-b840-4b7e80aa4db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:01.144001 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 964/1934] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:01.157525 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccd1cf-7162-4cd5-8513-420c31a2b922 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:01.157954 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccd1cf-7162-4cd5-8513-420c31a2b922 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:01.158116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccd1cf-7162-4cd5-8513-420c31a2b922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:01.177843 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-37ccd1cf-7162-4cd5-8513-420c31a2b922 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:01.179046 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-37ccd1cf-7162-4cd5-8513-420c31a2b922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:01.192744 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 971/1935] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:01.193980 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a049dc-aa70-4d47-b840-4b7e80aa4db3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:01.204449 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a049dc-aa70-4d47-b840-4b7e80aa4db3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:01.210168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d47fc-99c9-47e6-8a4f-ea67c7de5c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:01.210973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d47fc-99c9-47e6-8a4f-ea67c7de5c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:01.211391 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d47fc-99c9-47e6-8a4f-ea67c7de5c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:01.211761 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d47fc-99c9-47e6-8a4f-ea67c7de5c98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:01.212905 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d47fc-99c9-47e6-8a4f-ea67c7de5c98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:10:01.212905 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d47fc-99c9-47e6-8a4f-ea67c7de5c98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:01.214769 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d47fc-99c9-47e6-8a4f-ea67c7de5c98 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:01.234800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 965/1936] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:10:01.240416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccd1cf-7162-4cd5-8513-420c31a2b922 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:01.256558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccd1cf-7162-4cd5-8513-420c31a2b922 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:01.262031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97b3c6-c364-47fc-bad0-ce13d5ebd59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:01.262699 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97b3c6-c364-47fc-bad0-ce13d5ebd59d admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:01.262991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97b3c6-c364-47fc-bad0-ce13d5ebd59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:01.263274 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97b3c6-c364-47fc-bad0-ce13d5ebd59d admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:01.264176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97b3c6-c364-47fc-bad0-ce13d5ebd59d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:01.265935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d47fc-99c9-47e6-8a4f-ea67c7de5c98 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:01.266095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97b3c6-c364-47fc-bad0-ce13d5ebd59d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:01.268784 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-146d47fc-99c9-47e6-8a4f-ea67c7de5c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:01.296680 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d47fc-99c9-47e6-8a4f-ea67c7de5c98 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:01.297837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 972/1937] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:01 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:01.301905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97b3c6-c364-47fc-bad0-ce13d5ebd59d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:01.362570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aba343-85c6-4b00-9175-4352c9be6e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:01.363450 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba343-85c6-4b00-9175-4352c9be6e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:01.363731 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba343-85c6-4b00-9175-4352c9be6e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:01.364043 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aba343-85c6-4b00-9175-4352c9be6e8e admin admin] PATH_INFO: `/v3/projects/8badc71441ac451f87463526981e4910` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:01.365269 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aba343-85c6-4b00-9175-4352c9be6e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8badc71441ac451f87463526981e4910)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:01.367206 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aba343-85c6-4b00-9175-4352c9be6e8e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:01.377980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97b3c6-c364-47fc-bad0-ce13d5ebd59d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:01.383730 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfaaba-a62e-4e94-b250-23cded1c6d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:01.384526 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfaaba-a62e-4e94-b250-23cded1c6d54 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:01.384913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfaaba-a62e-4e94-b250-23cded1c6d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:01.385210 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfaaba-a62e-4e94-b250-23cded1c6d54 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:01.385928 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfaaba-a62e-4e94-b250-23cded1c6d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:01.387856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfaaba-a62e-4e94-b250-23cded1c6d54 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:01.412967 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 973/1938] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:01 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:10:01.412967 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfaaba-a62e-4e94-b250-23cded1c6d54 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:01.412967 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c7dfaaba-a62e-4e94-b250-23cded1c6d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:01.427746 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e7aba343-85c6-4b00-9175-4352c9be6e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8badc71441ac451f87463526981e4910', 'request_id': 'req-e7aba343-85c6-4b00-9175-4352c9be6e8e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:01.433472 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e7aba343-85c6-4b00-9175-4352c9be6e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8badc71441ac451f87463526981e4910', 'request_id': 'req-e7aba343-85c6-4b00-9175-4352c9be6e8e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:01.441054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e7aba343-85c6-4b00-9175-4352c9be6e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8badc71441ac451f87463526981e4910', 'request_id': 'req-e7aba343-85c6-4b00-9175-4352c9be6e8e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:01.455314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e7aba343-85c6-4b00-9175-4352c9be6e8e admin admin] The token cache is being invalidate because project 8badc71441ac451f87463526981e4910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:01.455611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e7aba343-85c6-4b00-9175-4352c9be6e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:01.456367 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e7aba343-85c6-4b00-9175-4352c9be6e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:01.458053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 966/1939] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:01 2022] DELETE /identity/v3/projects/8badc71441ac451f87463526981e4910 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:01.458960 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aba343-85c6-4b00-9175-4352c9be6e8e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:01.460394 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e7aba343-85c6-4b00-9175-4352c9be6e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:01.470868 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:01.474759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfaaba-a62e-4e94-b250-23cded1c6d54 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:01.501076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:01.526411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e44ac-b5bb-47cf-87bd-7843a6f0a98f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:01.526618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aba343-85c6-4b00-9175-4352c9be6e8e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:01.527070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e44ac-b5bb-47cf-87bd-7843a6f0a98f service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:01.527356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e44ac-b5bb-47cf-87bd-7843a6f0a98f service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:01.527639 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e44ac-b5bb-47cf-87bd-7843a6f0a98f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:01.529420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3c8e44ac-b5bb-47cf-87bd-7843a6f0a98f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:01.531845 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ca9f8-9cdb-4cef-aafa-cc20fa234e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:01.532541 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ca9f8-9cdb-4cef-aafa-cc20fa234e2a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:01.532855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ca9f8-9cdb-4cef-aafa-cc20fa234e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:01.533256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ca9f8-9cdb-4cef-aafa-cc20fa234e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:01.533991 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ca9f8-9cdb-4cef-aafa-cc20fa234e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:01.535612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ca9f8-9cdb-4cef-aafa-cc20fa234e2a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:01.550330 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 967/1940] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:01.551253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ca9f8-9cdb-4cef-aafa-cc20fa234e2a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:01.552998 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8a0ca9f8-9cdb-4cef-aafa-cc20fa234e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:01.565724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ca9f8-9cdb-4cef-aafa-cc20fa234e2a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:01.570528 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795c064-cb3f-4e34-a15d-77f37f92f9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:01.571396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795c064-cb3f-4e34-a15d-77f37f92f9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:01.571680 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795c064-cb3f-4e34-a15d-77f37f92f9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:01.572009 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795c064-cb3f-4e34-a15d-77f37f92f9d6 admin admin] PATH_INFO: `/v3/users/a4cc7fda2b01474eabfc2bd7a2307c50` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:01.573192 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795c064-cb3f-4e34-a15d-77f37f92f9d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4cc7fda2b01474eabfc2bd7a2307c50)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:01.575752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795c064-cb3f-4e34-a15d-77f37f92f9d6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:01.596747 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e44ac-b5bb-47cf-87bd-7843a6f0a98f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:01.598470 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e44ac-b5bb-47cf-87bd-7843a6f0a98f service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:01.609017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 974/1941] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:01.610129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e44ac-b5bb-47cf-87bd-7843a6f0a98f service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:01.621852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e44ac-b5bb-47cf-87bd-7843a6f0a98f service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:01.626974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40937373-e7f2-4103-aebf-e3db3583e0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:01.628094 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40937373-e7f2-4103-aebf-e3db3583e0ea admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:01.628638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40937373-e7f2-4103-aebf-e3db3583e0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:01.629075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40937373-e7f2-4103-aebf-e3db3583e0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:01.629968 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40937373-e7f2-4103-aebf-e3db3583e0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:01.631875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40937373-e7f2-4103-aebf-e3db3583e0ea admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:01.637836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4795c064-cb3f-4e34-a15d-77f37f92f9d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4cc7fda2b01474eabfc2bd7a2307c50'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:01.649702 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 975/1942] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:01.649969 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4795c064-cb3f-4e34-a15d-77f37f92f9d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4cc7fda2b01474eabfc2bd7a2307c50'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:01.651379 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40937373-e7f2-4103-aebf-e3db3583e0ea admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:01.663070 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4795c064-cb3f-4e34-a15d-77f37f92f9d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4cc7fda2b01474eabfc2bd7a2307c50'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:01.663730 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4795c064-cb3f-4e34-a15d-77f37f92f9d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4cc7fda2b01474eabfc2bd7a2307c50'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:01.665563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4795c064-cb3f-4e34-a15d-77f37f92f9d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4cc7fda2b01474eabfc2bd7a2307c50'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:01.665838 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40937373-e7f2-4103-aebf-e3db3583e0ea admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:01.673133 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230c92b-c631-42c3-acee-c7fe334456d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:01.674164 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230c92b-c631-42c3-acee-c7fe334456d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:01.674543 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230c92b-c631-42c3-acee-c7fe334456d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:01.674916 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230c92b-c631-42c3-acee-c7fe334456d1 admin admin] PATH_INFO: `/v3/projects/8ffbf62516a042019f58a11abbcb85eb/users/64c91e124a40427ca1371a0ca4d58b6c/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:01.694197 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230c92b-c631-42c3-acee-c7fe334456d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ffbf62516a042019f58a11abbcb85eb, user_id=64c91e124a40427ca1371a0ca4d58b6c, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:01.697533 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230c92b-c631-42c3-acee-c7fe334456d1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:01.697727 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 968/1943] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:01 2022] DELETE /identity/v3/users/a4cc7fda2b01474eabfc2bd7a2307c50 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:01.714331 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 976/1944] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:01 2022] PUT /identity/v3/projects/8ffbf62516a042019f58a11abbcb85eb/users/64c91e124a40427ca1371a0ca4d58b6c/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:01.727824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0dd63-441c-4961-a74e-6a052733c807 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:01.728263 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0dd63-441c-4961-a74e-6a052733c807 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:01.728640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0dd63-441c-4961-a74e-6a052733c807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:01.775115 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-01b0dd63-441c-4961-a74e-6a052733c807 None None] MFA Rules not processed for user `64c91e124a40427ca1371a0ca4d58b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:01.776627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-01b0dd63-441c-4961-a74e-6a052733c807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:01.862973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 969/1945] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:01.868029 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230c92b-c631-42c3-acee-c7fe334456d1 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:01.869853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2230c92b-c631-42c3-acee-c7fe334456d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:01.976500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230c92b-c631-42c3-acee-c7fe334456d1 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:01.983546 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c46d8-8f37-44bf-9cec-17c99f8efec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:01.984980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c46d8-8f37-44bf-9cec-17c99f8efec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:01.985716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c46d8-8f37-44bf-9cec-17c99f8efec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:01.986153 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c46d8-8f37-44bf-9cec-17c99f8efec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:01.987432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c46d8-8f37-44bf-9cec-17c99f8efec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:01.989913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c46d8-8f37-44bf-9cec-17c99f8efec3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:02.020572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 977/1946] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:01 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:02.021802 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0dd63-441c-4961-a74e-6a052733c807 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:02.032949 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0dd63-441c-4961-a74e-6a052733c807 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:02.036549 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:02.090767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c46d8-8f37-44bf-9cec-17c99f8efec3 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:02.093111 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-060c46d8-8f37-44bf-9cec-17c99f8efec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:02.107681 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7512227-d631-463d-ab0d-7414bc0baaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:02.108601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7512227-d631-463d-ab0d-7414bc0baaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.109408 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7512227-d631-463d-ab0d-7414bc0baaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.109788 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7512227-d631-463d-ab0d-7414bc0baaa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.110599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7512227-d631-463d-ab0d-7414bc0baaa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:02.112273 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c46d8-8f37-44bf-9cec-17c99f8efec3 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:02.112961 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7512227-d631-463d-ab0d-7414bc0baaa3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:02.118391 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fdf96-4b18-4975-a3c7-69c92279c447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:02.119771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fdf96-4b18-4975-a3c7-69c92279c447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.120117 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fdf96-4b18-4975-a3c7-69c92279c447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.120532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fdf96-4b18-4975-a3c7-69c92279c447 admin admin] PATH_INFO: `/v3/projects/58a21d162d0c49fc9f7b0399c617c41f` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.121790 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fdf96-4b18-4975-a3c7-69c92279c447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58a21d162d0c49fc9f7b0399c617c41f)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:02.124394 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fdf96-4b18-4975-a3c7-69c92279c447 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:02.139685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 970/1947] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:02 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:02.143739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7512227-d631-463d-ab0d-7414bc0baaa3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:02.154830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7512227-d631-463d-ab0d-7414bc0baaa3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:02.159740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465ae1a-e166-4bac-ab0d-7d66ecdbcc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:02.160429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465ae1a-e166-4bac-ab0d-7d66ecdbcc47 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.160753 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465ae1a-e166-4bac-ab0d-7d66ecdbcc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.160997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465ae1a-e166-4bac-ab0d-7d66ecdbcc47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.161730 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465ae1a-e166-4bac-ab0d-7d66ecdbcc47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:02.163329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465ae1a-e166-4bac-ab0d-7d66ecdbcc47 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:02.163998 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:02.179117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 971/1948] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:02.180224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465ae1a-e166-4bac-ab0d-7d66ecdbcc47 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:02.185384 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-db0fdf96-4b18-4975-a3c7-69c92279c447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58a21d162d0c49fc9f7b0399c617c41f', 'request_id': 'req-db0fdf96-4b18-4975-a3c7-69c92279c447'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:02.192624 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465ae1a-e166-4bac-ab0d-7d66ecdbcc47 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:02.196687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-db0fdf96-4b18-4975-a3c7-69c92279c447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58a21d162d0c49fc9f7b0399c617c41f', 'request_id': 'req-db0fdf96-4b18-4975-a3c7-69c92279c447'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:02.209016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-db0fdf96-4b18-4975-a3c7-69c92279c447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58a21d162d0c49fc9f7b0399c617c41f', 'request_id': 'req-db0fdf96-4b18-4975-a3c7-69c92279c447'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:02.220076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-db0fdf96-4b18-4975-a3c7-69c92279c447 admin admin] The token cache is being invalidate because project 58a21d162d0c49fc9f7b0399c617c41f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:02.220429 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-db0fdf96-4b18-4975-a3c7-69c92279c447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:02.221493 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-db0fdf96-4b18-4975-a3c7-69c92279c447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:02.224509 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 978/1949] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:02 2022] DELETE /identity/v3/projects/58a21d162d0c49fc9f7b0399c617c41f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:02.232301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46d95b-9bc8-4bf6-89d8-b90e1bb05393 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.232536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46d95b-9bc8-4bf6-89d8-b90e1bb05393 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.232845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46d95b-9bc8-4bf6-89d8-b90e1bb05393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.257235 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ae46d95b-9bc8-4bf6-89d8-b90e1bb05393 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:02.258631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ae46d95b-9bc8-4bf6-89d8-b90e1bb05393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:02.268930 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40a923-eb4a-48aa-8e2c-6d6f00966a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:02.271098 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40a923-eb4a-48aa-8e2c-6d6f00966a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.271458 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40a923-eb4a-48aa-8e2c-6d6f00966a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.271943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40a923-eb4a-48aa-8e2c-6d6f00966a4b admin admin] PATH_INFO: `/v3/projects/1917ed9d58ee416f992ea97a506ba74c/users/7674c4f641374d6cb018166e88b5420c/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.298028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40a923-eb4a-48aa-8e2c-6d6f00966a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1917ed9d58ee416f992ea97a506ba74c, user_id=7674c4f641374d6cb018166e88b5420c, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:02.300928 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40a923-eb4a-48aa-8e2c-6d6f00966a4b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:02.315724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 972/1950] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:02 2022] PUT /identity/v3/projects/1917ed9d58ee416f992ea97a506ba74c/users/7674c4f641374d6cb018166e88b5420c/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:02.319381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40a923-eb4a-48aa-8e2c-6d6f00966a4b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:02.321100 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ae40a923-eb4a-48aa-8e2c-6d6f00966a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:02.329452 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 979/1951] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:02.337469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe23fe5-a597-4039-a86f-5b9e6d0ae786 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.337772 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe23fe5-a597-4039-a86f-5b9e6d0ae786 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.338055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe23fe5-a597-4039-a86f-5b9e6d0ae786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.355753 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2fe23fe5-a597-4039-a86f-5b9e6d0ae786 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:02.356989 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2fe23fe5-a597-4039-a86f-5b9e6d0ae786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:02.385862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40a923-eb4a-48aa-8e2c-6d6f00966a4b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:02.391633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fdcc3-fdff-4a18-90f6-443d05d9fa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:02.392337 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fdcc3-fdff-4a18-90f6-443d05d9fa22 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.392628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fdcc3-fdff-4a18-90f6-443d05d9fa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.392913 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fdcc3-fdff-4a18-90f6-443d05d9fa22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.393648 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43fdcc3-fdff-4a18-90f6-443d05d9fa22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:02.395251 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43fdcc3-fdff-4a18-90f6-443d05d9fa22 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:02.405254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 973/1952] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:10:02.409178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fdcc3-fdff-4a18-90f6-443d05d9fa22 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:02.415355 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:02.419870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fdcc3-fdff-4a18-90f6-443d05d9fa22 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:02.424912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 980/1953] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:02.425708 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ca425-d8e4-493e-bb12-e2fafbd10fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:02.426587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ca425-d8e4-493e-bb12-e2fafbd10fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.426876 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ca425-d8e4-493e-bb12-e2fafbd10fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.427157 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ca425-d8e4-493e-bb12-e2fafbd10fbd admin admin] PATH_INFO: `/v3/projects/1917ed9d58ee416f992ea97a506ba74c/users/7674c4f641374d6cb018166e88b5420c/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.428942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe23fe5-a597-4039-a86f-5b9e6d0ae786 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:02.429435 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ca425-d8e4-493e-bb12-e2fafbd10fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1917ed9d58ee416f992ea97a506ba74c, user_id=7674c4f641374d6cb018166e88b5420c, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:02.432111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ca425-d8e4-493e-bb12-e2fafbd10fbd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:02.438288 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe23fe5-a597-4039-a86f-5b9e6d0ae786 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:02.442958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 974/1954] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:02 2022] PUT /identity/v3/projects/1917ed9d58ee416f992ea97a506ba74c/users/7674c4f641374d6cb018166e88b5420c/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:02.454262 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c75e0-1b45-4817-aab1-44a9c620f819 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.454557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c75e0-1b45-4817-aab1-44a9c620f819 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.454839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c75e0-1b45-4817-aab1-44a9c620f819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.480919 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-172c75e0-1b45-4817-aab1-44a9c620f819 None None] MFA Rules not processed for user `7674c4f641374d6cb018166e88b5420c`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:02.482442 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-172c75e0-1b45-4817-aab1-44a9c620f819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:02.490290 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:02.500295 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7f5b5-5456-4f44-b3e7-5a4029ed0eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:02.500997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7f5b5-5456-4f44-b3e7-5a4029ed0eea admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.501313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7f5b5-5456-4f44-b3e7-5a4029ed0eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.501740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7f5b5-5456-4f44-b3e7-5a4029ed0eea admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.502974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7f5b5-5456-4f44-b3e7-5a4029ed0eea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:10:02.503930 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7f5b5-5456-4f44-b3e7-5a4029ed0eea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:02.505637 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7f5b5-5456-4f44-b3e7-5a4029ed0eea admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:02.518713 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 981/1955] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:10:02.522970 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7f5b5-5456-4f44-b3e7-5a4029ed0eea admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:02.532433 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7f5b5-5456-4f44-b3e7-5a4029ed0eea admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:02.537093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c896686-57f3-4f8e-961b-d7a66af01e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:02.537719 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c896686-57f3-4f8e-961b-d7a66af01e74 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.538009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c896686-57f3-4f8e-961b-d7a66af01e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.538295 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c896686-57f3-4f8e-961b-d7a66af01e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.538973 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c896686-57f3-4f8e-961b-d7a66af01e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:02.541162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c896686-57f3-4f8e-961b-d7a66af01e74 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:02.554549 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 975/1956] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:02.567083 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c75e0-1b45-4817-aab1-44a9c620f819 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:02.568592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-172c75e0-1b45-4817-aab1-44a9c620f819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:02.569327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 982/1957] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:02 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:02.573009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c896686-57f3-4f8e-961b-d7a66af01e74 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:02.625928 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c75e0-1b45-4817-aab1-44a9c620f819 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:02.634019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c896686-57f3-4f8e-961b-d7a66af01e74 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:02.639033 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f603a8c-42b5-4203-bfb7-d53bc0264e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:02.639705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f603a8c-42b5-4203-bfb7-d53bc0264e95 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.640020 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f603a8c-42b5-4203-bfb7-d53bc0264e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.640303 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f603a8c-42b5-4203-bfb7-d53bc0264e95 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.640990 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f603a8c-42b5-4203-bfb7-d53bc0264e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:02.642962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f603a8c-42b5-4203-bfb7-d53bc0264e95 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:02.663424 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 983/1958] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:02 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:10:02.667821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f603a8c-42b5-4203-bfb7-d53bc0264e95 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:02.676286 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd930746-5a60-49d5-a7b4-4a46aec87346 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:02.676947 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd930746-5a60-49d5-a7b4-4a46aec87346 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.677234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd930746-5a60-49d5-a7b4-4a46aec87346 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.677539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd930746-5a60-49d5-a7b4-4a46aec87346 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.678325 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f603a8c-42b5-4203-bfb7-d53bc0264e95 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:02.682891 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46f167-3f50-4ffd-bc87-0d516065f638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:02.683525 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46f167-3f50-4ffd-bc87-0d516065f638 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.683808 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46f167-3f50-4ffd-bc87-0d516065f638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.684112 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46f167-3f50-4ffd-bc87-0d516065f638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.684828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46f167-3f50-4ffd-bc87-0d516065f638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:02.687092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46f167-3f50-4ffd-bc87-0d516065f638 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:02.696945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 984/1959] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:10:02.700701 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46f167-3f50-4ffd-bc87-0d516065f638 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:02.709953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46f167-3f50-4ffd-bc87-0d516065f638 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:02.714563 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d123c7-ad71-4ff4-bf6f-783ea078b0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:02.715184 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d123c7-ad71-4ff4-bf6f-783ea078b0bc admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.715472 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d123c7-ad71-4ff4-bf6f-783ea078b0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.715749 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d123c7-ad71-4ff4-bf6f-783ea078b0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.716489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d123c7-ad71-4ff4-bf6f-783ea078b0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:02.718061 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d123c7-ad71-4ff4-bf6f-783ea078b0bc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:02.721813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:02.728742 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 985/1960] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:10:02.733159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d123c7-ad71-4ff4-bf6f-783ea078b0bc admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:02.741392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd930746-5a60-49d5-a7b4-4a46aec87346 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:02.742912 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd930746-5a60-49d5-a7b4-4a46aec87346 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:02.743208 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d123c7-ad71-4ff4-bf6f-783ea078b0bc admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:02.750692 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875326b-6e59-4985-9f5f-9a2404173d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:02.750692 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875326b-6e59-4985-9f5f-9a2404173d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.750918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875326b-6e59-4985-9f5f-9a2404173d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.751104 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875326b-6e59-4985-9f5f-9a2404173d69 admin admin] PATH_INFO: `/v3/projects/196bf505059243058b8f1bbf74b90f1f/users/b4ed392ed8a94eb4a17c0b52340270e7/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.753830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 976/1961] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:10:02.765989 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875326b-6e59-4985-9f5f-9a2404173d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=196bf505059243058b8f1bbf74b90f1f, user_id=b4ed392ed8a94eb4a17c0b52340270e7, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:02.768687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875326b-6e59-4985-9f5f-9a2404173d69 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:02.781278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 986/1962] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:02 2022] PUT /identity/v3/projects/196bf505059243058b8f1bbf74b90f1f/users/b4ed392ed8a94eb4a17c0b52340270e7/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:02.792565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8232a8d-3e65-475c-86e0-187a3f808f2d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.792967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8232a8d-3e65-475c-86e0-187a3f808f2d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.793354 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8232a8d-3e65-475c-86e0-187a3f808f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.826601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e8232a8d-3e65-475c-86e0-187a3f808f2d None None] MFA Rules not processed for user `b4ed392ed8a94eb4a17c0b52340270e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:02.828032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e8232a8d-3e65-475c-86e0-187a3f808f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:02.910419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 977/1963] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:02.914719 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875326b-6e59-4985-9f5f-9a2404173d69 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:02.989763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875326b-6e59-4985-9f5f-9a2404173d69 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:02.995008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54308517-0fb7-46a1-8708-0b1dfbd3efab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:02.995717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308517-0fb7-46a1-8708-0b1dfbd3efab admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:02.996148 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308517-0fb7-46a1-8708-0b1dfbd3efab admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:02.996859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308517-0fb7-46a1-8708-0b1dfbd3efab admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:02.997666 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54308517-0fb7-46a1-8708-0b1dfbd3efab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:03.000050 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54308517-0fb7-46a1-8708-0b1dfbd3efab admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:03.020333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:03.037343 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 987/1964] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:02 2022] POST /identity/v3/projects => generated 393 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:03.037484 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8232a8d-3e65-475c-86e0-187a3f808f2d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:03.051948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8232a8d-3e65-475c-86e0-187a3f808f2d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:03.127593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fbfa0-5978-4a61-8236-8c7a406a3e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:03.128439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fbfa0-5978-4a61-8236-8c7a406a3e57 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:03.128730 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fbfa0-5978-4a61-8236-8c7a406a3e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:03.129010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fbfa0-5978-4a61-8236-8c7a406a3e57 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:03.129715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fbfa0-5978-4a61-8236-8c7a406a3e57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:03.131638 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fbfa0-5978-4a61-8236-8c7a406a3e57 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:03.156669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 978/1965] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:03 2022] POST /identity/v3/users => generated 303 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:03.157843 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54308517-0fb7-46a1-8708-0b1dfbd3efab admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:03.169099 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54308517-0fb7-46a1-8708-0b1dfbd3efab admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:03.174742 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad9537-86a1-4cb1-867d-cc8a3991e02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:03.175418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad9537-86a1-4cb1-867d-cc8a3991e02d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:03.175709 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad9537-86a1-4cb1-867d-cc8a3991e02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:03.176029 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad9537-86a1-4cb1-867d-cc8a3991e02d admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:03.176769 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad9537-86a1-4cb1-867d-cc8a3991e02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:03.178408 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad9537-86a1-4cb1-867d-cc8a3991e02d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:03.192903 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 988/1966] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:03.198107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fbfa0-5978-4a61-8236-8c7a406a3e57 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:03.208660 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fbfa0-5978-4a61-8236-8c7a406a3e57 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:03.213565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1282f-e11a-408d-bb91-aa0e8a36ba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:03.214601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1282f-e11a-408d-bb91-aa0e8a36ba72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:03.214883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1282f-e11a-408d-bb91-aa0e8a36ba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:03.215161 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1282f-e11a-408d-bb91-aa0e8a36ba72 admin admin] PATH_INFO: `/v3/projects/cd3fadfa8f674dffa8360670cdad10e3/users/f1724fb46f594bb8ae2b80f103b02206/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:03.231812 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1282f-e11a-408d-bb91-aa0e8a36ba72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3fadfa8f674dffa8360670cdad10e3, user_id=f1724fb46f594bb8ae2b80f103b02206, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:03.235481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1282f-e11a-408d-bb91-aa0e8a36ba72 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:03.236735 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad9537-86a1-4cb1-867d-cc8a3991e02d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:03.247038 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad9537-86a1-4cb1-867d-cc8a3991e02d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:03.250080 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 979/1967] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:03 2022] PUT /identity/v3/projects/cd3fadfa8f674dffa8360670cdad10e3/users/f1724fb46f594bb8ae2b80f103b02206/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:03.253881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1282f-e11a-408d-bb91-aa0e8a36ba72 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:03.300249 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:03.309593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e654946-153f-403f-800c-ec9940f00e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:03.309933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e654946-153f-403f-800c-ec9940f00e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:03.310029 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e654946-153f-403f-800c-ec9940f00e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:03.310496 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e654946-153f-403f-800c-ec9940f00e2f admin admin] PATH_INFO: `/v3/users/64c91e124a40427ca1371a0ca4d58b6c` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:03.311910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e654946-153f-403f-800c-ec9940f00e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=64c91e124a40427ca1371a0ca4d58b6c)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:03.314004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e654946-153f-403f-800c-ec9940f00e2f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:03.336197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1282f-e11a-408d-bb91-aa0e8a36ba72 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:03.344622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2971ea-1ff3-49c2-b897-5a25cf92ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:03.345315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2971ea-1ff3-49c2-b897-5a25cf92ec46 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:03.345606 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2971ea-1ff3-49c2-b897-5a25cf92ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:03.346117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2971ea-1ff3-49c2-b897-5a25cf92ec46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:03.347053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2971ea-1ff3-49c2-b897-5a25cf92ec46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:03.348765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2971ea-1ff3-49c2-b897-5a25cf92ec46 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:03.362721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 980/1968] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:10:03.363992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2971ea-1ff3-49c2-b897-5a25cf92ec46 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:03.370368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9e654946-153f-403f-800c-ec9940f00e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64c91e124a40427ca1371a0ca4d58b6c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:03.371187 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9e654946-153f-403f-800c-ec9940f00e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64c91e124a40427ca1371a0ca4d58b6c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:03.374275 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2971ea-1ff3-49c2-b897-5a25cf92ec46 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:03.379266 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4d23d-b2fc-43a7-88cd-2814e7a972e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:03.380391 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4d23d-b2fc-43a7-88cd-2814e7a972e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:03.380517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4d23d-b2fc-43a7-88cd-2814e7a972e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:03.380797 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4d23d-b2fc-43a7-88cd-2814e7a972e3 admin admin] PATH_INFO: `/v3/projects/cd3fadfa8f674dffa8360670cdad10e3/users/f1724fb46f594bb8ae2b80f103b02206/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:03.383028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4d23d-b2fc-43a7-88cd-2814e7a972e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3fadfa8f674dffa8360670cdad10e3, user_id=f1724fb46f594bb8ae2b80f103b02206, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:03.384451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9e654946-153f-403f-800c-ec9940f00e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64c91e124a40427ca1371a0ca4d58b6c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:03.385907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4d23d-b2fc-43a7-88cd-2814e7a972e3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:03.392709 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9e654946-153f-403f-800c-ec9940f00e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64c91e124a40427ca1371a0ca4d58b6c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:03.399158 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 981/1969] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:03 2022] PUT /identity/v3/projects/cd3fadfa8f674dffa8360670cdad10e3/users/f1724fb46f594bb8ae2b80f103b02206/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:03.417376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9e654946-153f-403f-800c-ec9940f00e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64c91e124a40427ca1371a0ca4d58b6c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:03.419441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ec4c2-f99e-4484-b701-598a2509bb02 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:03.419882 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ec4c2-f99e-4484-b701-598a2509bb02 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:03.420294 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ec4c2-f99e-4484-b701-598a2509bb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:03.424668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 989/1970] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:03 2022] DELETE /identity/v3/users/64c91e124a40427ca1371a0ca4d58b6c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:03.429519 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207c07-c1d1-41a5-b007-29287338c234 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:03.429895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207c07-c1d1-41a5-b007-29287338c234 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:03.430245 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a207c07-c1d1-41a5-b007-29287338c234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:03.449453 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0a207c07-c1d1-41a5-b007-29287338c234 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:03.449687 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-706ec4c2-f99e-4484-b701-598a2509bb02 None None] MFA Rules not processed for user `f1724fb46f594bb8ae2b80f103b02206`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:03.450680 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-706ec4c2-f99e-4484-b701-598a2509bb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:03.450807 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0a207c07-c1d1-41a5-b007-29287338c234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:03.520795 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 990/1971] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:03.530460 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 982/1972] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:03.531014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207c07-c1d1-41a5-b007-29287338c234 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:03.532437 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0a207c07-c1d1-41a5-b007-29287338c234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:03.538677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:03.542706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ec4c2-f99e-4484-b701-598a2509bb02 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:03.544211 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-706ec4c2-f99e-4484-b701-598a2509bb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:03.590892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a207c07-c1d1-41a5-b007-29287338c234 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:03.595195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851e951-e6c1-4e7b-8588-59e017130082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:03.596038 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e951-e6c1-4e7b-8588-59e017130082 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:03.596421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e951-e6c1-4e7b-8588-59e017130082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:03.596607 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e951-e6c1-4e7b-8588-59e017130082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:03.600968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ec4c2-f99e-4484-b701-598a2509bb02 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:03.604580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f075ee-1fd7-4665-891b-927c67c13e83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:03.605220 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f075ee-1fd7-4665-891b-927c67c13e83 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:03.605506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f075ee-1fd7-4665-891b-927c67c13e83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:03.605741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851e951-e6c1-4e7b-8588-59e017130082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:03.605858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f075ee-1fd7-4665-891b-927c67c13e83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:03.607178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851e951-e6c1-4e7b-8588-59e017130082 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:03.614592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f075ee-1fd7-4665-891b-927c67c13e83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:03.616031 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f075ee-1fd7-4665-891b-927c67c13e83 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:03.616663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 991/1973] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:10:03.626084 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 983/1974] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:10:03.670313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851e951-e6c1-4e7b-8588-59e017130082 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:03.679695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851e951-e6c1-4e7b-8588-59e017130082 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:03.683642 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92ca88-fc18-44a1-b2c9-8e2fa9455448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:03.684323 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92ca88-fc18-44a1-b2c9-8e2fa9455448 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:03.684612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92ca88-fc18-44a1-b2c9-8e2fa9455448 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:03.684894 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92ca88-fc18-44a1-b2c9-8e2fa9455448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:03.687227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ef92ca88-fc18-44a1-b2c9-8e2fa9455448 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:03.749174 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92ca88-fc18-44a1-b2c9-8e2fa9455448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:03.750607 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92ca88-fc18-44a1-b2c9-8e2fa9455448 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:03.760490 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 992/1975] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:03.890644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f075ee-1fd7-4665-891b-927c67c13e83 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:03.892240 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d6f075ee-1fd7-4665-891b-927c67c13e83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:03.908989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f075ee-1fd7-4665-891b-927c67c13e83 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:03.915789 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763934f-cc33-42e2-bdb3-5be51d6754e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:03.916943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763934f-cc33-42e2-bdb3-5be51d6754e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:03.917302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763934f-cc33-42e2-bdb3-5be51d6754e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:03.917697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763934f-cc33-42e2-bdb3-5be51d6754e2 admin admin] PATH_INFO: `/v3/projects/8ffbf62516a042019f58a11abbcb85eb` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:03.924384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763934f-cc33-42e2-bdb3-5be51d6754e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ffbf62516a042019f58a11abbcb85eb)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:03.927861 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763934f-cc33-42e2-bdb3-5be51d6754e2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:03.986955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:03.991533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e763934f-cc33-42e2-bdb3-5be51d6754e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ffbf62516a042019f58a11abbcb85eb', 'request_id': 'req-e763934f-cc33-42e2-bdb3-5be51d6754e2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:04.003472 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e763934f-cc33-42e2-bdb3-5be51d6754e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ffbf62516a042019f58a11abbcb85eb', 'request_id': 'req-e763934f-cc33-42e2-bdb3-5be51d6754e2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:04.027232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e763934f-cc33-42e2-bdb3-5be51d6754e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ffbf62516a042019f58a11abbcb85eb', 'request_id': 'req-e763934f-cc33-42e2-bdb3-5be51d6754e2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:04.040917 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e763934f-cc33-42e2-bdb3-5be51d6754e2 admin admin] The token cache is being invalidate because project 8ffbf62516a042019f58a11abbcb85eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:04.041424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e763934f-cc33-42e2-bdb3-5be51d6754e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:04.041894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e763934f-cc33-42e2-bdb3-5be51d6754e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:04.047276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 984/1976] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:03 2022] DELETE /identity/v3/projects/8ffbf62516a042019f58a11abbcb85eb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:04.048714 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92ca88-fc18-44a1-b2c9-8e2fa9455448 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:04.072187 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92ca88-fc18-44a1-b2c9-8e2fa9455448 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:04.148086 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375a94b-2b4c-4a24-af0d-a59ac106f83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:04.148969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375a94b-2b4c-4a24-af0d-a59ac106f83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:04.149252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375a94b-2b4c-4a24-af0d-a59ac106f83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:04.149528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375a94b-2b4c-4a24-af0d-a59ac106f83c admin admin] PATH_INFO: `/v3/users/7674c4f641374d6cb018166e88b5420c` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:04.150702 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375a94b-2b4c-4a24-af0d-a59ac106f83c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7674c4f641374d6cb018166e88b5420c)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:04.152640 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375a94b-2b4c-4a24-af0d-a59ac106f83c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:04.200357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8375a94b-2b4c-4a24-af0d-a59ac106f83c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7674c4f641374d6cb018166e88b5420c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:04.201876 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8375a94b-2b4c-4a24-af0d-a59ac106f83c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7674c4f641374d6cb018166e88b5420c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:04.203823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:04.210405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8375a94b-2b4c-4a24-af0d-a59ac106f83c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7674c4f641374d6cb018166e88b5420c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:04.217457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8375a94b-2b4c-4a24-af0d-a59ac106f83c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7674c4f641374d6cb018166e88b5420c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:04.229576 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8375a94b-2b4c-4a24-af0d-a59ac106f83c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7674c4f641374d6cb018166e88b5420c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:04.236403 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 993/1977] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:04 2022] DELETE /identity/v3/users/7674c4f641374d6cb018166e88b5420c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:04.505328 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763934f-cc33-42e2-bdb3-5be51d6754e2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:04.506785 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e763934f-cc33-42e2-bdb3-5be51d6754e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:04.520422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763934f-cc33-42e2-bdb3-5be51d6754e2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:04.580142 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd026a7a-d37d-4009-8c8b-ce198d14a941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:04.581030 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd026a7a-d37d-4009-8c8b-ce198d14a941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:04.581346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd026a7a-d37d-4009-8c8b-ce198d14a941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:04.581630 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd026a7a-d37d-4009-8c8b-ce198d14a941 admin admin] PATH_INFO: `/v3/projects/1917ed9d58ee416f992ea97a506ba74c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:04.582836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd026a7a-d37d-4009-8c8b-ce198d14a941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1917ed9d58ee416f992ea97a506ba74c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:04.584783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd026a7a-d37d-4009-8c8b-ce198d14a941 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:04.635170 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dd026a7a-d37d-4009-8c8b-ce198d14a941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1917ed9d58ee416f992ea97a506ba74c', 'request_id': 'req-dd026a7a-d37d-4009-8c8b-ce198d14a941'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:04.640780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dd026a7a-d37d-4009-8c8b-ce198d14a941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1917ed9d58ee416f992ea97a506ba74c', 'request_id': 'req-dd026a7a-d37d-4009-8c8b-ce198d14a941'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:04.648626 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dd026a7a-d37d-4009-8c8b-ce198d14a941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1917ed9d58ee416f992ea97a506ba74c', 'request_id': 'req-dd026a7a-d37d-4009-8c8b-ce198d14a941'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:04.661652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dd026a7a-d37d-4009-8c8b-ce198d14a941 admin admin] The token cache is being invalidate because project 1917ed9d58ee416f992ea97a506ba74c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:04.661950 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dd026a7a-d37d-4009-8c8b-ce198d14a941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:04.662604 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dd026a7a-d37d-4009-8c8b-ce198d14a941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:04.664209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 985/1978] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:04 2022] DELETE /identity/v3/projects/1917ed9d58ee416f992ea97a506ba74c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:04.669424 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5045f-591b-4818-92d1-6773d330dd78 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:04.669759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5045f-591b-4818-92d1-6773d330dd78 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:04.670055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5045f-591b-4818-92d1-6773d330dd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:04.688703 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ecc5045f-591b-4818-92d1-6773d330dd78 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:04.689912 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ecc5045f-591b-4818-92d1-6773d330dd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:04.747943 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 994/1979] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:04.755770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74189-ebab-45b5-a46a-72ed9c878026 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:04.756094 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74189-ebab-45b5-a46a-72ed9c878026 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:04.756379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff74189-ebab-45b5-a46a-72ed9c878026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:04.774771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3ff74189-ebab-45b5-a46a-72ed9c878026 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:04.776005 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3ff74189-ebab-45b5-a46a-72ed9c878026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:04.784489 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 986/1980] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:04.788485 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5045f-591b-4818-92d1-6773d330dd78 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:04.798390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5045f-591b-4818-92d1-6773d330dd78 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:04.803040 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e82db-92ac-4e07-aaca-f30f6aa96b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:04.803693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e82db-92ac-4e07-aaca-f30f6aa96b12 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:04.804007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e82db-92ac-4e07-aaca-f30f6aa96b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:04.804292 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e82db-92ac-4e07-aaca-f30f6aa96b12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:04.805026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e82db-92ac-4e07-aaca-f30f6aa96b12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:10:04.805338 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e82db-92ac-4e07-aaca-f30f6aa96b12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:04.806925 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e82db-92ac-4e07-aaca-f30f6aa96b12 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:04.818543 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 995/1981] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:10:04.822450 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff74189-ebab-45b5-a46a-72ed9c878026 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:04.832301 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff74189-ebab-45b5-a46a-72ed9c878026 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:04.836873 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05917436-427e-41cd-ae78-a52e2c003c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:04.837518 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05917436-427e-41cd-ae78-a52e2c003c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:04.837830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05917436-427e-41cd-ae78-a52e2c003c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:04.838136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05917436-427e-41cd-ae78-a52e2c003c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:04.838822 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05917436-427e-41cd-ae78-a52e2c003c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:04.840770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05917436-427e-41cd-ae78-a52e2c003c40 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:04.865918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 987/1982] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:04 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:04.869867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e82db-92ac-4e07-aaca-f30f6aa96b12 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:04.879662 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e82db-92ac-4e07-aaca-f30f6aa96b12 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:04.935120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d06587-b3de-4036-824f-af419e8b69df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:04.935815 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d06587-b3de-4036-824f-af419e8b69df admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:04.936129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d06587-b3de-4036-824f-af419e8b69df admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:04.936450 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d06587-b3de-4036-824f-af419e8b69df admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:04.937146 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d06587-b3de-4036-824f-af419e8b69df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:04.939092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d06587-b3de-4036-824f-af419e8b69df admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:04.958974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 996/1983] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:04 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:04.963084 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05917436-427e-41cd-ae78-a52e2c003c40 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:04.975332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05917436-427e-41cd-ae78-a52e2c003c40 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:04.980992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf01a86-ffa9-4da0-9dea-7e7d404580f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:04.982089 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf01a86-ffa9-4da0-9dea-7e7d404580f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:04.982383 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf01a86-ffa9-4da0-9dea-7e7d404580f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:04.982798 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf01a86-ffa9-4da0-9dea-7e7d404580f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:04.983535 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf01a86-ffa9-4da0-9dea-7e7d404580f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:04.985186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf01a86-ffa9-4da0-9dea-7e7d404580f1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:04.997470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 988/1984] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:05.001398 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d06587-b3de-4036-824f-af419e8b69df admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:05.012329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d06587-b3de-4036-824f-af419e8b69df admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:05.018304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22d9b1-7feb-42dc-aa91-27e24bc04ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:05.019767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22d9b1-7feb-42dc-aa91-27e24bc04ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:05.020096 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22d9b1-7feb-42dc-aa91-27e24bc04ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:05.020378 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22d9b1-7feb-42dc-aa91-27e24bc04ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:05.021114 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22d9b1-7feb-42dc-aa91-27e24bc04ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:05.022703 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22d9b1-7feb-42dc-aa91-27e24bc04ef9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:05.033207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 997/1985] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:05.037287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf01a86-ffa9-4da0-9dea-7e7d404580f1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:05.047550 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf01a86-ffa9-4da0-9dea-7e7d404580f1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:05.052646 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc248c49-b3aa-4d2f-8a43-fca0d906093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:05.053533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc248c49-b3aa-4d2f-8a43-fca0d906093f admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:05.053821 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc248c49-b3aa-4d2f-8a43-fca0d906093f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:05.054107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc248c49-b3aa-4d2f-8a43-fca0d906093f admin admin] PATH_INFO: `/v3/projects/e5f200b27e4640a59e9f76c737f94480/users/0073b4f6b6f14bb48dcd8541162eaf01/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:05.069289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc248c49-b3aa-4d2f-8a43-fca0d906093f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5f200b27e4640a59e9f76c737f94480, user_id=0073b4f6b6f14bb48dcd8541162eaf01, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:05.071956 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc248c49-b3aa-4d2f-8a43-fca0d906093f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:05.080734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:05.086371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 989/1986] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:05 2022] PUT /identity/v3/projects/e5f200b27e4640a59e9f76c737f94480/users/0073b4f6b6f14bb48dcd8541162eaf01/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:05.096978 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a161b1a-ade7-4e7c-b366-4690253b9cbb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:05.097278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a161b1a-ade7-4e7c-b366-4690253b9cbb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:05.097567 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a161b1a-ade7-4e7c-b366-4690253b9cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:05.125227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7a161b1a-ade7-4e7c-b366-4690253b9cbb None None] MFA Rules not processed for user `0073b4f6b6f14bb48dcd8541162eaf01`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:05.126452 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7a161b1a-ade7-4e7c-b366-4690253b9cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:05.147463 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:05.197167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 998/1987] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:05.202331 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc248c49-b3aa-4d2f-8a43-fca0d906093f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:05.269323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc248c49-b3aa-4d2f-8a43-fca0d906093f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:05.274234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8864f57-8cb4-4fd8-9335-c775c8355378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:05.274918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8864f57-8cb4-4fd8-9335-c775c8355378 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:05.275216 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8864f57-8cb4-4fd8-9335-c775c8355378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:05.275489 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8864f57-8cb4-4fd8-9335-c775c8355378 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:05.276236 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8864f57-8cb4-4fd8-9335-c775c8355378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:05.278185 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8864f57-8cb4-4fd8-9335-c775c8355378 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:05.308589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 990/1988] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:05 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:10:05.309853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a161b1a-ade7-4e7c-b366-4690253b9cbb None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:05.323088 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a161b1a-ade7-4e7c-b366-4690253b9cbb None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:05.458004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb05e1e-6763-4665-9385-e00a2b79a420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:05.459652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb05e1e-6763-4665-9385-e00a2b79a420 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:05.460383 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb05e1e-6763-4665-9385-e00a2b79a420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:05.460841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb05e1e-6763-4665-9385-e00a2b79a420 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:05.462366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb05e1e-6763-4665-9385-e00a2b79a420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:05.465744 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb05e1e-6763-4665-9385-e00a2b79a420 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:05.502298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 999/1989] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:05 2022] POST /identity/v3/users => generated 300 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:10:05.506861 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8864f57-8cb4-4fd8-9335-c775c8355378 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:05.539232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8864f57-8cb4-4fd8-9335-c775c8355378 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:05.548849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de86da-f97e-4e2c-b7f1-4b0ae6dca8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:05.549886 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de86da-f97e-4e2c-b7f1-4b0ae6dca8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:05.550589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de86da-f97e-4e2c-b7f1-4b0ae6dca8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:05.551246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de86da-f97e-4e2c-b7f1-4b0ae6dca8b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:05.552941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de86da-f97e-4e2c-b7f1-4b0ae6dca8b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:05.555524 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de86da-f97e-4e2c-b7f1-4b0ae6dca8b5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:05.576062 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 991/1990] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:05.577327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb05e1e-6763-4665-9385-e00a2b79a420 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:05.587512 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb05e1e-6763-4665-9385-e00a2b79a420 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:05.592310 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed7b11-d034-4b35-ada2-1d6089555e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:05.593236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed7b11-d034-4b35-ada2-1d6089555e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:05.593557 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed7b11-d034-4b35-ada2-1d6089555e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:05.593794 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed7b11-d034-4b35-ada2-1d6089555e1d admin admin] PATH_INFO: `/v3/projects/34de0aa9d95048e0bb600283a6d0df6c/users/d06a6b1817c64de3a113d8ec10f543c8/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:05.610409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed7b11-d034-4b35-ada2-1d6089555e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=34de0aa9d95048e0bb600283a6d0df6c, user_id=d06a6b1817c64de3a113d8ec10f543c8, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:05.613513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed7b11-d034-4b35-ada2-1d6089555e1d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:05.627210 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1000/1991] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:05 2022] PUT /identity/v3/projects/34de0aa9d95048e0bb600283a6d0df6c/users/d06a6b1817c64de3a113d8ec10f543c8/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:05.631180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de86da-f97e-4e2c-b7f1-4b0ae6dca8b5 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:05.641484 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de86da-f97e-4e2c-b7f1-4b0ae6dca8b5 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:05.703907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a59bf-2508-49d1-b1e5-03c264836c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:05.704612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a59bf-2508-49d1-b1e5-03c264836c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:05.704898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a59bf-2508-49d1-b1e5-03c264836c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:05.705177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a59bf-2508-49d1-b1e5-03c264836c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:05.709043 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a59bf-2508-49d1-b1e5-03c264836c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:05.709043 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a59bf-2508-49d1-b1e5-03c264836c3a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:05.716215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed7b11-d034-4b35-ada2-1d6089555e1d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:05.718128 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-dfed7b11-d034-4b35-ada2-1d6089555e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:05.720640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 992/1992] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:05.724620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a59bf-2508-49d1-b1e5-03c264836c3a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:05.736064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a59bf-2508-49d1-b1e5-03c264836c3a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:05.741663 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f38db-704d-408d-bafd-1703d541c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:05.742562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f38db-704d-408d-bafd-1703d541c318 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:05.742847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f38db-704d-408d-bafd-1703d541c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:05.743125 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f38db-704d-408d-bafd-1703d541c318 admin admin] PATH_INFO: `/v3/projects/34de0aa9d95048e0bb600283a6d0df6c/users/d06a6b1817c64de3a113d8ec10f543c8/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:05.745179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f38db-704d-408d-bafd-1703d541c318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34de0aa9d95048e0bb600283a6d0df6c, user_id=d06a6b1817c64de3a113d8ec10f543c8, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:05.747827 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f38db-704d-408d-bafd-1703d541c318 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:05.768010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 993/1993] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:05 2022] PUT /identity/v3/projects/34de0aa9d95048e0bb600283a6d0df6c/users/d06a6b1817c64de3a113d8ec10f543c8/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:05.771775 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e789c4b-1d12-4e39-9cf7-2adc8f46cd21 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:05.772113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e789c4b-1d12-4e39-9cf7-2adc8f46cd21 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:05.772527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e789c4b-1d12-4e39-9cf7-2adc8f46cd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:05.787771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed7b11-d034-4b35-ada2-1d6089555e1d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:05.802469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3e789c4b-1d12-4e39-9cf7-2adc8f46cd21 None None] MFA Rules not processed for user `d06a6b1817c64de3a113d8ec10f543c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:05.803764 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3e789c4b-1d12-4e39-9cf7-2adc8f46cd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:05.837515 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:05.853722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68feb5bb-da8b-491b-a160-4b085653d974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:05.854858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68feb5bb-da8b-491b-a160-4b085653d974 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:05.855157 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68feb5bb-da8b-491b-a160-4b085653d974 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:05.855706 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68feb5bb-da8b-491b-a160-4b085653d974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:05.855831 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:05.858340 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-68feb5bb-da8b-491b-a160-4b085653d974 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:05.881179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 994/1994] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:05.892123 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e789c4b-1d12-4e39-9cf7-2adc8f46cd21 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:05.893685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3e789c4b-1d12-4e39-9cf7-2adc8f46cd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:05.906270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e789c4b-1d12-4e39-9cf7-2adc8f46cd21 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:05.910164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685300c2-d6b8-4dca-b3b3-68efd1c1c303 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:05.910815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685300c2-d6b8-4dca-b3b3-68efd1c1c303 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:05.911105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685300c2-d6b8-4dca-b3b3-68efd1c1c303 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:05.911385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685300c2-d6b8-4dca-b3b3-68efd1c1c303 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:05.921384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685300c2-d6b8-4dca-b3b3-68efd1c1c303 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:05.922833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685300c2-d6b8-4dca-b3b3-68efd1c1c303 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:05.929964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68feb5bb-da8b-491b-a160-4b085653d974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:05.931397 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68feb5bb-da8b-491b-a160-4b085653d974 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:05.932549 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 995/1995] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:10:05.942707 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1001/1996] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:05.960253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685300c2-d6b8-4dca-b3b3-68efd1c1c303 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:06.032110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685300c2-d6b8-4dca-b3b3-68efd1c1c303 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:06.036848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccccb3-0c19-4070-ad9d-352ab9b066e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:06.037731 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccccb3-0c19-4070-ad9d-352ab9b066e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:06.038023 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccccb3-0c19-4070-ad9d-352ab9b066e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:06.038310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccccb3-0c19-4070-ad9d-352ab9b066e2 admin admin] PATH_INFO: `/v3/users/0073b4f6b6f14bb48dcd8541162eaf01` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:06.039520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccccb3-0c19-4070-ad9d-352ab9b066e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0073b4f6b6f14bb48dcd8541162eaf01)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:06.041985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccccb3-0c19-4070-ad9d-352ab9b066e2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:06.087626 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-26ccccb3-0c19-4070-ad9d-352ab9b066e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0073b4f6b6f14bb48dcd8541162eaf01'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:06.094427 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-26ccccb3-0c19-4070-ad9d-352ab9b066e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0073b4f6b6f14bb48dcd8541162eaf01'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:06.101531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-26ccccb3-0c19-4070-ad9d-352ab9b066e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0073b4f6b6f14bb48dcd8541162eaf01'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:06.102607 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-26ccccb3-0c19-4070-ad9d-352ab9b066e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0073b4f6b6f14bb48dcd8541162eaf01'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:06.103404 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-26ccccb3-0c19-4070-ad9d-352ab9b066e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0073b4f6b6f14bb48dcd8541162eaf01'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:06.121761 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 996/1997] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:05 2022] DELETE /identity/v3/users/0073b4f6b6f14bb48dcd8541162eaf01 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:06.126954 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca4444-6247-4911-9841-378eba73c55a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:06.127294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca4444-6247-4911-9841-378eba73c55a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:06.127588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca4444-6247-4911-9841-378eba73c55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:06.146952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-26ca4444-6247-4911-9841-378eba73c55a None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:06.148252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-26ca4444-6247-4911-9841-378eba73c55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:06.217879 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1002/1998] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:06.227306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccccb3-0c19-4070-ad9d-352ab9b066e2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:06.228774 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-26ccccb3-0c19-4070-ad9d-352ab9b066e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:06.286021 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:06.293536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccccb3-0c19-4070-ad9d-352ab9b066e2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:06.298655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70575e3c-eaf6-4d2e-8620-f9d1183fa9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:06.299315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70575e3c-eaf6-4d2e-8620-f9d1183fa9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:06.299604 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70575e3c-eaf6-4d2e-8620-f9d1183fa9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:06.299886 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70575e3c-eaf6-4d2e-8620-f9d1183fa9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:06.310202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70575e3c-eaf6-4d2e-8620-f9d1183fa9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:06.311826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70575e3c-eaf6-4d2e-8620-f9d1183fa9d8 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:06.327565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 997/1999] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:06.846135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca4444-6247-4911-9841-378eba73c55a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:06.848520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-26ca4444-6247-4911-9841-378eba73c55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:06.869503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca4444-6247-4911-9841-378eba73c55a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:06.876436 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d2245-d0e0-4334-a6b2-8920be7b9d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:06.877817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2245-d0e0-4334-a6b2-8920be7b9d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:06.877817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2245-d0e0-4334-a6b2-8920be7b9d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:06.878020 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2245-d0e0-4334-a6b2-8920be7b9d42 admin admin] PATH_INFO: `/v3/projects/e5f200b27e4640a59e9f76c737f94480` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:06.879278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d2245-d0e0-4334-a6b2-8920be7b9d42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5f200b27e4640a59e9f76c737f94480)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:06.881845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d2245-d0e0-4334-a6b2-8920be7b9d42 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:06.951989 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b15d2245-d0e0-4334-a6b2-8920be7b9d42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5f200b27e4640a59e9f76c737f94480', 'request_id': 'req-b15d2245-d0e0-4334-a6b2-8920be7b9d42'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:06.959624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b15d2245-d0e0-4334-a6b2-8920be7b9d42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5f200b27e4640a59e9f76c737f94480', 'request_id': 'req-b15d2245-d0e0-4334-a6b2-8920be7b9d42'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:06.966812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b15d2245-d0e0-4334-a6b2-8920be7b9d42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5f200b27e4640a59e9f76c737f94480', 'request_id': 'req-b15d2245-d0e0-4334-a6b2-8920be7b9d42'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:06.981925 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b15d2245-d0e0-4334-a6b2-8920be7b9d42 admin admin] The token cache is being invalidate because project e5f200b27e4640a59e9f76c737f94480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:06.982392 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b15d2245-d0e0-4334-a6b2-8920be7b9d42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:06.983094 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b15d2245-d0e0-4334-a6b2-8920be7b9d42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:06.984766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1003/2000] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:06 2022] DELETE /identity/v3/projects/e5f200b27e4640a59e9f76c737f94480 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:06.988804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70575e3c-eaf6-4d2e-8620-f9d1183fa9d8 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:07.000246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70575e3c-eaf6-4d2e-8620-f9d1183fa9d8 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:07.077466 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c5fbb-6bf9-4c93-8768-05c322703813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:07.078559 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c5fbb-6bf9-4c93-8768-05c322703813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:07.078845 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c5fbb-6bf9-4c93-8768-05c322703813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:07.079119 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c5fbb-6bf9-4c93-8768-05c322703813 admin admin] PATH_INFO: `/v3/users/d06a6b1817c64de3a113d8ec10f543c8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:07.080830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c5fbb-6bf9-4c93-8768-05c322703813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d06a6b1817c64de3a113d8ec10f543c8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:07.082770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c5fbb-6bf9-4c93-8768-05c322703813 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:07.142569 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7d0c5fbb-6bf9-4c93-8768-05c322703813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd06a6b1817c64de3a113d8ec10f543c8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:07.149521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7d0c5fbb-6bf9-4c93-8768-05c322703813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd06a6b1817c64de3a113d8ec10f543c8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:07.156809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7d0c5fbb-6bf9-4c93-8768-05c322703813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd06a6b1817c64de3a113d8ec10f543c8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:07.157442 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7d0c5fbb-6bf9-4c93-8768-05c322703813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd06a6b1817c64de3a113d8ec10f543c8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:07.158057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7d0c5fbb-6bf9-4c93-8768-05c322703813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd06a6b1817c64de3a113d8ec10f543c8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:07.177181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 998/2001] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:06 2022] DELETE /identity/v3/users/d06a6b1817c64de3a113d8ec10f543c8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:07.239827 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d2245-d0e0-4334-a6b2-8920be7b9d42 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:07.242129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b15d2245-d0e0-4334-a6b2-8920be7b9d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:07.271456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:07.331064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d2245-d0e0-4334-a6b2-8920be7b9d42 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:07.405752 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe6ce5-5084-4c4d-8223-300b3f781907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:07.406437 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe6ce5-5084-4c4d-8223-300b3f781907 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:07.407650 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe6ce5-5084-4c4d-8223-300b3f781907 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:07.407650 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe6ce5-5084-4c4d-8223-300b3f781907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:07.409683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3abe6ce5-5084-4c4d-8223-300b3f781907 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:07.500030 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe6ce5-5084-4c4d-8223-300b3f781907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:07.501932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe6ce5-5084-4c4d-8223-300b3f781907 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:07.520200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1004/2002] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:07.521852 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c5fbb-6bf9-4c93-8768-05c322703813 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:07.523472 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7d0c5fbb-6bf9-4c93-8768-05c322703813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:07.614833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c5fbb-6bf9-4c93-8768-05c322703813 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:07.620823 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f010b-e5d1-44fd-a81f-2398accda58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:07.621691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f010b-e5d1-44fd-a81f-2398accda58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:07.621983 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f010b-e5d1-44fd-a81f-2398accda58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:07.622872 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f010b-e5d1-44fd-a81f-2398accda58d admin admin] PATH_INFO: `/v3/projects/34de0aa9d95048e0bb600283a6d0df6c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:07.624273 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f010b-e5d1-44fd-a81f-2398accda58d admin admin] RBAC: Authorizing `identity:delete_project(project_id=34de0aa9d95048e0bb600283a6d0df6c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:07.626285 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f010b-e5d1-44fd-a81f-2398accda58d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:07.640784 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:07.692124 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e5f010b-e5d1-44fd-a81f-2398accda58d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34de0aa9d95048e0bb600283a6d0df6c', 'request_id': 'req-9e5f010b-e5d1-44fd-a81f-2398accda58d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:07.698813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e5f010b-e5d1-44fd-a81f-2398accda58d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34de0aa9d95048e0bb600283a6d0df6c', 'request_id': 'req-9e5f010b-e5d1-44fd-a81f-2398accda58d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:07.710822 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e5f010b-e5d1-44fd-a81f-2398accda58d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34de0aa9d95048e0bb600283a6d0df6c', 'request_id': 'req-9e5f010b-e5d1-44fd-a81f-2398accda58d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:07.724379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e5f010b-e5d1-44fd-a81f-2398accda58d admin admin] The token cache is being invalidate because project 34de0aa9d95048e0bb600283a6d0df6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:07.724692 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e5f010b-e5d1-44fd-a81f-2398accda58d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:07.725387 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e5f010b-e5d1-44fd-a81f-2398accda58d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:07.727395 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 999/2003] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:07 2022] DELETE /identity/v3/projects/34de0aa9d95048e0bb600283a6d0df6c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:07.732234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c34944-0692-49c6-9d7c-91e9de63fbca None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:07.732716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c34944-0692-49c6-9d7c-91e9de63fbca None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:07.733380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c34944-0692-49c6-9d7c-91e9de63fbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:07.752298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a2c34944-0692-49c6-9d7c-91e9de63fbca None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:07.753516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a2c34944-0692-49c6-9d7c-91e9de63fbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:07.832269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1005/2004] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:07.839168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ad247-56b5-49a0-b5a2-b6eae79d6b97 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:07.839465 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ad247-56b5-49a0-b5a2-b6eae79d6b97 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:07.839742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ad247-56b5-49a0-b5a2-b6eae79d6b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:07.872691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ab0ad247-56b5-49a0-b5a2-b6eae79d6b97 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:07.872691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ab0ad247-56b5-49a0-b5a2-b6eae79d6b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:07.889397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1000/2005] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:07.900260 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c34944-0692-49c6-9d7c-91e9de63fbca None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:07.918083 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c34944-0692-49c6-9d7c-91e9de63fbca None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:07.929245 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12329c9f-6d1f-4809-b8da-7425d415cbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:07.930321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12329c9f-6d1f-4809-b8da-7425d415cbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:07.931460 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12329c9f-6d1f-4809-b8da-7425d415cbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:07.932126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12329c9f-6d1f-4809-b8da-7425d415cbd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:07.942059 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12329c9f-6d1f-4809-b8da-7425d415cbd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:10:07.942583 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12329c9f-6d1f-4809-b8da-7425d415cbd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:07.944324 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12329c9f-6d1f-4809-b8da-7425d415cbd4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:07.975005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1006/2006] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:10:07.978893 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ad247-56b5-49a0-b5a2-b6eae79d6b97 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:07.994022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ad247-56b5-49a0-b5a2-b6eae79d6b97 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:08.009520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561cf7e-8890-4e6a-844a-7b5274e08234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:08.010278 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561cf7e-8890-4e6a-844a-7b5274e08234 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:08.012118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561cf7e-8890-4e6a-844a-7b5274e08234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:08.012535 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561cf7e-8890-4e6a-844a-7b5274e08234 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:08.013425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561cf7e-8890-4e6a-844a-7b5274e08234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:08.018238 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561cf7e-8890-4e6a-844a-7b5274e08234 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:08.080050 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1001/2007] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:07 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:08.085901 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12329c9f-6d1f-4809-b8da-7425d415cbd4 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:08.102460 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12329c9f-6d1f-4809-b8da-7425d415cbd4 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:08.111120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:08.221739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ef96b-bd2a-41cd-8a58-8fe00dfac160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:08.222531 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ef96b-bd2a-41cd-8a58-8fe00dfac160 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:08.222947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ef96b-bd2a-41cd-8a58-8fe00dfac160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:08.223251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ef96b-bd2a-41cd-8a58-8fe00dfac160 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:08.224087 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ef96b-bd2a-41cd-8a58-8fe00dfac160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:08.226427 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ef96b-bd2a-41cd-8a58-8fe00dfac160 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:08.253823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1007/2008] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:08 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:08.257736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561cf7e-8890-4e6a-844a-7b5274e08234 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:08.269561 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561cf7e-8890-4e6a-844a-7b5274e08234 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:08.279092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6e943-8d9c-44af-b876-3fe056319e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:08.281255 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6e943-8d9c-44af-b876-3fe056319e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:08.281502 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6e943-8d9c-44af-b876-3fe056319e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:08.281943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6e943-8d9c-44af-b876-3fe056319e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:08.282751 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6e943-8d9c-44af-b876-3fe056319e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:08.285332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6e943-8d9c-44af-b876-3fe056319e4a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:08.296768 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1002/2009] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:08.301497 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ef96b-bd2a-41cd-8a58-8fe00dfac160 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:08.313578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ef96b-bd2a-41cd-8a58-8fe00dfac160 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:08.319834 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a4a61-2b08-4906-a54c-5e2e09686be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:08.320721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a4a61-2b08-4906-a54c-5e2e09686be9 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:08.321159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a4a61-2b08-4906-a54c-5e2e09686be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:08.321569 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a4a61-2b08-4906-a54c-5e2e09686be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:08.322508 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a4a61-2b08-4906-a54c-5e2e09686be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:08.324581 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a4a61-2b08-4906-a54c-5e2e09686be9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:08.343142 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1008/2010] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:08.347201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6e943-8d9c-44af-b876-3fe056319e4a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:08.358241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6e943-8d9c-44af-b876-3fe056319e4a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:08.363111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59d752-41ac-412b-93bc-83fcc47133d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:08.364011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59d752-41ac-412b-93bc-83fcc47133d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:08.364565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59d752-41ac-412b-93bc-83fcc47133d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:08.365693 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59d752-41ac-412b-93bc-83fcc47133d4 admin admin] PATH_INFO: `/v3/projects/3f12f6243ce94c01968f196d3a83d60b/users/a7ffd76190ba4329b9cb06065e5da3b6/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:08.397918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59d752-41ac-412b-93bc-83fcc47133d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f12f6243ce94c01968f196d3a83d60b, user_id=a7ffd76190ba4329b9cb06065e5da3b6, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:08.400954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59d752-41ac-412b-93bc-83fcc47133d4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:08.419880 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1003/2011] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:08 2022] PUT /identity/v3/projects/3f12f6243ce94c01968f196d3a83d60b/users/a7ffd76190ba4329b9cb06065e5da3b6/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:08.431129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822957dd-b078-4421-bd40-17be2c974bb7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:08.431453 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822957dd-b078-4421-bd40-17be2c974bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:08.431740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822957dd-b078-4421-bd40-17be2c974bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:08.469872 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-822957dd-b078-4421-bd40-17be2c974bb7 None None] MFA Rules not processed for user `a7ffd76190ba4329b9cb06065e5da3b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:08.471300 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-822957dd-b078-4421-bd40-17be2c974bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:08.564280 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1009/2012] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:08.565824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59d752-41ac-412b-93bc-83fcc47133d4 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:08.654290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59d752-41ac-412b-93bc-83fcc47133d4 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:08.660333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d424b6d-5dee-4500-9316-fbc3e7071b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:08.661092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d424b6d-5dee-4500-9316-fbc3e7071b4f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:08.661390 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d424b6d-5dee-4500-9316-fbc3e7071b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:08.661669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d424b6d-5dee-4500-9316-fbc3e7071b4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:08.663697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d424b6d-5dee-4500-9316-fbc3e7071b4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:08.664372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d424b6d-5dee-4500-9316-fbc3e7071b4f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:08.693802 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1004/2013] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:08 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:08.702265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822957dd-b078-4421-bd40-17be2c974bb7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:08.709285 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822957dd-b078-4421-bd40-17be2c974bb7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:08.768010 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a82ef-3e61-4836-9f0f-a0cdf40bf411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:08.768686 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a82ef-3e61-4836-9f0f-a0cdf40bf411 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:08.768971 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a82ef-3e61-4836-9f0f-a0cdf40bf411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:08.769250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a82ef-3e61-4836-9f0f-a0cdf40bf411 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:08.769951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a82ef-3e61-4836-9f0f-a0cdf40bf411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:08.771858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a82ef-3e61-4836-9f0f-a0cdf40bf411 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:08.792127 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1010/2014] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:08 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:08.795946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d424b6d-5dee-4500-9316-fbc3e7071b4f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:08.806089 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d424b6d-5dee-4500-9316-fbc3e7071b4f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:08.811109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f83f6-5fb3-47ad-8804-d54347f4c3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:08.811769 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f83f6-5fb3-47ad-8804-d54347f4c3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:08.812092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f83f6-5fb3-47ad-8804-d54347f4c3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:08.812369 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f83f6-5fb3-47ad-8804-d54347f4c3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:08.813090 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f83f6-5fb3-47ad-8804-d54347f4c3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:08.814676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f83f6-5fb3-47ad-8804-d54347f4c3d6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:08.825118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1005/2015] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:08.829657 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a82ef-3e61-4836-9f0f-a0cdf40bf411 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:08.839379 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a82ef-3e61-4836-9f0f-a0cdf40bf411 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:08.844571 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccd208-0f28-4519-a27b-86ea92daded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:08.845444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccd208-0f28-4519-a27b-86ea92daded7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:08.845728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccd208-0f28-4519-a27b-86ea92daded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:08.846017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccd208-0f28-4519-a27b-86ea92daded7 admin admin] PATH_INFO: `/v3/projects/a94c0057ebc7487191f6cecad56c2d8e/users/4628ec66aa8941d79ab419b87e5696d7/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:08.848247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:08.862128 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cccd208-0f28-4519-a27b-86ea92daded7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94c0057ebc7487191f6cecad56c2d8e, user_id=4628ec66aa8941d79ab419b87e5696d7, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:08.864847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cccd208-0f28-4519-a27b-86ea92daded7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:08.877992 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1011/2016] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:08 2022] PUT /identity/v3/projects/a94c0057ebc7487191f6cecad56c2d8e/users/4628ec66aa8941d79ab419b87e5696d7/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:08.881844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f83f6-5fb3-47ad-8804-d54347f4c3d6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:08.892455 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f83f6-5fb3-47ad-8804-d54347f4c3d6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:08.897000 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:08.949245 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e1d2c-62e9-422e-a4ca-7d92d85deaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:08.949917 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e1d2c-62e9-422e-a4ca-7d92d85deaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:08.950208 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e1d2c-62e9-422e-a4ca-7d92d85deaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:08.950492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e1d2c-62e9-422e-a4ca-7d92d85deaa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:08.951816 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e1d2c-62e9-422e-a4ca-7d92d85deaa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:08.953464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e1d2c-62e9-422e-a4ca-7d92d85deaa7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:08.963065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1006/2017] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:08.967447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccd208-0f28-4519-a27b-86ea92daded7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:08.977997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccd208-0f28-4519-a27b-86ea92daded7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:08.982646 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd0ae3-777c-4d9e-bdd5-8c045c9b5102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:08.983530 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd0ae3-777c-4d9e-bdd5-8c045c9b5102 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:08.983816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd0ae3-777c-4d9e-bdd5-8c045c9b5102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:08.984137 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd0ae3-777c-4d9e-bdd5-8c045c9b5102 admin admin] PATH_INFO: `/v3/projects/a94c0057ebc7487191f6cecad56c2d8e/users/4628ec66aa8941d79ab419b87e5696d7/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:08.986199 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd0ae3-777c-4d9e-bdd5-8c045c9b5102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94c0057ebc7487191f6cecad56c2d8e, user_id=4628ec66aa8941d79ab419b87e5696d7, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:08.988977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd0ae3-777c-4d9e-bdd5-8c045c9b5102 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:08.999788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1012/2018] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:08 2022] PUT /identity/v3/projects/a94c0057ebc7487191f6cecad56c2d8e/users/4628ec66aa8941d79ab419b87e5696d7/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:09.011019 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43716e-1498-45eb-9718-98a85840c6fd None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:09.011317 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43716e-1498-45eb-9718-98a85840c6fd None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:09.011603 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43716e-1498-45eb-9718-98a85840c6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:09.038035 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3b43716e-1498-45eb-9718-98a85840c6fd None None] MFA Rules not processed for user `4628ec66aa8941d79ab419b87e5696d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:09.039237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3b43716e-1498-45eb-9718-98a85840c6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:09.105615 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1007/2019] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:09.116510 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd0ae3-777c-4d9e-bdd5-8c045c9b5102 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:09.118224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6cbd0ae3-777c-4d9e-bdd5-8c045c9b5102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:09.177932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd0ae3-777c-4d9e-bdd5-8c045c9b5102 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:09.181393 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448e54d-ec7a-4cb6-b551-19a74698fb76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:09.182045 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448e54d-ec7a-4cb6-b551-19a74698fb76 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:09.182330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448e54d-ec7a-4cb6-b551-19a74698fb76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:09.182605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448e54d-ec7a-4cb6-b551-19a74698fb76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:09.260370 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448e54d-ec7a-4cb6-b551-19a74698fb76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:09.261844 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448e54d-ec7a-4cb6-b551-19a74698fb76 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:09.271668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1013/2020] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:17.229652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43716e-1498-45eb-9718-98a85840c6fd None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:17.231202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3b43716e-1498-45eb-9718-98a85840c6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:17.357375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43716e-1498-45eb-9718-98a85840c6fd None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:17.363580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cab0a6-0b3b-46cf-8ffb-a8b3e4ec18b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:17.364872 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cab0a6-0b3b-46cf-8ffb-a8b3e4ec18b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:17.365217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cab0a6-0b3b-46cf-8ffb-a8b3e4ec18b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:17.365494 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cab0a6-0b3b-46cf-8ffb-a8b3e4ec18b3 admin admin] PATH_INFO: `/v3/users/b4ed392ed8a94eb4a17c0b52340270e7` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:17.369080 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cab0a6-0b3b-46cf-8ffb-a8b3e4ec18b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ed392ed8a94eb4a17c0b52340270e7)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:17.372913 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cab0a6-0b3b-46cf-8ffb-a8b3e4ec18b3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:17.457016 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:17.475359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e2cab0a6-0b3b-46cf-8ffb-a8b3e4ec18b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ed392ed8a94eb4a17c0b52340270e7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:17.485729 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e2cab0a6-0b3b-46cf-8ffb-a8b3e4ec18b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ed392ed8a94eb4a17c0b52340270e7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:17.497085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e2cab0a6-0b3b-46cf-8ffb-a8b3e4ec18b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ed392ed8a94eb4a17c0b52340270e7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:17.498438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e2cab0a6-0b3b-46cf-8ffb-a8b3e4ec18b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ed392ed8a94eb4a17c0b52340270e7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:17.499212 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e2cab0a6-0b3b-46cf-8ffb-a8b3e4ec18b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ed392ed8a94eb4a17c0b52340270e7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:17.527587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1008/2021] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:17 2022] DELETE /identity/v3/users/b4ed392ed8a94eb4a17c0b52340270e7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:17.530798 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf5868-d430-44e3-bc20-76c46bec053f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:17.532041 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf5868-d430-44e3-bc20-76c46bec053f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:17.532819 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf5868-d430-44e3-bc20-76c46bec053f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:17.555457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6adf5868-d430-44e3-bc20-76c46bec053f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:17.556829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6adf5868-d430-44e3-bc20-76c46bec053f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:17.644193 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1014/2022] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:17.663039 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cab0a6-0b3b-46cf-8ffb-a8b3e4ec18b3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:17.665083 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e2cab0a6-0b3b-46cf-8ffb-a8b3e4ec18b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:17.754306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cab0a6-0b3b-46cf-8ffb-a8b3e4ec18b3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:17.762444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659a0bd-4d90-476b-881b-a60ba9d51f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:17.763219 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659a0bd-4d90-476b-881b-a60ba9d51f79 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:17.763612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659a0bd-4d90-476b-881b-a60ba9d51f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:17.764524 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659a0bd-4d90-476b-881b-a60ba9d51f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:17.789534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659a0bd-4d90-476b-881b-a60ba9d51f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:17.791607 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659a0bd-4d90-476b-881b-a60ba9d51f79 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:17.811814 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1009/2023] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:17.898705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf5868-d430-44e3-bc20-76c46bec053f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:17.900448 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6adf5868-d430-44e3-bc20-76c46bec053f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:17.922464 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf5868-d430-44e3-bc20-76c46bec053f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:17.930837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9338842-d4f4-45a0-a43d-bed822d3ea68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:17.932065 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9338842-d4f4-45a0-a43d-bed822d3ea68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:17.932506 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9338842-d4f4-45a0-a43d-bed822d3ea68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:17.932741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9338842-d4f4-45a0-a43d-bed822d3ea68 admin admin] PATH_INFO: `/v3/users/167ad498253b45e6b649e4c232f05a69` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:17.934118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9338842-d4f4-45a0-a43d-bed822d3ea68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=167ad498253b45e6b649e4c232f05a69)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:17.937299 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9338842-d4f4-45a0-a43d-bed822d3ea68 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:17.962732 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:17.988759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b9338842-d4f4-45a0-a43d-bed822d3ea68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '167ad498253b45e6b649e4c232f05a69'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:17.989545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b9338842-d4f4-45a0-a43d-bed822d3ea68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '167ad498253b45e6b649e4c232f05a69'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:17.997577 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b9338842-d4f4-45a0-a43d-bed822d3ea68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '167ad498253b45e6b649e4c232f05a69'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.005383 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b9338842-d4f4-45a0-a43d-bed822d3ea68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '167ad498253b45e6b649e4c232f05a69'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.018043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b9338842-d4f4-45a0-a43d-bed822d3ea68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '167ad498253b45e6b649e4c232f05a69'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.024981 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1015/2024] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:17 2022] DELETE /identity/v3/users/167ad498253b45e6b649e4c232f05a69 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:18.029478 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3915f0c-8c7d-4526-9a24-0eec2b5103ba None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:18.029860 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3915f0c-8c7d-4526-9a24-0eec2b5103ba None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:18.030208 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3915f0c-8c7d-4526-9a24-0eec2b5103ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:18.052674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d3915f0c-8c7d-4526-9a24-0eec2b5103ba None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:18.053817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d3915f0c-8c7d-4526-9a24-0eec2b5103ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:18.113185 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1010/2025] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:18.123299 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9338842-d4f4-45a0-a43d-bed822d3ea68 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:18.125249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b9338842-d4f4-45a0-a43d-bed822d3ea68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:18.173022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3915f0c-8c7d-4526-9a24-0eec2b5103ba None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:18.174610 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d3915f0c-8c7d-4526-9a24-0eec2b5103ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:18.186611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9338842-d4f4-45a0-a43d-bed822d3ea68 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:18.191591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821661c-eae6-4216-a755-7a1ac562b6e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:18.192444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821661c-eae6-4216-a755-7a1ac562b6e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:18.192825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821661c-eae6-4216-a755-7a1ac562b6e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:18.193128 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821661c-eae6-4216-a755-7a1ac562b6e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:18.193765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3915f0c-8c7d-4526-9a24-0eec2b5103ba None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:18.199219 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840233e-e071-4df1-b4ff-fa9faff51531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:18.200124 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840233e-e071-4df1-b4ff-fa9faff51531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:18.200410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840233e-e071-4df1-b4ff-fa9faff51531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:18.200686 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840233e-e071-4df1-b4ff-fa9faff51531 admin admin] PATH_INFO: `/v3/projects/196bf505059243058b8f1bbf74b90f1f` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:18.202463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840233e-e071-4df1-b4ff-fa9faff51531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=196bf505059243058b8f1bbf74b90f1f)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:18.204418 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840233e-e071-4df1-b4ff-fa9faff51531 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:18.204533 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821661c-eae6-4216-a755-7a1ac562b6e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:18.205874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821661c-eae6-4216-a755-7a1ac562b6e0 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:18.216163 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1016/2026] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:18.253394 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:18.255317 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3840233e-e071-4df1-b4ff-fa9faff51531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '196bf505059243058b8f1bbf74b90f1f', 'request_id': 'req-3840233e-e071-4df1-b4ff-fa9faff51531'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.264168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3840233e-e071-4df1-b4ff-fa9faff51531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '196bf505059243058b8f1bbf74b90f1f', 'request_id': 'req-3840233e-e071-4df1-b4ff-fa9faff51531'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.273034 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3840233e-e071-4df1-b4ff-fa9faff51531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '196bf505059243058b8f1bbf74b90f1f', 'request_id': 'req-3840233e-e071-4df1-b4ff-fa9faff51531'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.287033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3840233e-e071-4df1-b4ff-fa9faff51531 admin admin] The token cache is being invalidate because project 196bf505059243058b8f1bbf74b90f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:18.287728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3840233e-e071-4df1-b4ff-fa9faff51531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.288455 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3840233e-e071-4df1-b4ff-fa9faff51531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.290644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1011/2027] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:18 2022] DELETE /identity/v3/projects/196bf505059243058b8f1bbf74b90f1f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:18.294466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821661c-eae6-4216-a755-7a1ac562b6e0 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:18.307037 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821661c-eae6-4216-a755-7a1ac562b6e0 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:18.372559 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef20908-160c-4ce0-bd30-d6965a27d66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:18.374170 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef20908-160c-4ce0-bd30-d6965a27d66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:18.374463 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef20908-160c-4ce0-bd30-d6965a27d66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:18.374741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef20908-160c-4ce0-bd30-d6965a27d66a admin admin] PATH_INFO: `/v3/users/f1724fb46f594bb8ae2b80f103b02206` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:18.375998 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef20908-160c-4ce0-bd30-d6965a27d66a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1724fb46f594bb8ae2b80f103b02206)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:18.377938 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef20908-160c-4ce0-bd30-d6965a27d66a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:18.422679 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:18.428828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cef20908-160c-4ce0-bd30-d6965a27d66a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1724fb46f594bb8ae2b80f103b02206'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.430179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cef20908-160c-4ce0-bd30-d6965a27d66a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1724fb46f594bb8ae2b80f103b02206'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.438063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cef20908-160c-4ce0-bd30-d6965a27d66a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1724fb46f594bb8ae2b80f103b02206'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.445026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cef20908-160c-4ce0-bd30-d6965a27d66a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1724fb46f594bb8ae2b80f103b02206'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.456720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cef20908-160c-4ce0-bd30-d6965a27d66a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1724fb46f594bb8ae2b80f103b02206'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.462866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1017/2028] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:18 2022] DELETE /identity/v3/users/f1724fb46f594bb8ae2b80f103b02206 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:18.495539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840233e-e071-4df1-b4ff-fa9faff51531 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:18.497028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3840233e-e071-4df1-b4ff-fa9faff51531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:18.512766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840233e-e071-4df1-b4ff-fa9faff51531 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:18.581397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81680f9-2cfd-494a-8947-f9ae38a4a158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:18.583310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81680f9-2cfd-494a-8947-f9ae38a4a158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:18.583814 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81680f9-2cfd-494a-8947-f9ae38a4a158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:18.584320 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81680f9-2cfd-494a-8947-f9ae38a4a158 admin admin] PATH_INFO: `/v3/projects/0014c3b95509435e828efeb66de3fdd4` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:18.585772 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81680f9-2cfd-494a-8947-f9ae38a4a158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0014c3b95509435e828efeb66de3fdd4)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:18.588235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81680f9-2cfd-494a-8947-f9ae38a4a158 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:18.639239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b81680f9-2cfd-494a-8947-f9ae38a4a158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0014c3b95509435e828efeb66de3fdd4', 'request_id': 'req-b81680f9-2cfd-494a-8947-f9ae38a4a158'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.645379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b81680f9-2cfd-494a-8947-f9ae38a4a158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0014c3b95509435e828efeb66de3fdd4', 'request_id': 'req-b81680f9-2cfd-494a-8947-f9ae38a4a158'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.658547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b81680f9-2cfd-494a-8947-f9ae38a4a158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0014c3b95509435e828efeb66de3fdd4', 'request_id': 'req-b81680f9-2cfd-494a-8947-f9ae38a4a158'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.679874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b81680f9-2cfd-494a-8947-f9ae38a4a158 admin admin] The token cache is being invalidate because project 0014c3b95509435e828efeb66de3fdd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:18.680239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b81680f9-2cfd-494a-8947-f9ae38a4a158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.680903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b81680f9-2cfd-494a-8947-f9ae38a4a158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.683413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1012/2029] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:18 2022] DELETE /identity/v3/projects/0014c3b95509435e828efeb66de3fdd4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:18.687791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef20908-160c-4ce0-bd30-d6965a27d66a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:18.689623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cef20908-160c-4ce0-bd30-d6965a27d66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:18.706949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef20908-160c-4ce0-bd30-d6965a27d66a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:18.771143 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8ebdd-abee-4568-bbe1-2fbda160544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:18.772080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8ebdd-abee-4568-bbe1-2fbda160544e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:18.772528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8ebdd-abee-4568-bbe1-2fbda160544e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:18.772955 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8ebdd-abee-4568-bbe1-2fbda160544e admin admin] PATH_INFO: `/v3/users/b64cf4e83dda405c81a124e57aa34c7d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:18.774353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8ebdd-abee-4568-bbe1-2fbda160544e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b64cf4e83dda405c81a124e57aa34c7d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:18.776583 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8ebdd-abee-4568-bbe1-2fbda160544e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:18.790746 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81680f9-2cfd-494a-8947-f9ae38a4a158 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:18.792498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b81680f9-2cfd-494a-8947-f9ae38a4a158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:18.814566 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81680f9-2cfd-494a-8947-f9ae38a4a158 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:18.831292 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae4a23-006f-48b6-9a5c-0d571e8e333e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:18.831292 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae4a23-006f-48b6-9a5c-0d571e8e333e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:18.831292 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae4a23-006f-48b6-9a5c-0d571e8e333e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:18.831292 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae4a23-006f-48b6-9a5c-0d571e8e333e admin admin] PATH_INFO: `/v3/projects/cd3fadfa8f674dffa8360670cdad10e3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:18.833406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae4a23-006f-48b6-9a5c-0d571e8e333e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd3fadfa8f674dffa8360670cdad10e3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:18.835277 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae4a23-006f-48b6-9a5c-0d571e8e333e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:18.844650 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-37a8ebdd-abee-4568-bbe1-2fbda160544e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b64cf4e83dda405c81a124e57aa34c7d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.845867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-37a8ebdd-abee-4568-bbe1-2fbda160544e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b64cf4e83dda405c81a124e57aa34c7d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.857799 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-37a8ebdd-abee-4568-bbe1-2fbda160544e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b64cf4e83dda405c81a124e57aa34c7d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.884693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-37a8ebdd-abee-4568-bbe1-2fbda160544e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b64cf4e83dda405c81a124e57aa34c7d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.924038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c5ae4a23-006f-48b6-9a5c-0d571e8e333e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd3fadfa8f674dffa8360670cdad10e3', 'request_id': 'req-c5ae4a23-006f-48b6-9a5c-0d571e8e333e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.937172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-37a8ebdd-abee-4568-bbe1-2fbda160544e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b64cf4e83dda405c81a124e57aa34c7d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.942778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c5ae4a23-006f-48b6-9a5c-0d571e8e333e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd3fadfa8f674dffa8360670cdad10e3', 'request_id': 'req-c5ae4a23-006f-48b6-9a5c-0d571e8e333e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.948890 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:18.953704 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1018/2030] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:18 2022] DELETE /identity/v3/users/b64cf4e83dda405c81a124e57aa34c7d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:18.958863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c5ae4a23-006f-48b6-9a5c-0d571e8e333e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd3fadfa8f674dffa8360670cdad10e3', 'request_id': 'req-c5ae4a23-006f-48b6-9a5c-0d571e8e333e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.981495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c5ae4a23-006f-48b6-9a5c-0d571e8e333e admin admin] The token cache is being invalidate because project cd3fadfa8f674dffa8360670cdad10e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:18.981943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c5ae4a23-006f-48b6-9a5c-0d571e8e333e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.987584 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c5ae4a23-006f-48b6-9a5c-0d571e8e333e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:18.996129 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1013/2031] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:18 2022] DELETE /identity/v3/projects/cd3fadfa8f674dffa8360670cdad10e3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:18.996243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958d442-0263-4340-b1fb-91e1c738402b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:18.996243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958d442-0263-4340-b1fb-91e1c738402b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:18.996390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958d442-0263-4340-b1fb-91e1c738402b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:19.022200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8958d442-0263-4340-b1fb-91e1c738402b None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:19.023710 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8958d442-0263-4340-b1fb-91e1c738402b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:19.067364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:19.116396 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1019/2032] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:19.119528 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05101f-9e22-46aa-a130-4c79c8bef91f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:19.119971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05101f-9e22-46aa-a130-4c79c8bef91f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:19.120709 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05101f-9e22-46aa-a130-4c79c8bef91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:19.140448 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ed05101f-9e22-46aa-a130-4c79c8bef91f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:19.141775 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ed05101f-9e22-46aa-a130-4c79c8bef91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:19.150646 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1014/2033] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:19.155539 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958d442-0263-4340-b1fb-91e1c738402b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:19.167176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958d442-0263-4340-b1fb-91e1c738402b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:19.172161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df9e12-5894-41d8-bc18-08c3750d2364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:19.172946 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df9e12-5894-41d8-bc18-08c3750d2364 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:19.173339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df9e12-5894-41d8-bc18-08c3750d2364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:19.173720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df9e12-5894-41d8-bc18-08c3750d2364 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:19.174745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df9e12-5894-41d8-bc18-08c3750d2364 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:10:19.175385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df9e12-5894-41d8-bc18-08c3750d2364 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:19.176896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df9e12-5894-41d8-bc18-08c3750d2364 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:19.191070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1020/2034] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:10:19.196290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05101f-9e22-46aa-a130-4c79c8bef91f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:19.213673 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05101f-9e22-46aa-a130-4c79c8bef91f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:19.224378 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc990e6-13aa-4f73-ad11-6b45a7ed451f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:19.225490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc990e6-13aa-4f73-ad11-6b45a7ed451f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:19.226032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc990e6-13aa-4f73-ad11-6b45a7ed451f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:19.226447 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc990e6-13aa-4f73-ad11-6b45a7ed451f admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:19.227279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc990e6-13aa-4f73-ad11-6b45a7ed451f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:19.235683 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc990e6-13aa-4f73-ad11-6b45a7ed451f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:19.267112 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1015/2035] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:19 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:19.271611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df9e12-5894-41d8-bc18-08c3750d2364 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:19.283575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df9e12-5894-41d8-bc18-08c3750d2364 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:19.354035 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6468d0-6b01-445c-af6b-30a9f24c9827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:19.354727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6468d0-6b01-445c-af6b-30a9f24c9827 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:19.355014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6468d0-6b01-445c-af6b-30a9f24c9827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:19.355437 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6468d0-6b01-445c-af6b-30a9f24c9827 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:19.356320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6468d0-6b01-445c-af6b-30a9f24c9827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:19.356687 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc990e6-13aa-4f73-ad11-6b45a7ed451f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:19.358369 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7fc990e6-13aa-4f73-ad11-6b45a7ed451f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:19.358539 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6468d0-6b01-445c-af6b-30a9f24c9827 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:19.384247 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc990e6-13aa-4f73-ad11-6b45a7ed451f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:19.384440 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1021/2036] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:19 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:19.388584 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6468d0-6b01-445c-af6b-30a9f24c9827 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:19.393541 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af03812-4141-46ec-b5e6-4035e3daca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:19.394542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af03812-4141-46ec-b5e6-4035e3daca77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:19.394859 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af03812-4141-46ec-b5e6-4035e3daca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:19.395105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af03812-4141-46ec-b5e6-4035e3daca77 admin admin] PATH_INFO: `/v3/projects/69a76c6a138c41caa6c619409b00d125` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:19.396368 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af03812-4141-46ec-b5e6-4035e3daca77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69a76c6a138c41caa6c619409b00d125)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:19.398305 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af03812-4141-46ec-b5e6-4035e3daca77 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:19.399119 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6468d0-6b01-445c-af6b-30a9f24c9827 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:19.404100 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562281d3-9b05-41e2-986c-67bc0f464b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:19.404784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562281d3-9b05-41e2-986c-67bc0f464b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:19.405068 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562281d3-9b05-41e2-986c-67bc0f464b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:19.405346 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562281d3-9b05-41e2-986c-67bc0f464b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:19.406068 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562281d3-9b05-41e2-986c-67bc0f464b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:19.407632 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562281d3-9b05-41e2-986c-67bc0f464b46 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:19.418992 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1022/2037] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:10:19.422734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562281d3-9b05-41e2-986c-67bc0f464b46 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:19.433772 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562281d3-9b05-41e2-986c-67bc0f464b46 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:19.448691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0af03812-4141-46ec-b5e6-4035e3daca77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69a76c6a138c41caa6c619409b00d125', 'request_id': 'req-0af03812-4141-46ec-b5e6-4035e3daca77'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:19.454869 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0af03812-4141-46ec-b5e6-4035e3daca77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69a76c6a138c41caa6c619409b00d125', 'request_id': 'req-0af03812-4141-46ec-b5e6-4035e3daca77'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:19.462842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0af03812-4141-46ec-b5e6-4035e3daca77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69a76c6a138c41caa6c619409b00d125', 'request_id': 'req-0af03812-4141-46ec-b5e6-4035e3daca77'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:19.475638 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0af03812-4141-46ec-b5e6-4035e3daca77 admin admin] The token cache is being invalidate because project 69a76c6a138c41caa6c619409b00d125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:19.475951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0af03812-4141-46ec-b5e6-4035e3daca77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:19.476604 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0af03812-4141-46ec-b5e6-4035e3daca77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:19.478421 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1016/2038] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:19 2022] DELETE /identity/v3/projects/69a76c6a138c41caa6c619409b00d125 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:19.482069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af03812-4141-46ec-b5e6-4035e3daca77 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:19.483558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0af03812-4141-46ec-b5e6-4035e3daca77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:19.492269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2903c-d729-4464-9b57-44f490dc985a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:19.493112 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2903c-d729-4464-9b57-44f490dc985a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:19.493515 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2903c-d729-4464-9b57-44f490dc985a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:19.493807 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2903c-d729-4464-9b57-44f490dc985a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:19.494545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2903c-d729-4464-9b57-44f490dc985a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:19.496170 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2903c-d729-4464-9b57-44f490dc985a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:19.509857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1023/2039] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:19.510891 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2903c-d729-4464-9b57-44f490dc985a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:19.512644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a3f2903c-d729-4464-9b57-44f490dc985a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:19.526115 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2903c-d729-4464-9b57-44f490dc985a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:19.531058 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d255ec-dbaf-4af4-a5bf-d003750fd420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:19.532017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d255ec-dbaf-4af4-a5bf-d003750fd420 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:19.532390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d255ec-dbaf-4af4-a5bf-d003750fd420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:19.532590 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d255ec-dbaf-4af4-a5bf-d003750fd420 admin admin] PATH_INFO: `/v3/projects/19a51e9453a548d79a2e7f48881f56b5/users/5c5d93043fe4483d98479892ba2b60e5/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:19.550295 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af03812-4141-46ec-b5e6-4035e3daca77 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:19.552473 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d255ec-dbaf-4af4-a5bf-d003750fd420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a51e9453a548d79a2e7f48881f56b5, user_id=5c5d93043fe4483d98479892ba2b60e5, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:19.555787 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d255ec-dbaf-4af4-a5bf-d003750fd420 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:19.556934 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b533c-857a-409c-ac30-66b2eb02ff2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:19.560672 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b533c-857a-409c-ac30-66b2eb02ff2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:19.560672 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b533c-857a-409c-ac30-66b2eb02ff2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:19.560672 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b533c-857a-409c-ac30-66b2eb02ff2b admin admin] PATH_INFO: `/v3/users/5b5b5bd193c5446aafee0589a65d7fc8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:19.560672 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b533c-857a-409c-ac30-66b2eb02ff2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b5b5bd193c5446aafee0589a65d7fc8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:19.563698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b533c-857a-409c-ac30-66b2eb02ff2b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:19.573274 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1024/2040] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:19 2022] PUT /identity/v3/projects/19a51e9453a548d79a2e7f48881f56b5/users/5c5d93043fe4483d98479892ba2b60e5/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:19.584909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d44bb-cda7-4106-b4dc-b5859da3f625 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:19.585226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d44bb-cda7-4106-b4dc-b5859da3f625 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:19.585490 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d44bb-cda7-4106-b4dc-b5859da3f625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:19.611941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-da3d44bb-cda7-4106-b4dc-b5859da3f625 None None] MFA Rules not processed for user `5c5d93043fe4483d98479892ba2b60e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:19.613199 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-da3d44bb-cda7-4106-b4dc-b5859da3f625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:19.617328 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:19.620627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:19.622427 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-632b533c-857a-409c-ac30-66b2eb02ff2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b5b5bd193c5446aafee0589a65d7fc8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:19.631815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-632b533c-857a-409c-ac30-66b2eb02ff2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b5b5bd193c5446aafee0589a65d7fc8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:19.640487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-632b533c-857a-409c-ac30-66b2eb02ff2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b5b5bd193c5446aafee0589a65d7fc8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:19.641126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-632b533c-857a-409c-ac30-66b2eb02ff2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b5b5bd193c5446aafee0589a65d7fc8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:19.641797 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-632b533c-857a-409c-ac30-66b2eb02ff2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b5b5bd193c5446aafee0589a65d7fc8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:19.660175 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1017/2041] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:19 2022] DELETE /identity/v3/users/5b5b5bd193c5446aafee0589a65d7fc8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:19.687244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1025/2042] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:19.691606 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b533c-857a-409c-ac30-66b2eb02ff2b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:19.693028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-632b533c-857a-409c-ac30-66b2eb02ff2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:19.760652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b533c-857a-409c-ac30-66b2eb02ff2b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:19.765437 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4b44e-f1df-40ed-977c-0591fb1c0db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:19.766088 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4b44e-f1df-40ed-977c-0591fb1c0db0 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:19.766376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4b44e-f1df-40ed-977c-0591fb1c0db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:19.766651 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4b44e-f1df-40ed-977c-0591fb1c0db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:19.767344 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4b44e-f1df-40ed-977c-0591fb1c0db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:19.769280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4b44e-f1df-40ed-977c-0591fb1c0db0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:19.794763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1018/2043] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:19 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:19.801029 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d44bb-cda7-4106-b4dc-b5859da3f625 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:19.866681 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d44bb-cda7-4106-b4dc-b5859da3f625 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:19.933826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4b44e-f1df-40ed-977c-0591fb1c0db0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:19.935727 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-67d4b44e-f1df-40ed-977c-0591fb1c0db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:19.938905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4064f9-0da4-4798-b191-74adbd93049a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:19.939904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4064f9-0da4-4798-b191-74adbd93049a admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:19.940229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4064f9-0da4-4798-b191-74adbd93049a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:19.940796 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4064f9-0da4-4798-b191-74adbd93049a admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:19.941676 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4064f9-0da4-4798-b191-74adbd93049a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:19.944293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4064f9-0da4-4798-b191-74adbd93049a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:19.963975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4b44e-f1df-40ed-977c-0591fb1c0db0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:19.971119 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1309be-89ca-4ada-b55f-090f9ad2ec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:19.972091 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1309be-89ca-4ada-b55f-090f9ad2ec04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:19.972372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1309be-89ca-4ada-b55f-090f9ad2ec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:19.972705 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1309be-89ca-4ada-b55f-090f9ad2ec04 admin admin] PATH_INFO: `/v3/projects/988dfc6dcae048acb5319324afa96ea8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:19.974322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1309be-89ca-4ada-b55f-090f9ad2ec04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=988dfc6dcae048acb5319324afa96ea8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:19.976566 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1309be-89ca-4ada-b55f-090f9ad2ec04 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:19.990922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1026/2044] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:19 2022] POST /identity/v3/users => generated 301 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:10:19.994794 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4064f9-0da4-4798-b191-74adbd93049a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:20.005989 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4064f9-0da4-4798-b191-74adbd93049a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:20.010963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771e77d-e222-4515-b88e-afec76696bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:20.011644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771e77d-e222-4515-b88e-afec76696bcb admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.011956 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771e77d-e222-4515-b88e-afec76696bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.012236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771e77d-e222-4515-b88e-afec76696bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.012981 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771e77d-e222-4515-b88e-afec76696bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:20.014623 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771e77d-e222-4515-b88e-afec76696bcb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:20.028786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1027/2045] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:20.030649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771e77d-e222-4515-b88e-afec76696bcb admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:20.040980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771e77d-e222-4515-b88e-afec76696bcb admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:20.043942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ad1309be-89ca-4ada-b55f-090f9ad2ec04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '988dfc6dcae048acb5319324afa96ea8', 'request_id': 'req-ad1309be-89ca-4ada-b55f-090f9ad2ec04'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:20.051015 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ad1309be-89ca-4ada-b55f-090f9ad2ec04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '988dfc6dcae048acb5319324afa96ea8', 'request_id': 'req-ad1309be-89ca-4ada-b55f-090f9ad2ec04'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:20.060586 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ad1309be-89ca-4ada-b55f-090f9ad2ec04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '988dfc6dcae048acb5319324afa96ea8', 'request_id': 'req-ad1309be-89ca-4ada-b55f-090f9ad2ec04'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:20.072949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:20.073856 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ad1309be-89ca-4ada-b55f-090f9ad2ec04 admin admin] The token cache is being invalidate because project 988dfc6dcae048acb5319324afa96ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:20.074094 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ad1309be-89ca-4ada-b55f-090f9ad2ec04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:20.074769 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ad1309be-89ca-4ada-b55f-090f9ad2ec04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:20.076810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1019/2046] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:19 2022] DELETE /identity/v3/projects/988dfc6dcae048acb5319324afa96ea8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:20.081355 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ed414-28af-4309-9e63-d14aa4b8a741 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.081710 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ed414-28af-4309-9e63-d14aa4b8a741 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.082060 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ed414-28af-4309-9e63-d14aa4b8a741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.098965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1b9ed414-28af-4309-9e63-d14aa4b8a741 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:20.100201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1b9ed414-28af-4309-9e63-d14aa4b8a741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:20.103043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda63fdc-7a19-4489-8271-40941ac2c908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:20.104034 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda63fdc-7a19-4489-8271-40941ac2c908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.104337 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda63fdc-7a19-4489-8271-40941ac2c908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.104883 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda63fdc-7a19-4489-8271-40941ac2c908 admin admin] PATH_INFO: `/v3/projects/3b6eb2b5169a4fbf975e7630aabe14da/users/144f1675d0d443fdb30651c9c733ffa2/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.108900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1020/2047] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:20.116344 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23380b-c6b9-43cd-a973-78ddd4d84e45 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.116640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23380b-c6b9-43cd-a973-78ddd4d84e45 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.116925 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23380b-c6b9-43cd-a973-78ddd4d84e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.121806 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda63fdc-7a19-4489-8271-40941ac2c908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6eb2b5169a4fbf975e7630aabe14da, user_id=144f1675d0d443fdb30651c9c733ffa2, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:20.125327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda63fdc-7a19-4489-8271-40941ac2c908 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:20.135411 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-aa23380b-c6b9-43cd-a973-78ddd4d84e45 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:20.136643 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-aa23380b-c6b9-43cd-a973-78ddd4d84e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:20.139281 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1028/2048] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:20 2022] PUT /identity/v3/projects/3b6eb2b5169a4fbf975e7630aabe14da/users/144f1675d0d443fdb30651c9c733ffa2/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:20.143163 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda63fdc-7a19-4489-8271-40941ac2c908 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:20.144760 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fda63fdc-7a19-4489-8271-40941ac2c908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:20.155897 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:20.207312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1021/2049] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:20.211293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23380b-c6b9-43cd-a973-78ddd4d84e45 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:20.219849 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda63fdc-7a19-4489-8271-40941ac2c908 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:20.220497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23380b-c6b9-43cd-a973-78ddd4d84e45 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:20.224574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e53840-5c70-42b6-b4cd-9ac08ce661bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:20.225151 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa5033-7623-4f78-beb8-f54f99f30240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:20.225262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e53840-5c70-42b6-b4cd-9ac08ce661bd admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.225506 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e53840-5c70-42b6-b4cd-9ac08ce661bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.225779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e53840-5c70-42b6-b4cd-9ac08ce661bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.225872 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa5033-7623-4f78-beb8-f54f99f30240 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.226070 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa5033-7623-4f78-beb8-f54f99f30240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.226351 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa5033-7623-4f78-beb8-f54f99f30240 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.226505 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e53840-5c70-42b6-b4cd-9ac08ce661bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:20.227078 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa5033-7623-4f78-beb8-f54f99f30240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:10:20.227389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa5033-7623-4f78-beb8-f54f99f30240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:20.228110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e53840-5c70-42b6-b4cd-9ac08ce661bd admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:20.229026 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa5033-7623-4f78-beb8-f54f99f30240 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:20.239949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1029/2050] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:20.243393 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e53840-5c70-42b6-b4cd-9ac08ce661bd admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:20.248456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1022/2051] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:10:20.249602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa5033-7623-4f78-beb8-f54f99f30240 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:20.253376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e53840-5c70-42b6-b4cd-9ac08ce661bd admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:20.258598 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed504ea-ab5a-4f2d-8d79-0408c1c5f0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:20.259152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed504ea-ab5a-4f2d-8d79-0408c1c5f0ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.259507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed504ea-ab5a-4f2d-8d79-0408c1c5f0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.259723 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa5033-7623-4f78-beb8-f54f99f30240 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:20.259940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed504ea-ab5a-4f2d-8d79-0408c1c5f0ee admin admin] PATH_INFO: `/v3/projects/3b6eb2b5169a4fbf975e7630aabe14da/users/144f1675d0d443fdb30651c9c733ffa2/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.262008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed504ea-ab5a-4f2d-8d79-0408c1c5f0ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6eb2b5169a4fbf975e7630aabe14da, user_id=144f1675d0d443fdb30651c9c733ffa2, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:20.264868 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed504ea-ab5a-4f2d-8d79-0408c1c5f0ee admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:20.265173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515a05f-bf56-4583-8780-840fb1b9de19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:20.265806 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515a05f-bf56-4583-8780-840fb1b9de19 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.266149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515a05f-bf56-4583-8780-840fb1b9de19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.266469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515a05f-bf56-4583-8780-840fb1b9de19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.267115 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515a05f-bf56-4583-8780-840fb1b9de19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:20.269038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515a05f-bf56-4583-8780-840fb1b9de19 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:20.278346 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1030/2052] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:20 2022] PUT /identity/v3/projects/3b6eb2b5169a4fbf975e7630aabe14da/users/144f1675d0d443fdb30651c9c733ffa2/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:20.289643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6483cbd-5d51-4587-8320-1a3ce20970b8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.290288 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6483cbd-5d51-4587-8320-1a3ce20970b8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.290679 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6483cbd-5d51-4587-8320-1a3ce20970b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.298311 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1023/2053] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:20 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:10:20.303705 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515a05f-bf56-4583-8780-840fb1b9de19 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:20.326718 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d6483cbd-5d51-4587-8320-1a3ce20970b8 None None] MFA Rules not processed for user `144f1675d0d443fdb30651c9c733ffa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:20.328527 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d6483cbd-5d51-4587-8320-1a3ce20970b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:20.402161 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515a05f-bf56-4583-8780-840fb1b9de19 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:20.408555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73447a-3d7f-4fbc-82cc-522e7fcbab9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:20.410452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73447a-3d7f-4fbc-82cc-522e7fcbab9b admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.411589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73447a-3d7f-4fbc-82cc-522e7fcbab9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.412072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73447a-3d7f-4fbc-82cc-522e7fcbab9b admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.413551 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73447a-3d7f-4fbc-82cc-522e7fcbab9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:20.416278 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73447a-3d7f-4fbc-82cc-522e7fcbab9b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:20.443487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1031/2054] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:20.450348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1024/2055] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:20 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:10:20.452935 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6483cbd-5d51-4587-8320-1a3ce20970b8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:20.454164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73447a-3d7f-4fbc-82cc-522e7fcbab9b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:20.461603 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d6483cbd-5d51-4587-8320-1a3ce20970b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:20.465008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73447a-3d7f-4fbc-82cc-522e7fcbab9b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:20.478972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eac338-cdd8-4bae-9cf7-f61be27b9283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:20.478972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eac338-cdd8-4bae-9cf7-f61be27b9283 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.478972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eac338-cdd8-4bae-9cf7-f61be27b9283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.478972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eac338-cdd8-4bae-9cf7-f61be27b9283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.479402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eac338-cdd8-4bae-9cf7-f61be27b9283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:20.479402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eac338-cdd8-4bae-9cf7-f61be27b9283 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:20.488933 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1025/2056] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:20.490295 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eac338-cdd8-4bae-9cf7-f61be27b9283 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:20.497443 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:20.501258 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eac338-cdd8-4bae-9cf7-f61be27b9283 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:20.507171 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88486ea8-3be3-4cee-b962-8c35252f16a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:20.507829 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88486ea8-3be3-4cee-b962-8c35252f16a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.508209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88486ea8-3be3-4cee-b962-8c35252f16a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.508435 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88486ea8-3be3-4cee-b962-8c35252f16a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.509168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88486ea8-3be3-4cee-b962-8c35252f16a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:20.510760 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88486ea8-3be3-4cee-b962-8c35252f16a2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:20.522766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1026/2057] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:10:20.526693 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88486ea8-3be3-4cee-b962-8c35252f16a2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:20.537687 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88486ea8-3be3-4cee-b962-8c35252f16a2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:20.543420 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4e007-70b8-43fa-ad99-f5a3738bf6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:20.544348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4e007-70b8-43fa-ad99-f5a3738bf6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.544630 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4e007-70b8-43fa-ad99-f5a3738bf6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.544910 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4e007-70b8-43fa-ad99-f5a3738bf6b3 admin admin] PATH_INFO: `/v3/projects/71b52e5f2a8c47aeaa510dd998687060/users/c061cf52906f4d52b1cb42bffd25bece/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.547299 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6483cbd-5d51-4587-8320-1a3ce20970b8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:20.551120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc8658-5a6d-4156-abf6-4921a7135e37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:20.551773 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc8658-5a6d-4156-abf6-4921a7135e37 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.552092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc8658-5a6d-4156-abf6-4921a7135e37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.552372 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc8658-5a6d-4156-abf6-4921a7135e37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.559411 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4e007-70b8-43fa-ad99-f5a3738bf6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71b52e5f2a8c47aeaa510dd998687060, user_id=c061cf52906f4d52b1cb42bffd25bece, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:20.561804 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc8658-5a6d-4156-abf6-4921a7135e37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:20.562166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4e007-70b8-43fa-ad99-f5a3738bf6b3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:20.563227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc8658-5a6d-4156-abf6-4921a7135e37 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:20.573076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1032/2058] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:10:20.574740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1027/2059] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:20 2022] PUT /identity/v3/projects/71b52e5f2a8c47aeaa510dd998687060/users/c061cf52906f4d52b1cb42bffd25bece/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:20.586034 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4baa9-aa76-4d31-bcce-48f5dc5b98b6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.586328 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4baa9-aa76-4d31-bcce-48f5dc5b98b6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.586605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4baa9-aa76-4d31-bcce-48f5dc5b98b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.614349 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0ad4baa9-aa76-4d31-bcce-48f5dc5b98b6 None None] MFA Rules not processed for user `c061cf52906f4d52b1cb42bffd25bece`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:20.615574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0ad4baa9-aa76-4d31-bcce-48f5dc5b98b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:20.686698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1033/2060] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:20.698239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4e007-70b8-43fa-ad99-f5a3738bf6b3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:20.700514 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f3c4e007-70b8-43fa-ad99-f5a3738bf6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:20.704613 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4baa9-aa76-4d31-bcce-48f5dc5b98b6 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:20.738201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:20.761104 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4e007-70b8-43fa-ad99-f5a3738bf6b3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:20.765279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3f199-3d05-4595-897d-46fee3528460 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182c7bb48c184e9983c02ae86709e803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:20.765924 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3f199-3d05-4595-897d-46fee3528460 service glance] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.766213 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3f199-3d05-4595-897d-46fee3528460 service glance] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.766492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3f199-3d05-4595-897d-46fee3528460 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.767333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4baa9-aa76-4d31-bcce-48f5dc5b98b6 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:20.771921 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b7615-8e41-48a0-b7a8-03c7ab986b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:20.772818 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b7615-8e41-48a0-b7a8-03c7ab986b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.773107 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b7615-8e41-48a0-b7a8-03c7ab986b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.773392 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b7615-8e41-48a0-b7a8-03c7ab986b41 admin admin] PATH_INFO: `/v3/users/5c5d93043fe4483d98479892ba2b60e5` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.774798 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b7615-8e41-48a0-b7a8-03c7ab986b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5d93043fe4483d98479892ba2b60e5)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:20.775263 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3f199-3d05-4595-897d-46fee3528460 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:20.776714 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3f199-3d05-4595-897d-46fee3528460 service glance] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:20.776822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b7615-8e41-48a0-b7a8-03c7ab986b41 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:20.786493 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1028/2061] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:10:20.825423 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a65b7615-8e41-48a0-b7a8-03c7ab986b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5d93043fe4483d98479892ba2b60e5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:20.826223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a65b7615-8e41-48a0-b7a8-03c7ab986b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5d93043fe4483d98479892ba2b60e5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:20.834191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a65b7615-8e41-48a0-b7a8-03c7ab986b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5d93043fe4483d98479892ba2b60e5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:20.836394 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:20.844124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a65b7615-8e41-48a0-b7a8-03c7ab986b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5d93043fe4483d98479892ba2b60e5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:20.858355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a65b7615-8e41-48a0-b7a8-03c7ab986b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5d93043fe4483d98479892ba2b60e5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:20.864708 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1034/2062] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:20 2022] DELETE /identity/v3/users/5c5d93043fe4483d98479892ba2b60e5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:20.869108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b69bac-f99b-42e5-84d7-2377fc3bb6ff None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:20.869405 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b69bac-f99b-42e5-84d7-2377fc3bb6ff None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:20.869690 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b69bac-f99b-42e5-84d7-2377fc3bb6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:20.889589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c1b69bac-f99b-42e5-84d7-2377fc3bb6ff None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:20.890894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c1b69bac-f99b-42e5-84d7-2377fc3bb6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:20.955057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1029/2063] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:20.964544 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b7615-8e41-48a0-b7a8-03c7ab986b41 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:20.965988 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a65b7615-8e41-48a0-b7a8-03c7ab986b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:21.045151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b7615-8e41-48a0-b7a8-03c7ab986b41 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:21.049329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb2863-0858-4a5f-898a-e097c40adfdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:21.050187 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb2863-0858-4a5f-898a-e097c40adfdd service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:21.050474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb2863-0858-4a5f-898a-e097c40adfdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:21.050873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb2863-0858-4a5f-898a-e097c40adfdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:21.061486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb2863-0858-4a5f-898a-e097c40adfdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:21.062572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb2863-0858-4a5f-898a-e097c40adfdd service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:21.074881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1035/2064] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:21.370704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b69bac-f99b-42e5-84d7-2377fc3bb6ff None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:21.372951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c1b69bac-f99b-42e5-84d7-2377fc3bb6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:21.390692 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b69bac-f99b-42e5-84d7-2377fc3bb6ff None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:21.395757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b14940-171f-40ca-8960-2cfdb3c804b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:21.396779 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b14940-171f-40ca-8960-2cfdb3c804b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:21.397134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b14940-171f-40ca-8960-2cfdb3c804b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:21.397493 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b14940-171f-40ca-8960-2cfdb3c804b0 admin admin] PATH_INFO: `/v3/projects/19a51e9453a548d79a2e7f48881f56b5` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:21.398899 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b14940-171f-40ca-8960-2cfdb3c804b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a51e9453a548d79a2e7f48881f56b5)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:21.401452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b14940-171f-40ca-8960-2cfdb3c804b0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:21.447260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-26b14940-171f-40ca-8960-2cfdb3c804b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a51e9453a548d79a2e7f48881f56b5', 'request_id': 'req-26b14940-171f-40ca-8960-2cfdb3c804b0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:21.453272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-26b14940-171f-40ca-8960-2cfdb3c804b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a51e9453a548d79a2e7f48881f56b5', 'request_id': 'req-26b14940-171f-40ca-8960-2cfdb3c804b0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:21.460393 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-26b14940-171f-40ca-8960-2cfdb3c804b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a51e9453a548d79a2e7f48881f56b5', 'request_id': 'req-26b14940-171f-40ca-8960-2cfdb3c804b0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:21.471975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-26b14940-171f-40ca-8960-2cfdb3c804b0 admin admin] The token cache is being invalidate because project 19a51e9453a548d79a2e7f48881f56b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:21.472269 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-26b14940-171f-40ca-8960-2cfdb3c804b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:21.472907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-26b14940-171f-40ca-8960-2cfdb3c804b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:21.474440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1030/2065] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:21 2022] DELETE /identity/v3/projects/19a51e9453a548d79a2e7f48881f56b5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:21.478401 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb2863-0858-4a5f-898a-e097c40adfdd service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:21.488213 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb2863-0858-4a5f-898a-e097c40adfdd service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:21.548250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66272c81-245a-4f30-b2ef-b58a5dff9116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:21.549212 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66272c81-245a-4f30-b2ef-b58a5dff9116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:21.549562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66272c81-245a-4f30-b2ef-b58a5dff9116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:21.549911 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66272c81-245a-4f30-b2ef-b58a5dff9116 admin admin] PATH_INFO: `/v3/users/144f1675d0d443fdb30651c9c733ffa2` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:21.551200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66272c81-245a-4f30-b2ef-b58a5dff9116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=144f1675d0d443fdb30651c9c733ffa2)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:21.553401 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66272c81-245a-4f30-b2ef-b58a5dff9116 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:21.613768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-66272c81-245a-4f30-b2ef-b58a5dff9116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144f1675d0d443fdb30651c9c733ffa2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:21.615269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-66272c81-245a-4f30-b2ef-b58a5dff9116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144f1675d0d443fdb30651c9c733ffa2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:21.625996 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-66272c81-245a-4f30-b2ef-b58a5dff9116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144f1675d0d443fdb30651c9c733ffa2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:21.634227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-66272c81-245a-4f30-b2ef-b58a5dff9116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144f1675d0d443fdb30651c9c733ffa2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:21.648778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:21.652960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-66272c81-245a-4f30-b2ef-b58a5dff9116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144f1675d0d443fdb30651c9c733ffa2'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:21.666331 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1036/2066] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:21 2022] DELETE /identity/v3/users/144f1675d0d443fdb30651c9c733ffa2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:21.958111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b14940-171f-40ca-8960-2cfdb3c804b0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:21.959666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-26b14940-171f-40ca-8960-2cfdb3c804b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:21.974365 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b14940-171f-40ca-8960-2cfdb3c804b0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:22.032292 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e835c2a-4b06-49ee-ba66-bdb3e64b1d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:22.033196 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e835c2a-4b06-49ee-ba66-bdb3e64b1d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:22.033487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e835c2a-4b06-49ee-ba66-bdb3e64b1d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:22.033766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e835c2a-4b06-49ee-ba66-bdb3e64b1d0d admin admin] PATH_INFO: `/v3/projects/3b6eb2b5169a4fbf975e7630aabe14da` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:22.035021 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e835c2a-4b06-49ee-ba66-bdb3e64b1d0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b6eb2b5169a4fbf975e7630aabe14da)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:22.037039 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e835c2a-4b06-49ee-ba66-bdb3e64b1d0d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:22.038554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:22.086755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4e835c2a-4b06-49ee-ba66-bdb3e64b1d0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b6eb2b5169a4fbf975e7630aabe14da', 'request_id': 'req-4e835c2a-4b06-49ee-ba66-bdb3e64b1d0d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:22.092139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4e835c2a-4b06-49ee-ba66-bdb3e64b1d0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b6eb2b5169a4fbf975e7630aabe14da', 'request_id': 'req-4e835c2a-4b06-49ee-ba66-bdb3e64b1d0d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:22.103822 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4e835c2a-4b06-49ee-ba66-bdb3e64b1d0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b6eb2b5169a4fbf975e7630aabe14da', 'request_id': 'req-4e835c2a-4b06-49ee-ba66-bdb3e64b1d0d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:22.122271 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4e835c2a-4b06-49ee-ba66-bdb3e64b1d0d admin admin] The token cache is being invalidate because project 3b6eb2b5169a4fbf975e7630aabe14da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:22.122389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4e835c2a-4b06-49ee-ba66-bdb3e64b1d0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:22.122998 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4e835c2a-4b06-49ee-ba66-bdb3e64b1d0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:22.125178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1031/2067] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:21 2022] DELETE /identity/v3/projects/3b6eb2b5169a4fbf975e7630aabe14da => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:22.130857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456ced0-a88d-4253-a862-25d396124a55 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:22.131372 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456ced0-a88d-4253-a862-25d396124a55 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:22.131527 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456ced0-a88d-4253-a862-25d396124a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:22.160104 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d456ced0-a88d-4253-a862-25d396124a55 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:22.161328 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d456ced0-a88d-4253-a862-25d396124a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:22.223618 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1037/2068] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:22.231226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1608a-1db2-4481-8a43-8e5269c3290b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:22.231522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1608a-1db2-4481-8a43-8e5269c3290b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:22.231805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1608a-1db2-4481-8a43-8e5269c3290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:22.250802 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-acd1608a-1db2-4481-8a43-8e5269c3290b None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:22.252052 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-acd1608a-1db2-4481-8a43-8e5269c3290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:22.260371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1032/2069] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:22.264549 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456ced0-a88d-4253-a862-25d396124a55 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:22.274074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456ced0-a88d-4253-a862-25d396124a55 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:22.278599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b07f4c-87a2-4252-ae10-30db996ea429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:22.279270 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b07f4c-87a2-4252-ae10-30db996ea429 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:22.279597 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b07f4c-87a2-4252-ae10-30db996ea429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:22.279881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b07f4c-87a2-4252-ae10-30db996ea429 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:22.280643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b07f4c-87a2-4252-ae10-30db996ea429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:10:22.280954 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b07f4c-87a2-4252-ae10-30db996ea429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:22.282551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b07f4c-87a2-4252-ae10-30db996ea429 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:22.297516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1038/2070] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:10:22.302200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1608a-1db2-4481-8a43-8e5269c3290b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:22.312855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1608a-1db2-4481-8a43-8e5269c3290b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:22.317778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672628c-d6cf-41ea-9a02-a8c2cb448e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:22.319635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672628c-d6cf-41ea-9a02-a8c2cb448e27 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:22.319635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672628c-d6cf-41ea-9a02-a8c2cb448e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:22.319635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672628c-d6cf-41ea-9a02-a8c2cb448e27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:22.319968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672628c-d6cf-41ea-9a02-a8c2cb448e27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:22.321829 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672628c-d6cf-41ea-9a02-a8c2cb448e27 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:22.355877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1033/2071] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:22 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:22.360716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b07f4c-87a2-4252-ae10-30db996ea429 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:22.371478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b07f4c-87a2-4252-ae10-30db996ea429 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:22.433154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a5170-2d0b-4f31-9151-620a12a95507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:22.433837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a5170-2d0b-4f31-9151-620a12a95507 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:22.434120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a5170-2d0b-4f31-9151-620a12a95507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:22.434398 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a5170-2d0b-4f31-9151-620a12a95507 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:22.435125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a5170-2d0b-4f31-9151-620a12a95507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:22.437129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a5170-2d0b-4f31-9151-620a12a95507 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:22.456872 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1039/2072] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:22 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:22.460844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672628c-d6cf-41ea-9a02-a8c2cb448e27 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:22.471527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672628c-d6cf-41ea-9a02-a8c2cb448e27 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:22.476094 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f60845-7fba-4ab2-b03e-727d8da7462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:22.476745 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60845-7fba-4ab2-b03e-727d8da7462c admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:22.477033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60845-7fba-4ab2-b03e-727d8da7462c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:22.477310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60845-7fba-4ab2-b03e-727d8da7462c admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:22.478034 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f60845-7fba-4ab2-b03e-727d8da7462c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:22.479624 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f60845-7fba-4ab2-b03e-727d8da7462c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:22.490717 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1034/2073] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:22.494599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a5170-2d0b-4f31-9151-620a12a95507 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:22.504814 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a5170-2d0b-4f31-9151-620a12a95507 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:22.509396 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f0496-b631-4a76-9acc-163857649de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:22.510058 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f0496-b631-4a76-9acc-163857649de0 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:22.510446 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f0496-b631-4a76-9acc-163857649de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:22.510776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f0496-b631-4a76-9acc-163857649de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:22.511542 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f0496-b631-4a76-9acc-163857649de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:22.513159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f0496-b631-4a76-9acc-163857649de0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:22.526726 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1040/2074] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:22.531328 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f60845-7fba-4ab2-b03e-727d8da7462c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:22.542832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f60845-7fba-4ab2-b03e-727d8da7462c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:22.548389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2888e-f712-4664-b579-c7ec54a8e358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:22.549302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2888e-f712-4664-b579-c7ec54a8e358 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:22.549580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2888e-f712-4664-b579-c7ec54a8e358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:22.549851 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2888e-f712-4664-b579-c7ec54a8e358 admin admin] PATH_INFO: `/v3/projects/ae1556572a29481bb73f577b3007f486/users/dd2d473d93b1409e86bf272950f054d3/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:22.564449 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2888e-f712-4664-b579-c7ec54a8e358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1556572a29481bb73f577b3007f486, user_id=dd2d473d93b1409e86bf272950f054d3, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:22.567122 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2888e-f712-4664-b579-c7ec54a8e358 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:22.580036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1035/2075] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:22 2022] PUT /identity/v3/projects/ae1556572a29481bb73f577b3007f486/users/dd2d473d93b1409e86bf272950f054d3/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:22.590126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f5a12-96ee-41e9-8324-502419fa1ccc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:22.590422 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f5a12-96ee-41e9-8324-502419fa1ccc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:22.590734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f5a12-96ee-41e9-8324-502419fa1ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:22.618119 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3e0f5a12-96ee-41e9-8324-502419fa1ccc None None] MFA Rules not processed for user `dd2d473d93b1409e86bf272950f054d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:22.619265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3e0f5a12-96ee-41e9-8324-502419fa1ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:22.670949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:22.690128 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1041/2076] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:22.701748 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2888e-f712-4664-b579-c7ec54a8e358 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:22.703560 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-52a2888e-f712-4664-b579-c7ec54a8e358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:22.761295 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2888e-f712-4664-b579-c7ec54a8e358 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:22.765463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bfab8-016f-4b9b-a20f-c226004a92d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:22.766764 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bfab8-016f-4b9b-a20f-c226004a92d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:22.767068 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bfab8-016f-4b9b-a20f-c226004a92d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:22.767478 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bfab8-016f-4b9b-a20f-c226004a92d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:22.784254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bfab8-016f-4b9b-a20f-c226004a92d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:22.785708 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bfab8-016f-4b9b-a20f-c226004a92d1 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:22.798714 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1036/2077] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:22.825398 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f5a12-96ee-41e9-8324-502419fa1ccc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:22.910985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f5a12-96ee-41e9-8324-502419fa1ccc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:22.915876 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746be21-fd8e-428e-9c8b-b47938cb4dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:22.916787 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746be21-fd8e-428e-9c8b-b47938cb4dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:22.917070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746be21-fd8e-428e-9c8b-b47938cb4dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:22.917344 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746be21-fd8e-428e-9c8b-b47938cb4dc5 admin admin] PATH_INFO: `/v3/users/dd2d473d93b1409e86bf272950f054d3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:22.918680 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746be21-fd8e-428e-9c8b-b47938cb4dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2d473d93b1409e86bf272950f054d3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:22.920748 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746be21-fd8e-428e-9c8b-b47938cb4dc5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:22.969842 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3746be21-fd8e-428e-9c8b-b47938cb4dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2d473d93b1409e86bf272950f054d3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:22.970496 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3746be21-fd8e-428e-9c8b-b47938cb4dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2d473d93b1409e86bf272950f054d3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:22.977445 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3746be21-fd8e-428e-9c8b-b47938cb4dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2d473d93b1409e86bf272950f054d3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:22.985501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3746be21-fd8e-428e-9c8b-b47938cb4dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2d473d93b1409e86bf272950f054d3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:22.997451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3746be21-fd8e-428e-9c8b-b47938cb4dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2d473d93b1409e86bf272950f054d3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:23.003564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1042/2078] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:22 2022] DELETE /identity/v3/users/dd2d473d93b1409e86bf272950f054d3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:23.008581 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5ebc8-28df-4c54-8590-6a3388e49e4e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:23.008581 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5ebc8-28df-4c54-8590-6a3388e49e4e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:23.008814 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5ebc8-28df-4c54-8590-6a3388e49e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:23.026037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-73a5ebc8-28df-4c54-8590-6a3388e49e4e None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:23.027238 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-73a5ebc8-28df-4c54-8590-6a3388e49e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:23.052800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:23.089739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1037/2079] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:23.100844 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746be21-fd8e-428e-9c8b-b47938cb4dc5 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:23.102450 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3746be21-fd8e-428e-9c8b-b47938cb4dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:23.176300 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746be21-fd8e-428e-9c8b-b47938cb4dc5 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:23.180792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a045d-d86a-4e51-bbcd-f7075eee2eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:23.181453 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a045d-d86a-4e51-bbcd-f7075eee2eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:23.181737 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a045d-d86a-4e51-bbcd-f7075eee2eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:23.182014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a045d-d86a-4e51-bbcd-f7075eee2eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:23.194705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a045d-d86a-4e51-bbcd-f7075eee2eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:23.196779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a045d-d86a-4e51-bbcd-f7075eee2eb1 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:23.209286 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1043/2080] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:23.485694 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5ebc8-28df-4c54-8590-6a3388e49e4e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:23.487305 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-73a5ebc8-28df-4c54-8590-6a3388e49e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:23.501124 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5ebc8-28df-4c54-8590-6a3388e49e4e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:23.506232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9a3c8-4961-406a-a850-a64b435ce77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:23.507134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9a3c8-4961-406a-a850-a64b435ce77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:23.507485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9a3c8-4961-406a-a850-a64b435ce77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:23.507821 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9a3c8-4961-406a-a850-a64b435ce77e admin admin] PATH_INFO: `/v3/projects/ae1556572a29481bb73f577b3007f486` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:23.509088 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9a3c8-4961-406a-a850-a64b435ce77e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae1556572a29481bb73f577b3007f486)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:23.511220 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9a3c8-4961-406a-a850-a64b435ce77e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:23.566726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f4b9a3c8-4961-406a-a850-a64b435ce77e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae1556572a29481bb73f577b3007f486', 'request_id': 'req-f4b9a3c8-4961-406a-a850-a64b435ce77e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:23.573458 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f4b9a3c8-4961-406a-a850-a64b435ce77e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae1556572a29481bb73f577b3007f486', 'request_id': 'req-f4b9a3c8-4961-406a-a850-a64b435ce77e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:23.581823 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f4b9a3c8-4961-406a-a850-a64b435ce77e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae1556572a29481bb73f577b3007f486', 'request_id': 'req-f4b9a3c8-4961-406a-a850-a64b435ce77e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:23.593722 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f4b9a3c8-4961-406a-a850-a64b435ce77e admin admin] The token cache is being invalidate because project ae1556572a29481bb73f577b3007f486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:23.593979 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f4b9a3c8-4961-406a-a850-a64b435ce77e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:23.594678 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f4b9a3c8-4961-406a-a850-a64b435ce77e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:23.596279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1038/2081] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:23 2022] DELETE /identity/v3/projects/ae1556572a29481bb73f577b3007f486 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:23.600985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb2872-cc76-4554-8ebf-a14522e95248 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:23.601284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb2872-cc76-4554-8ebf-a14522e95248 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:23.601567 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb2872-cc76-4554-8ebf-a14522e95248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:23.632345 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-91eb2872-cc76-4554-8ebf-a14522e95248 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:23.633911 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-91eb2872-cc76-4554-8ebf-a14522e95248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:23.644557 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:23.699221 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1044/2082] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:23.707869 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7909ca6-bba8-4a70-8f96-97d718c20740 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:23.708196 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7909ca6-bba8-4a70-8f96-97d718c20740 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:23.708478 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7909ca6-bba8-4a70-8f96-97d718c20740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:23.727300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b7909ca6-bba8-4a70-8f96-97d718c20740 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:23.728559 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b7909ca6-bba8-4a70-8f96-97d718c20740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:23.737293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1039/2083] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:23.741665 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb2872-cc76-4554-8ebf-a14522e95248 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:23.752197 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb2872-cc76-4554-8ebf-a14522e95248 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:23.756812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46292d5b-e4f6-4e0b-9d47-f7f8f166dde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:23.757462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46292d5b-e4f6-4e0b-9d47-f7f8f166dde0 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:23.757751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46292d5b-e4f6-4e0b-9d47-f7f8f166dde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:23.758033 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46292d5b-e4f6-4e0b-9d47-f7f8f166dde0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:23.758774 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46292d5b-e4f6-4e0b-9d47-f7f8f166dde0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:10:23.759089 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46292d5b-e4f6-4e0b-9d47-f7f8f166dde0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:23.760726 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46292d5b-e4f6-4e0b-9d47-f7f8f166dde0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:23.772252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1045/2084] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:10:23.776353 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7909ca6-bba8-4a70-8f96-97d718c20740 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:23.785715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7909ca6-bba8-4a70-8f96-97d718c20740 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:23.790656 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e21aff-b203-45b8-b1c9-53591543764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:23.791327 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e21aff-b203-45b8-b1c9-53591543764d admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:23.791613 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e21aff-b203-45b8-b1c9-53591543764d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:23.791937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e21aff-b203-45b8-b1c9-53591543764d admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:23.792646 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e21aff-b203-45b8-b1c9-53591543764d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:23.794554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e21aff-b203-45b8-b1c9-53591543764d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:23.823267 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1040/2085] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:23 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:23.825142 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46292d5b-e4f6-4e0b-9d47-f7f8f166dde0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:23.836206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46292d5b-e4f6-4e0b-9d47-f7f8f166dde0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:23.895307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af61a1-f54e-4764-aeae-8147bcc26a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:23.896046 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af61a1-f54e-4764-aeae-8147bcc26a27 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:23.896337 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af61a1-f54e-4764-aeae-8147bcc26a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:23.896642 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af61a1-f54e-4764-aeae-8147bcc26a27 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:23.897342 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af61a1-f54e-4764-aeae-8147bcc26a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:23.899276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af61a1-f54e-4764-aeae-8147bcc26a27 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:23.922189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1046/2086] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:23 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:23.926214 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e21aff-b203-45b8-b1c9-53591543764d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:23.937406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e21aff-b203-45b8-b1c9-53591543764d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:23.947451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d6af6-70aa-4ed3-9f45-77ed5543ab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:23.948194 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d6af6-70aa-4ed3-9f45-77ed5543ab81 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:23.948488 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d6af6-70aa-4ed3-9f45-77ed5543ab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:23.948770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d6af6-70aa-4ed3-9f45-77ed5543ab81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:23.949591 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d6af6-70aa-4ed3-9f45-77ed5543ab81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:23.951275 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d6af6-70aa-4ed3-9f45-77ed5543ab81 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:23.964701 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1041/2087] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:10:23.979204 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af61a1-f54e-4764-aeae-8147bcc26a27 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:23.995776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af61a1-f54e-4764-aeae-8147bcc26a27 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:24.011634 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f0f02-46d0-473b-894f-152d132ee84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:24.012360 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f0f02-46d0-473b-894f-152d132ee84b admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:24.012733 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f0f02-46d0-473b-894f-152d132ee84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:24.013021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f0f02-46d0-473b-894f-152d132ee84b admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:24.014567 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f0f02-46d0-473b-894f-152d132ee84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:24.017874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f0f02-46d0-473b-894f-152d132ee84b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:24.039289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1047/2088] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:24.043677 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d6af6-70aa-4ed3-9f45-77ed5543ab81 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:24.054854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d6af6-70aa-4ed3-9f45-77ed5543ab81 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:24.066151 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd26dda-9282-4307-b6cb-75bd0de81846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:24.067278 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd26dda-9282-4307-b6cb-75bd0de81846 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:24.067857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd26dda-9282-4307-b6cb-75bd0de81846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:24.068379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd26dda-9282-4307-b6cb-75bd0de81846 admin admin] PATH_INFO: `/v3/projects/6eaf5369cb0c409b956fd608f07381b7/users/36f307c010ef473e935d1dc2048b9edd/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:24.091408 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd26dda-9282-4307-b6cb-75bd0de81846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eaf5369cb0c409b956fd608f07381b7, user_id=36f307c010ef473e935d1dc2048b9edd, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:24.095323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd26dda-9282-4307-b6cb-75bd0de81846 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:24.110109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1042/2089] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:24 2022] PUT /identity/v3/projects/6eaf5369cb0c409b956fd608f07381b7/users/36f307c010ef473e935d1dc2048b9edd/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:24.120614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76c7f3-2306-4c36-89b2-24cbf3c0ed3d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:24.120940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76c7f3-2306-4c36-89b2-24cbf3c0ed3d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:24.121339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76c7f3-2306-4c36-89b2-24cbf3c0ed3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:24.150549 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4b76c7f3-2306-4c36-89b2-24cbf3c0ed3d None None] MFA Rules not processed for user `36f307c010ef473e935d1dc2048b9edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:24.152480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4b76c7f3-2306-4c36-89b2-24cbf3c0ed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:24.255188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1048/2090] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:24.282900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd26dda-9282-4307-b6cb-75bd0de81846 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:24.284640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-acd26dda-9282-4307-b6cb-75bd0de81846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:24.353749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:24.355559 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd26dda-9282-4307-b6cb-75bd0de81846 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:24.363625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf58fd1-17cd-4ff5-bc78-72c33b765d1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:24.364512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf58fd1-17cd-4ff5-bc78-72c33b765d1a service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:24.364904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf58fd1-17cd-4ff5-bc78-72c33b765d1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:24.365259 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf58fd1-17cd-4ff5-bc78-72c33b765d1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:24.377189 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf58fd1-17cd-4ff5-bc78-72c33b765d1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:24.378796 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf58fd1-17cd-4ff5-bc78-72c33b765d1a service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:24.389950 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1043/2091] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:26.899705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b3994-c6f0-498b-b81e-ba357a5c9bb3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:26.900278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b3994-c6f0-498b-b81e-ba357a5c9bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:26.900367 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b3994-c6f0-498b-b81e-ba357a5c9bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:26.926410 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-575b3994-c6f0-498b-b81e-ba357a5c9bb3 None None] MFA Rules not processed for user `36f307c010ef473e935d1dc2048b9edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:26.927740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-575b3994-c6f0-498b-b81e-ba357a5c9bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:26.936752 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1049/2092] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:28.082280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf58fd1-17cd-4ff5-bc78-72c33b765d1a service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:28.093735 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf58fd1-17cd-4ff5-bc78-72c33b765d1a service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:28.103448 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf843cd-ce1b-48ce-9163-90eda232754c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:28.104685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf843cd-ce1b-48ce-9163-90eda232754c service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:28.104981 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf843cd-ce1b-48ce-9163-90eda232754c service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:28.105264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf843cd-ce1b-48ce-9163-90eda232754c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:28.108201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0bf843cd-ce1b-48ce-9163-90eda232754c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:28.202786 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf843cd-ce1b-48ce-9163-90eda232754c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:28.204255 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf843cd-ce1b-48ce-9163-90eda232754c service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:28.214960 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1044/2093] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:29.709265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b3994-c6f0-498b-b81e-ba357a5c9bb3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:29.710707 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-575b3994-c6f0-498b-b81e-ba357a5c9bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:29.717236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:29.790748 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b3994-c6f0-498b-b81e-ba357a5c9bb3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:29.798461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc845d7-25d5-4a27-981e-12667955fa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:29.799401 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc845d7-25d5-4a27-981e-12667955fa97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:29.800289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc845d7-25d5-4a27-981e-12667955fa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:29.800289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc845d7-25d5-4a27-981e-12667955fa97 admin admin] PATH_INFO: `/v3/users/81d7ce97e4ba4d42b0fa87527442cd3a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:29.801236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc845d7-25d5-4a27-981e-12667955fa97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d7ce97e4ba4d42b0fa87527442cd3a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:29.803178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc845d7-25d5-4a27-981e-12667955fa97 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:29.865017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2bc845d7-25d5-4a27-981e-12667955fa97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d7ce97e4ba4d42b0fa87527442cd3a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:29.865892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2bc845d7-25d5-4a27-981e-12667955fa97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d7ce97e4ba4d42b0fa87527442cd3a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:29.878472 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2bc845d7-25d5-4a27-981e-12667955fa97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d7ce97e4ba4d42b0fa87527442cd3a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:29.888712 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2bc845d7-25d5-4a27-981e-12667955fa97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d7ce97e4ba4d42b0fa87527442cd3a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:29.917389 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2bc845d7-25d5-4a27-981e-12667955fa97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d7ce97e4ba4d42b0fa87527442cd3a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:29.930280 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1050/2094] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:29 2022] DELETE /identity/v3/users/81d7ce97e4ba4d42b0fa87527442cd3a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:29.934409 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab51e7-2704-4ff8-bb0d-b54572211dbc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:29.934907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab51e7-2704-4ff8-bb0d-b54572211dbc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:29.935020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab51e7-2704-4ff8-bb0d-b54572211dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:29.957369 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6dab51e7-2704-4ff8-bb0d-b54572211dbc None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:29.958586 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6dab51e7-2704-4ff8-bb0d-b54572211dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:30.061383 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1045/2095] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:30.073827 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc845d7-25d5-4a27-981e-12667955fa97 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:30.075933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2bc845d7-25d5-4a27-981e-12667955fa97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:30.156464 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc845d7-25d5-4a27-981e-12667955fa97 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:30.161631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1c38a-9c72-49ce-b545-0ceb1075fc0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:30.162494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1c38a-9c72-49ce-b545-0ceb1075fc0d service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:30.162778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1c38a-9c72-49ce-b545-0ceb1075fc0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:30.163391 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1c38a-9c72-49ce-b545-0ceb1075fc0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:30.176907 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1c38a-9c72-49ce-b545-0ceb1075fc0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:30.178566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1c38a-9c72-49ce-b545-0ceb1075fc0d service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:30.193630 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1051/2096] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:10:30.606831 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab51e7-2704-4ff8-bb0d-b54572211dbc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:30.608933 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6dab51e7-2704-4ff8-bb0d-b54572211dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:30.628235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab51e7-2704-4ff8-bb0d-b54572211dbc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:30.646108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:30.647144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:30.647565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:30.647977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1 admin admin] PATH_INFO: `/v3/projects/3c8990e6f1fc48af988617f3ceb3a80a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:30.649263 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8990e6f1fc48af988617f3ceb3a80a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:30.651536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:30.721556 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8990e6f1fc48af988617f3ceb3a80a', 'request_id': 'req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:30.730148 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8990e6f1fc48af988617f3ceb3a80a', 'request_id': 'req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:30.740796 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8990e6f1fc48af988617f3ceb3a80a', 'request_id': 'req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:30.756363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1 admin admin] The token cache is being invalidate because project 3c8990e6f1fc48af988617f3ceb3a80a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:30.757245 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:30.758008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:30.760218 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1046/2097] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:30 2022] DELETE /identity/v3/projects/3c8990e6f1fc48af988617f3ceb3a80a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:30.764198 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1c38a-9c72-49ce-b545-0ceb1075fc0d service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:30.775300 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1c38a-9c72-49ce-b545-0ceb1075fc0d service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:30.798138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:30.843089 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e55da3-a960-4e53-9297-6b685d8d2dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:30.844598 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e55da3-a960-4e53-9297-6b685d8d2dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:30.844950 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e55da3-a960-4e53-9297-6b685d8d2dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:30.845300 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e55da3-a960-4e53-9297-6b685d8d2dda admin admin] PATH_INFO: `/v3/users/c7dcbbe6e58a405981b733bdbd8a98dc` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:30.846650 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e55da3-a960-4e53-9297-6b685d8d2dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7dcbbe6e58a405981b733bdbd8a98dc)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:30.848906 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e55da3-a960-4e53-9297-6b685d8d2dda admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:30.897795 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-36e55da3-a960-4e53-9297-6b685d8d2dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7dcbbe6e58a405981b733bdbd8a98dc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:30.898449 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-36e55da3-a960-4e53-9297-6b685d8d2dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7dcbbe6e58a405981b733bdbd8a98dc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:30.911123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-36e55da3-a960-4e53-9297-6b685d8d2dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7dcbbe6e58a405981b733bdbd8a98dc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:30.919683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-36e55da3-a960-4e53-9297-6b685d8d2dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7dcbbe6e58a405981b733bdbd8a98dc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:30.932071 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-36e55da3-a960-4e53-9297-6b685d8d2dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7dcbbe6e58a405981b733bdbd8a98dc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:30.941302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1052/2098] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:30 2022] DELETE /identity/v3/users/c7dcbbe6e58a405981b733bdbd8a98dc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:31.626525 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:31.628230 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:31.643303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395c71e-6468-4a47-87a6-5ae3ac4fafc1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:31.663491 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:31.725746 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059b6d3-7e7d-4a2e-8946-48cfa2984105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:31.726770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059b6d3-7e7d-4a2e-8946-48cfa2984105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:31.727147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059b6d3-7e7d-4a2e-8946-48cfa2984105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:31.727555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059b6d3-7e7d-4a2e-8946-48cfa2984105 admin admin] PATH_INFO: `/v3/projects/975178dcb0fe4cf5b462938c55b1c073` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:31.728802 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059b6d3-7e7d-4a2e-8946-48cfa2984105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=975178dcb0fe4cf5b462938c55b1c073)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:31.730857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059b6d3-7e7d-4a2e-8946-48cfa2984105 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:31.792386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4059b6d3-7e7d-4a2e-8946-48cfa2984105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '975178dcb0fe4cf5b462938c55b1c073', 'request_id': 'req-4059b6d3-7e7d-4a2e-8946-48cfa2984105'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:31.799167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4059b6d3-7e7d-4a2e-8946-48cfa2984105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '975178dcb0fe4cf5b462938c55b1c073', 'request_id': 'req-4059b6d3-7e7d-4a2e-8946-48cfa2984105'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:31.806818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4059b6d3-7e7d-4a2e-8946-48cfa2984105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '975178dcb0fe4cf5b462938c55b1c073', 'request_id': 'req-4059b6d3-7e7d-4a2e-8946-48cfa2984105'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:31.818851 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4059b6d3-7e7d-4a2e-8946-48cfa2984105 admin admin] The token cache is being invalidate because project 975178dcb0fe4cf5b462938c55b1c073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:31.819150 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4059b6d3-7e7d-4a2e-8946-48cfa2984105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:31.820160 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4059b6d3-7e7d-4a2e-8946-48cfa2984105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:31.822112 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1047/2099] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:31 2022] DELETE /identity/v3/projects/975178dcb0fe4cf5b462938c55b1c073 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:31.827132 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14210ef1-e742-4be7-ab8c-b0418acf3d7c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:31.828106 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14210ef1-e742-4be7-ab8c-b0418acf3d7c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:31.828976 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14210ef1-e742-4be7-ab8c-b0418acf3d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:31.848383 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-14210ef1-e742-4be7-ab8c-b0418acf3d7c None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:31.849818 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-14210ef1-e742-4be7-ab8c-b0418acf3d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:31.911272 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1053/2100] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:31.919487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e6663-ba0c-4b4f-bfe5-f6d1c4f70fcc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:31.920263 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e6663-ba0c-4b4f-bfe5-f6d1c4f70fcc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:31.920568 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e6663-ba0c-4b4f-bfe5-f6d1c4f70fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:31.940429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f29e6663-ba0c-4b4f-bfe5-f6d1c4f70fcc None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:31.942316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f29e6663-ba0c-4b4f-bfe5-f6d1c4f70fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:31.950353 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1048/2101] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:31.954730 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14210ef1-e742-4be7-ab8c-b0418acf3d7c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:31.964568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14210ef1-e742-4be7-ab8c-b0418acf3d7c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:31.973061 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96a4ca-68f5-4238-b2c9-a69e8c992e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:31.973748 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96a4ca-68f5-4238-b2c9-a69e8c992e74 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:31.974038 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96a4ca-68f5-4238-b2c9-a69e8c992e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:31.974321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96a4ca-68f5-4238-b2c9-a69e8c992e74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:31.975075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96a4ca-68f5-4238-b2c9-a69e8c992e74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:10:31.975384 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96a4ca-68f5-4238-b2c9-a69e8c992e74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:31.977097 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96a4ca-68f5-4238-b2c9-a69e8c992e74 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:31.990112 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1054/2102] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:10:31.994300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e6663-ba0c-4b4f-bfe5-f6d1c4f70fcc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:32.004238 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e6663-ba0c-4b4f-bfe5-f6d1c4f70fcc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:32.009637 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9678483-3185-4b29-ac7c-4599cd458a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:32.010304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678483-3185-4b29-ac7c-4599cd458a5d admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:32.010591 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678483-3185-4b29-ac7c-4599cd458a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:32.010868 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678483-3185-4b29-ac7c-4599cd458a5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:32.011569 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9678483-3185-4b29-ac7c-4599cd458a5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:32.013817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9678483-3185-4b29-ac7c-4599cd458a5d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:32.044081 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1049/2103] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:31 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:32.045972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96a4ca-68f5-4238-b2c9-a69e8c992e74 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:32.057284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96a4ca-68f5-4238-b2c9-a69e8c992e74 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:32.090376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:32.125791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644d823-6919-425e-8349-a428b1a7d927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:32.126931 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644d823-6919-425e-8349-a428b1a7d927 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:32.127405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644d823-6919-425e-8349-a428b1a7d927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:32.128071 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644d823-6919-425e-8349-a428b1a7d927 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:32.129395 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644d823-6919-425e-8349-a428b1a7d927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:32.132053 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644d823-6919-425e-8349-a428b1a7d927 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:32.153667 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1055/2104] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:32 2022] POST /identity/v3/users => generated 301 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:10:32.158226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9678483-3185-4b29-ac7c-4599cd458a5d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:32.170569 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9678483-3185-4b29-ac7c-4599cd458a5d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:32.175328 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f743b4-202a-4798-b173-bac5dc4e9b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:32.176117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f743b4-202a-4798-b173-bac5dc4e9b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:32.176476 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f743b4-202a-4798-b173-bac5dc4e9b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:32.176827 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f743b4-202a-4798-b173-bac5dc4e9b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:32.177652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f743b4-202a-4798-b173-bac5dc4e9b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:32.179334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f743b4-202a-4798-b173-bac5dc4e9b66 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:32.190953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1050/2105] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:32.195237 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644d823-6919-425e-8349-a428b1a7d927 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:32.207562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644d823-6919-425e-8349-a428b1a7d927 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:32.215192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69685682-1c63-4f0c-b780-cb486bddf891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:32.215970 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69685682-1c63-4f0c-b780-cb486bddf891 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:32.216336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69685682-1c63-4f0c-b780-cb486bddf891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:32.217160 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69685682-1c63-4f0c-b780-cb486bddf891 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:32.217934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69685682-1c63-4f0c-b780-cb486bddf891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:32.219729 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69685682-1c63-4f0c-b780-cb486bddf891 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:32.231425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1056/2106] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:32.235532 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f743b4-202a-4798-b173-bac5dc4e9b66 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:32.245722 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f743b4-202a-4798-b173-bac5dc4e9b66 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:32.250352 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a183d6-93b7-4d65-844f-c0961c56b575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:32.251260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a183d6-93b7-4d65-844f-c0961c56b575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:32.251546 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a183d6-93b7-4d65-844f-c0961c56b575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:32.251826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a183d6-93b7-4d65-844f-c0961c56b575 admin admin] PATH_INFO: `/v3/projects/d8594e7897224d749d4bbca95b1474f4/users/a4eb36a9d7d44022b7156c75f8496a5f/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:32.266942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a183d6-93b7-4d65-844f-c0961c56b575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8594e7897224d749d4bbca95b1474f4, user_id=a4eb36a9d7d44022b7156c75f8496a5f, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:32.269833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a183d6-93b7-4d65-844f-c0961c56b575 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:32.286101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1051/2107] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:32 2022] PUT /identity/v3/projects/d8594e7897224d749d4bbca95b1474f4/users/a4eb36a9d7d44022b7156c75f8496a5f/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:32.295748 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2db23-6c8a-4a12-b3ff-246e713023d9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:32.296191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2db23-6c8a-4a12-b3ff-246e713023d9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:32.296479 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2db23-6c8a-4a12-b3ff-246e713023d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:32.323963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a6d2db23-6c8a-4a12-b3ff-246e713023d9 None None] MFA Rules not processed for user `a4eb36a9d7d44022b7156c75f8496a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:32.325161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a6d2db23-6c8a-4a12-b3ff-246e713023d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:32.394851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1057/2108] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:32.399428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a183d6-93b7-4d65-844f-c0961c56b575 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:32.438047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:32.461641 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a183d6-93b7-4d65-844f-c0961c56b575 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:32.466390 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e179d-47ab-4fc8-a690-eeedcf226a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:32.467533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e179d-47ab-4fc8-a690-eeedcf226a24 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:32.467821 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e179d-47ab-4fc8-a690-eeedcf226a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:32.468128 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e179d-47ab-4fc8-a690-eeedcf226a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:32.468854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e179d-47ab-4fc8-a690-eeedcf226a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:32.470744 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e179d-47ab-4fc8-a690-eeedcf226a24 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:32.500407 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1052/2109] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:32 2022] POST /identity/v3/projects => generated 399 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:32.501819 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2db23-6c8a-4a12-b3ff-246e713023d9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:32.512812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2db23-6c8a-4a12-b3ff-246e713023d9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:32.581774 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602ad15-da38-44ff-b992-1c773c4a7804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:32.582460 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602ad15-da38-44ff-b992-1c773c4a7804 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:32.582748 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602ad15-da38-44ff-b992-1c773c4a7804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:32.583141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602ad15-da38-44ff-b992-1c773c4a7804 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:32.583840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602ad15-da38-44ff-b992-1c773c4a7804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:32.585699 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602ad15-da38-44ff-b992-1c773c4a7804 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:32.611502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1058/2110] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:32 2022] POST /identity/v3/users => generated 306 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:32.615486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e179d-47ab-4fc8-a690-eeedcf226a24 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:32.627425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e179d-47ab-4fc8-a690-eeedcf226a24 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:32.632513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7d71c-4ea4-40b2-82ed-816618da7d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:32.633067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7d71c-4ea4-40b2-82ed-816618da7d98 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:32.633575 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7d71c-4ea4-40b2-82ed-816618da7d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:32.633861 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7d71c-4ea4-40b2-82ed-816618da7d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:32.634646 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7d71c-4ea4-40b2-82ed-816618da7d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:32.636612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7d71c-4ea4-40b2-82ed-816618da7d98 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:32.649288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1053/2111] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:10:32.653103 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602ad15-da38-44ff-b992-1c773c4a7804 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:32.663886 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602ad15-da38-44ff-b992-1c773c4a7804 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:32.671413 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9639fe-5e53-4dd6-89f9-f04d62c2de4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:32.672067 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9639fe-5e53-4dd6-89f9-f04d62c2de4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:32.672514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9639fe-5e53-4dd6-89f9-f04d62c2de4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:32.672808 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9639fe-5e53-4dd6-89f9-f04d62c2de4a admin admin] PATH_INFO: `/v3/projects/9b3ce3faac6c46369e79e66b35976e93/users/4b0d7a91e1ad428dbb3199035739d59f/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:32.697322 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9639fe-5e53-4dd6-89f9-f04d62c2de4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3ce3faac6c46369e79e66b35976e93, user_id=4b0d7a91e1ad428dbb3199035739d59f, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:32.700848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9639fe-5e53-4dd6-89f9-f04d62c2de4a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:32.722669 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1059/2112] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:32 2022] PUT /identity/v3/projects/9b3ce3faac6c46369e79e66b35976e93/users/4b0d7a91e1ad428dbb3199035739d59f/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:32.729772 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7d71c-4ea4-40b2-82ed-816618da7d98 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:32.740572 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7d71c-4ea4-40b2-82ed-816618da7d98 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:32.845333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518706e2-687a-4cf0-a8a4-5f3eda8a2aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:32.855826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518706e2-687a-4cf0-a8a4-5f3eda8a2aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:32.856147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518706e2-687a-4cf0-a8a4-5f3eda8a2aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:32.856431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518706e2-687a-4cf0-a8a4-5f3eda8a2aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:32.857235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518706e2-687a-4cf0-a8a4-5f3eda8a2aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:32.864194 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518706e2-687a-4cf0-a8a4-5f3eda8a2aa6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:32.881615 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1054/2113] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:32.881862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9639fe-5e53-4dd6-89f9-f04d62c2de4a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:32.889777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:32.894396 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9639fe-5e53-4dd6-89f9-f04d62c2de4a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:32.900802 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb151bf-63f9-4af6-9976-1f18f039d5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:32.901729 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb151bf-63f9-4af6-9976-1f18f039d5d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:32.902195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb151bf-63f9-4af6-9976-1f18f039d5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:32.902707 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb151bf-63f9-4af6-9976-1f18f039d5d8 admin admin] PATH_INFO: `/v3/projects/9b3ce3faac6c46369e79e66b35976e93/users/4b0d7a91e1ad428dbb3199035739d59f/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:32.905080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb151bf-63f9-4af6-9976-1f18f039d5d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3ce3faac6c46369e79e66b35976e93, user_id=4b0d7a91e1ad428dbb3199035739d59f, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:32.908403 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb151bf-63f9-4af6-9976-1f18f039d5d8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:32.921027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1060/2114] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:32 2022] PUT /identity/v3/projects/9b3ce3faac6c46369e79e66b35976e93/users/4b0d7a91e1ad428dbb3199035739d59f/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:32.931095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30c11d-f2db-4195-a4c5-9196b6e4e5e3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:32.931387 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30c11d-f2db-4195-a4c5-9196b6e4e5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:32.931667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30c11d-f2db-4195-a4c5-9196b6e4e5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:32.965112 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5b30c11d-f2db-4195-a4c5-9196b6e4e5e3 None None] MFA Rules not processed for user `4b0d7a91e1ad428dbb3199035739d59f`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:32.966332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5b30c11d-f2db-4195-a4c5-9196b6e4e5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:33.040251 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1055/2115] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:32 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:33.051089 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb151bf-63f9-4af6-9976-1f18f039d5d8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:33.052892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-efb151bf-63f9-4af6-9976-1f18f039d5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:33.110523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb151bf-63f9-4af6-9976-1f18f039d5d8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:33.115315 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d23c2-ff4e-48e1-8417-4e37f3a9147e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:33.116338 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d23c2-ff4e-48e1-8417-4e37f3a9147e service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:33.116338 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d23c2-ff4e-48e1-8417-4e37f3a9147e service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:33.116581 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d23c2-ff4e-48e1-8417-4e37f3a9147e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:33.128320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d23c2-ff4e-48e1-8417-4e37f3a9147e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:33.130164 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d23c2-ff4e-48e1-8417-4e37f3a9147e service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:33.142880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1061/2116] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:33 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:33.220339 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30c11d-f2db-4195-a4c5-9196b6e4e5e3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:33.221787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5b30c11d-f2db-4195-a4c5-9196b6e4e5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:33.233838 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30c11d-f2db-4195-a4c5-9196b6e4e5e3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:33.237673 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1673342-901d-490b-9cdc-9ad8a46ba7ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:33.238410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1673342-901d-490b-9cdc-9ad8a46ba7ce service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:33.238768 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1673342-901d-490b-9cdc-9ad8a46ba7ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:33.239240 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1673342-901d-490b-9cdc-9ad8a46ba7ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:33.269704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:33.297986 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1673342-901d-490b-9cdc-9ad8a46ba7ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:33.299412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1673342-901d-490b-9cdc-9ad8a46ba7ce service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:33.308279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1056/2117] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:33.359962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d23c2-ff4e-48e1-8417-4e37f3a9147e service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:33.361375 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ad4d23c2-ff4e-48e1-8417-4e37f3a9147e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:33.432920 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d23c2-ff4e-48e1-8417-4e37f3a9147e service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:33.439466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dff65-9a25-4405-a348-e6291343e8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:33.440385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dff65-9a25-4405-a348-e6291343e8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:33.440676 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dff65-9a25-4405-a348-e6291343e8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:33.440958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dff65-9a25-4405-a348-e6291343e8de admin admin] PATH_INFO: `/v3/users/a7ffd76190ba4329b9cb06065e5da3b6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:33.442162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dff65-9a25-4405-a348-e6291343e8de admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ffd76190ba4329b9cb06065e5da3b6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:33.444135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dff65-9a25-4405-a348-e6291343e8de admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:33.495044 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f74dff65-9a25-4405-a348-e6291343e8de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ffd76190ba4329b9cb06065e5da3b6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:33.495841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f74dff65-9a25-4405-a348-e6291343e8de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ffd76190ba4329b9cb06065e5da3b6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:33.504776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f74dff65-9a25-4405-a348-e6291343e8de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ffd76190ba4329b9cb06065e5da3b6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:33.512396 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f74dff65-9a25-4405-a348-e6291343e8de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ffd76190ba4329b9cb06065e5da3b6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:33.526327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f74dff65-9a25-4405-a348-e6291343e8de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ffd76190ba4329b9cb06065e5da3b6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:33.532901 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1062/2118] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:33 2022] DELETE /identity/v3/users/a7ffd76190ba4329b9cb06065e5da3b6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:33.538033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a59096-ff52-4102-9c17-04c7dcd709bf None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:33.538469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a59096-ff52-4102-9c17-04c7dcd709bf None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:33.538826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a59096-ff52-4102-9c17-04c7dcd709bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:33.563431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-90a59096-ff52-4102-9c17-04c7dcd709bf None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:33.565172 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-90a59096-ff52-4102-9c17-04c7dcd709bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:33.634632 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1057/2119] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:33.644983 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dff65-9a25-4405-a348-e6291343e8de admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:33.646485 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f74dff65-9a25-4405-a348-e6291343e8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:33.660928 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:33.707132 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dff65-9a25-4405-a348-e6291343e8de admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:33.710781 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9199627-f6bb-49e5-9694-1988cd4f12b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:33.711368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9199627-f6bb-49e5-9694-1988cd4f12b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:33.711652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9199627-f6bb-49e5-9694-1988cd4f12b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:33.711982 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9199627-f6bb-49e5-9694-1988cd4f12b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:33.720814 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9199627-f6bb-49e5-9694-1988cd4f12b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:33.722233 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9199627-f6bb-49e5-9694-1988cd4f12b7 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:33.731863 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1063/2120] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:34.096719 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a59096-ff52-4102-9c17-04c7dcd709bf None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:34.098216 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-90a59096-ff52-4102-9c17-04c7dcd709bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:34.113696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a59096-ff52-4102-9c17-04c7dcd709bf None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:34.118624 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:34.119505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:34.119787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:34.120102 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a admin admin] PATH_INFO: `/v3/projects/3f12f6243ce94c01968f196d3a83d60b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:34.121303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f12f6243ce94c01968f196d3a83d60b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:34.123262 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:34.177107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f12f6243ce94c01968f196d3a83d60b', 'request_id': 'req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:34.182662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f12f6243ce94c01968f196d3a83d60b', 'request_id': 'req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:34.190469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f12f6243ce94c01968f196d3a83d60b', 'request_id': 'req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:34.202895 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a admin admin] The token cache is being invalidate because project 3f12f6243ce94c01968f196d3a83d60b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:34.203240 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:34.203816 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:34.205662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1058/2121] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:34 2022] DELETE /identity/v3/projects/3f12f6243ce94c01968f196d3a83d60b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:34.209755 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9199627-f6bb-49e5-9694-1988cd4f12b7 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:34.221014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9199627-f6bb-49e5-9694-1988cd4f12b7 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:34.290934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6a887-a5ea-47a1-a6cd-faa2772ccd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:34.292082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6a887-a5ea-47a1-a6cd-faa2772ccd33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:34.292515 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6a887-a5ea-47a1-a6cd-faa2772ccd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:34.293147 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6a887-a5ea-47a1-a6cd-faa2772ccd33 admin admin] PATH_INFO: `/v3/users/4628ec66aa8941d79ab419b87e5696d7` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:34.294378 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6a887-a5ea-47a1-a6cd-faa2772ccd33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4628ec66aa8941d79ab419b87e5696d7)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:34.301982 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6a887-a5ea-47a1-a6cd-faa2772ccd33 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:34.355020 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b7d6a887-a5ea-47a1-a6cd-faa2772ccd33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4628ec66aa8941d79ab419b87e5696d7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:34.355675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b7d6a887-a5ea-47a1-a6cd-faa2772ccd33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4628ec66aa8941d79ab419b87e5696d7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:34.364014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b7d6a887-a5ea-47a1-a6cd-faa2772ccd33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4628ec66aa8941d79ab419b87e5696d7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:34.372082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b7d6a887-a5ea-47a1-a6cd-faa2772ccd33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4628ec66aa8941d79ab419b87e5696d7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:34.395045 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b7d6a887-a5ea-47a1-a6cd-faa2772ccd33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4628ec66aa8941d79ab419b87e5696d7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:34.401339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1064/2122] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:34 2022] DELETE /identity/v3/users/4628ec66aa8941d79ab419b87e5696d7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:34.685888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:34.690070 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:34.727176 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868bdfd-649a-4f08-8e2f-4dc0e3891f5a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:34.804709 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:34.822024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbde8bf-5755-44f6-b7cd-9b565746b827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:34.824626 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde8bf-5755-44f6-b7cd-9b565746b827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:34.825200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde8bf-5755-44f6-b7cd-9b565746b827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:34.825796 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde8bf-5755-44f6-b7cd-9b565746b827 admin admin] PATH_INFO: `/v3/projects/a94c0057ebc7487191f6cecad56c2d8e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:34.827744 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbde8bf-5755-44f6-b7cd-9b565746b827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a94c0057ebc7487191f6cecad56c2d8e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:34.830283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbde8bf-5755-44f6-b7cd-9b565746b827 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:34.929636 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-abbde8bf-5755-44f6-b7cd-9b565746b827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94c0057ebc7487191f6cecad56c2d8e', 'request_id': 'req-abbde8bf-5755-44f6-b7cd-9b565746b827'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:34.948983 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-abbde8bf-5755-44f6-b7cd-9b565746b827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94c0057ebc7487191f6cecad56c2d8e', 'request_id': 'req-abbde8bf-5755-44f6-b7cd-9b565746b827'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:34.990980 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-abbde8bf-5755-44f6-b7cd-9b565746b827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94c0057ebc7487191f6cecad56c2d8e', 'request_id': 'req-abbde8bf-5755-44f6-b7cd-9b565746b827'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:35.045960 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-abbde8bf-5755-44f6-b7cd-9b565746b827 admin admin] The token cache is being invalidate because project a94c0057ebc7487191f6cecad56c2d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:35.046248 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-abbde8bf-5755-44f6-b7cd-9b565746b827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:35.046951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-abbde8bf-5755-44f6-b7cd-9b565746b827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:35.049054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1059/2123] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:34 2022] DELETE /identity/v3/projects/a94c0057ebc7487191f6cecad56c2d8e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:35.056034 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be889d7-981c-4ac3-a655-58f5614e4f45 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:35.056334 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be889d7-981c-4ac3-a655-58f5614e4f45 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:35.056638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be889d7-981c-4ac3-a655-58f5614e4f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:35.086811 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2be889d7-981c-4ac3-a655-58f5614e4f45 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:35.088219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2be889d7-981c-4ac3-a655-58f5614e4f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:35.125454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:35.186900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1065/2124] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:35.196453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a03e1-9a2e-4a84-9f26-7d1ad1bacb64 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:35.197180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a03e1-9a2e-4a84-9f26-7d1ad1bacb64 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:35.199119 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a03e1-9a2e-4a84-9f26-7d1ad1bacb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:35.221102 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d71a03e1-9a2e-4a84-9f26-7d1ad1bacb64 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:35.223480 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d71a03e1-9a2e-4a84-9f26-7d1ad1bacb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:35.239584 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1060/2125] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:35.244565 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be889d7-981c-4ac3-a655-58f5614e4f45 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:35.258284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be889d7-981c-4ac3-a655-58f5614e4f45 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:35.263107 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288b2a5-0132-4aac-a05b-50b21faed996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:35.263827 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288b2a5-0132-4aac-a05b-50b21faed996 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:35.264159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288b2a5-0132-4aac-a05b-50b21faed996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:35.264440 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288b2a5-0132-4aac-a05b-50b21faed996 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:35.265174 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288b2a5-0132-4aac-a05b-50b21faed996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:10:35.265503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288b2a5-0132-4aac-a05b-50b21faed996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:35.267420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288b2a5-0132-4aac-a05b-50b21faed996 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:35.282541 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1066/2126] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:10:35.286700 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a03e1-9a2e-4a84-9f26-7d1ad1bacb64 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:35.300161 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a03e1-9a2e-4a84-9f26-7d1ad1bacb64 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:35.307199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577a8b6-19a8-45bc-8394-1965fb978922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:35.308132 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577a8b6-19a8-45bc-8394-1965fb978922 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:35.308242 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577a8b6-19a8-45bc-8394-1965fb978922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:35.308629 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577a8b6-19a8-45bc-8394-1965fb978922 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:35.309484 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577a8b6-19a8-45bc-8394-1965fb978922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:35.312238 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577a8b6-19a8-45bc-8394-1965fb978922 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:35.359813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1061/2127] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:35 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:35.363769 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288b2a5-0132-4aac-a05b-50b21faed996 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:35.382920 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288b2a5-0132-4aac-a05b-50b21faed996 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:35.449261 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416d7db-654e-481e-9159-ebbc994117cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:35.449939 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416d7db-654e-481e-9159-ebbc994117cb admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:35.450228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416d7db-654e-481e-9159-ebbc994117cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:35.450506 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416d7db-654e-481e-9159-ebbc994117cb admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:35.451251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416d7db-654e-481e-9159-ebbc994117cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:35.453211 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416d7db-654e-481e-9159-ebbc994117cb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:35.476010 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1067/2128] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:35 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:10:35.477171 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577a8b6-19a8-45bc-8394-1965fb978922 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:35.488133 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577a8b6-19a8-45bc-8394-1965fb978922 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:35.497122 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2472b-2add-4e81-862f-7e916c082457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:35.498486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2472b-2add-4e81-862f-7e916c082457 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:35.498845 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2472b-2add-4e81-862f-7e916c082457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:35.499195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2472b-2add-4e81-862f-7e916c082457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:35.500060 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2472b-2add-4e81-862f-7e916c082457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:35.501769 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2472b-2add-4e81-862f-7e916c082457 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:35.515717 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1062/2129] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:35.517813 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416d7db-654e-481e-9159-ebbc994117cb admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:35.528755 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416d7db-654e-481e-9159-ebbc994117cb admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:35.533662 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d8e18-14d9-49d7-b3e5-028c624ada9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:35.534348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8e18-14d9-49d7-b3e5-028c624ada9a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:35.534637 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8e18-14d9-49d7-b3e5-028c624ada9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:35.534922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8e18-14d9-49d7-b3e5-028c624ada9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:35.535673 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d8e18-14d9-49d7-b3e5-028c624ada9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:35.537560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d8e18-14d9-49d7-b3e5-028c624ada9a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:35.549621 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1068/2130] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:35.554106 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2472b-2add-4e81-862f-7e916c082457 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:35.565550 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2472b-2add-4e81-862f-7e916c082457 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:35.570532 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d595e-cd4f-4f09-9532-eb8a4369e9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:35.571591 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d595e-cd4f-4f09-9532-eb8a4369e9fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:35.571877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d595e-cd4f-4f09-9532-eb8a4369e9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:35.572205 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d595e-cd4f-4f09-9532-eb8a4369e9fc admin admin] PATH_INFO: `/v3/projects/b8ec39451801415bb6b5560d2795b301/users/ee031b3dbfd4484abf46c42fe4a32698/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:35.590224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d595e-cd4f-4f09-9532-eb8a4369e9fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ec39451801415bb6b5560d2795b301, user_id=ee031b3dbfd4484abf46c42fe4a32698, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:35.593864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d595e-cd4f-4f09-9532-eb8a4369e9fc admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:35.611304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1063/2131] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:35 2022] PUT /identity/v3/projects/b8ec39451801415bb6b5560d2795b301/users/ee031b3dbfd4484abf46c42fe4a32698/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:35.623928 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1982c4-0ecf-458d-a627-ed4ad3de9c0d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:35.624330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1982c4-0ecf-458d-a627-ed4ad3de9c0d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:35.627745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1982c4-0ecf-458d-a627-ed4ad3de9c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:35.653608 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7c1982c4-0ecf-458d-a627-ed4ad3de9c0d None None] MFA Rules not processed for user `ee031b3dbfd4484abf46c42fe4a32698`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:35.655501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7c1982c4-0ecf-458d-a627-ed4ad3de9c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:35.730684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1069/2132] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:35.742994 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d595e-cd4f-4f09-9532-eb8a4369e9fc admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:35.744783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cd7d595e-cd4f-4f09-9532-eb8a4369e9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:35.811481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d595e-cd4f-4f09-9532-eb8a4369e9fc admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:35.816280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db783166-0be1-4c13-afdb-c77758214472 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:35.817009 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db783166-0be1-4c13-afdb-c77758214472 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:35.817372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db783166-0be1-4c13-afdb-c77758214472 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:35.817730 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db783166-0be1-4c13-afdb-c77758214472 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:35.827513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db783166-0be1-4c13-afdb-c77758214472 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:35.829274 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db783166-0be1-4c13-afdb-c77758214472 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:35.839352 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1064/2133] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:35.932329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1982c4-0ecf-458d-a627-ed4ad3de9c0d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:35.933866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7c1982c4-0ecf-458d-a627-ed4ad3de9c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:35.971949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:36.016723 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1982c4-0ecf-458d-a627-ed4ad3de9c0d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:36.021629 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0223e7-a549-48e4-b150-b5a69ed9f812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:36.022781 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0223e7-a549-48e4-b150-b5a69ed9f812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:36.023215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0223e7-a549-48e4-b150-b5a69ed9f812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:36.023508 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0223e7-a549-48e4-b150-b5a69ed9f812 admin admin] PATH_INFO: `/v3/users/c515e9590b744362bf15c8f23020c9a9` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:36.024825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0223e7-a549-48e4-b150-b5a69ed9f812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c515e9590b744362bf15c8f23020c9a9)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:36.027070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0223e7-a549-48e4-b150-b5a69ed9f812 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:36.080234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2e0223e7-a549-48e4-b150-b5a69ed9f812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c515e9590b744362bf15c8f23020c9a9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:36.081387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2e0223e7-a549-48e4-b150-b5a69ed9f812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c515e9590b744362bf15c8f23020c9a9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:36.101386 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2e0223e7-a549-48e4-b150-b5a69ed9f812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c515e9590b744362bf15c8f23020c9a9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:36.115504 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2e0223e7-a549-48e4-b150-b5a69ed9f812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c515e9590b744362bf15c8f23020c9a9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:36.130402 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2e0223e7-a549-48e4-b150-b5a69ed9f812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c515e9590b744362bf15c8f23020c9a9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:36.146754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1070/2134] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:35 2022] DELETE /identity/v3/users/c515e9590b744362bf15c8f23020c9a9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:36.356626 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db783166-0be1-4c13-afdb-c77758214472 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:36.377742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db783166-0be1-4c13-afdb-c77758214472 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:36.422801 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:36.481036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b36d15-8036-453e-ad76-a0fc50b47b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:36.481909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b36d15-8036-453e-ad76-a0fc50b47b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:36.482229 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b36d15-8036-453e-ad76-a0fc50b47b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:36.482513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b36d15-8036-453e-ad76-a0fc50b47b3d admin admin] PATH_INFO: `/v3/projects/1513d130f2ab450db8a12bd76757313c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:36.483762 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b36d15-8036-453e-ad76-a0fc50b47b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1513d130f2ab450db8a12bd76757313c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:36.485701 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b36d15-8036-453e-ad76-a0fc50b47b3d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:36.537815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-45b36d15-8036-453e-ad76-a0fc50b47b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1513d130f2ab450db8a12bd76757313c', 'request_id': 'req-45b36d15-8036-453e-ad76-a0fc50b47b3d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:36.545419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-45b36d15-8036-453e-ad76-a0fc50b47b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1513d130f2ab450db8a12bd76757313c', 'request_id': 'req-45b36d15-8036-453e-ad76-a0fc50b47b3d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:36.553909 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-45b36d15-8036-453e-ad76-a0fc50b47b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1513d130f2ab450db8a12bd76757313c', 'request_id': 'req-45b36d15-8036-453e-ad76-a0fc50b47b3d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:36.565806 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-45b36d15-8036-453e-ad76-a0fc50b47b3d admin admin] The token cache is being invalidate because project 1513d130f2ab450db8a12bd76757313c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:36.566099 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-45b36d15-8036-453e-ad76-a0fc50b47b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:36.566739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-45b36d15-8036-453e-ad76-a0fc50b47b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:36.568374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1065/2135] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:36 2022] DELETE /identity/v3/projects/1513d130f2ab450db8a12bd76757313c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:36.572427 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0223e7-a549-48e4-b150-b5a69ed9f812 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:36.573793 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2e0223e7-a549-48e4-b150-b5a69ed9f812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:36.587468 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0223e7-a549-48e4-b150-b5a69ed9f812 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:36.654079 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859f66a-fc55-4665-8735-d3c014c74c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:36.655051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859f66a-fc55-4665-8735-d3c014c74c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:36.655338 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859f66a-fc55-4665-8735-d3c014c74c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:36.655615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859f66a-fc55-4665-8735-d3c014c74c9b admin admin] PATH_INFO: `/v3/users/8c9650fb01b14a35bf4397e74cb3a23c` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:36.656916 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859f66a-fc55-4665-8735-d3c014c74c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c9650fb01b14a35bf4397e74cb3a23c)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:36.658909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859f66a-fc55-4665-8735-d3c014c74c9b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:36.717604 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f859f66a-fc55-4665-8735-d3c014c74c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c9650fb01b14a35bf4397e74cb3a23c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:36.718269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f859f66a-fc55-4665-8735-d3c014c74c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c9650fb01b14a35bf4397e74cb3a23c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:36.721998 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:36.725685 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f859f66a-fc55-4665-8735-d3c014c74c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c9650fb01b14a35bf4397e74cb3a23c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:36.735227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f859f66a-fc55-4665-8735-d3c014c74c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c9650fb01b14a35bf4397e74cb3a23c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:36.747058 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f859f66a-fc55-4665-8735-d3c014c74c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c9650fb01b14a35bf4397e74cb3a23c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:36.754834 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1071/2136] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:36 2022] DELETE /identity/v3/users/8c9650fb01b14a35bf4397e74cb3a23c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:36.927249 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b36d15-8036-453e-ad76-a0fc50b47b3d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:36.928750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-45b36d15-8036-453e-ad76-a0fc50b47b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:36.943692 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b36d15-8036-453e-ad76-a0fc50b47b3d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:37.009847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402b354-74b7-4405-9445-4fe2eef74f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:37.010711 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402b354-74b7-4405-9445-4fe2eef74f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:37.010999 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402b354-74b7-4405-9445-4fe2eef74f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:37.011280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402b354-74b7-4405-9445-4fe2eef74f4f admin admin] PATH_INFO: `/v3/projects/ce7060828e0245caa7fc33a9c7a3d22f` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:37.012494 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402b354-74b7-4405-9445-4fe2eef74f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce7060828e0245caa7fc33a9c7a3d22f)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:37.014468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402b354-74b7-4405-9445-4fe2eef74f4f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:37.063220 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a402b354-74b7-4405-9445-4fe2eef74f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7060828e0245caa7fc33a9c7a3d22f', 'request_id': 'req-a402b354-74b7-4405-9445-4fe2eef74f4f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:37.067004 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:37.069487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a402b354-74b7-4405-9445-4fe2eef74f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7060828e0245caa7fc33a9c7a3d22f', 'request_id': 'req-a402b354-74b7-4405-9445-4fe2eef74f4f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:37.077832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a402b354-74b7-4405-9445-4fe2eef74f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7060828e0245caa7fc33a9c7a3d22f', 'request_id': 'req-a402b354-74b7-4405-9445-4fe2eef74f4f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:37.089059 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a402b354-74b7-4405-9445-4fe2eef74f4f admin admin] The token cache is being invalidate because project ce7060828e0245caa7fc33a9c7a3d22f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:37.089345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a402b354-74b7-4405-9445-4fe2eef74f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:37.089964 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a402b354-74b7-4405-9445-4fe2eef74f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:37.092051 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1066/2137] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:36 2022] DELETE /identity/v3/projects/ce7060828e0245caa7fc33a9c7a3d22f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:37.096993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd1643-1376-4760-a720-292d3f997c26 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:37.097293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd1643-1376-4760-a720-292d3f997c26 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:37.097577 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd1643-1376-4760-a720-292d3f997c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:37.116181 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-85bd1643-1376-4760-a720-292d3f997c26 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:37.117325 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-85bd1643-1376-4760-a720-292d3f997c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:37.181972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1072/2138] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:37.190077 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79aca75-0f5e-4657-ad97-c4e919c31fc4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:37.190380 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79aca75-0f5e-4657-ad97-c4e919c31fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:37.190651 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79aca75-0f5e-4657-ad97-c4e919c31fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:37.211389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f79aca75-0f5e-4657-ad97-c4e919c31fc4 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:37.212714 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f79aca75-0f5e-4657-ad97-c4e919c31fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:37.222546 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1067/2139] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:37.226823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd1643-1376-4760-a720-292d3f997c26 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:37.240265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd1643-1376-4760-a720-292d3f997c26 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:37.248219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03940156-da2c-4489-8ddc-8931986272f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:37.249109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03940156-da2c-4489-8ddc-8931986272f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:37.249362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03940156-da2c-4489-8ddc-8931986272f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:37.249644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03940156-da2c-4489-8ddc-8931986272f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:37.250382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03940156-da2c-4489-8ddc-8931986272f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:10:37.250691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03940156-da2c-4489-8ddc-8931986272f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:37.252338 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03940156-da2c-4489-8ddc-8931986272f6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:37.268610 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1073/2140] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:10:37.269848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79aca75-0f5e-4657-ad97-c4e919c31fc4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:37.283868 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79aca75-0f5e-4657-ad97-c4e919c31fc4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:37.290255 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a463f-9254-40d2-afe0-fb7bcf2a1e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:37.290924 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a463f-9254-40d2-afe0-fb7bcf2a1e13 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:37.291206 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a463f-9254-40d2-afe0-fb7bcf2a1e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:37.291487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a463f-9254-40d2-afe0-fb7bcf2a1e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:37.292215 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a463f-9254-40d2-afe0-fb7bcf2a1e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:37.294144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a463f-9254-40d2-afe0-fb7bcf2a1e13 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:37.332545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1068/2141] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:37 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:37.336775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03940156-da2c-4489-8ddc-8931986272f6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:37.349547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03940156-da2c-4489-8ddc-8931986272f6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:37.461253 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9deb64-6b4e-4ff6-bdb4-92b40e9ad587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:37.462250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9deb64-6b4e-4ff6-bdb4-92b40e9ad587 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:37.462580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9deb64-6b4e-4ff6-bdb4-92b40e9ad587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:37.462973 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9deb64-6b4e-4ff6-bdb4-92b40e9ad587 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:37.463782 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9deb64-6b4e-4ff6-bdb4-92b40e9ad587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:37.474745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9deb64-6b4e-4ff6-bdb4-92b40e9ad587 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:37.543325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a463f-9254-40d2-afe0-fb7bcf2a1e13 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:37.543711 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1074/2142] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:37 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:37.564945 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a463f-9254-40d2-afe0-fb7bcf2a1e13 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:37.576536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5a274-3690-4dee-9c67-7fa57dc9de9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:37.577382 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5a274-3690-4dee-9c67-7fa57dc9de9c admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:37.577668 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5a274-3690-4dee-9c67-7fa57dc9de9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:37.577940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5a274-3690-4dee-9c67-7fa57dc9de9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:37.579410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5a274-3690-4dee-9c67-7fa57dc9de9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:37.581055 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5a274-3690-4dee-9c67-7fa57dc9de9c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:37.595590 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1069/2143] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:37.600056 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9deb64-6b4e-4ff6-bdb4-92b40e9ad587 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:37.614856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9deb64-6b4e-4ff6-bdb4-92b40e9ad587 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:37.622727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5625d6-351d-417c-9154-37e297868759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:37.623595 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5625d6-351d-417c-9154-37e297868759 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:37.624044 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5625d6-351d-417c-9154-37e297868759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:37.624471 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5625d6-351d-417c-9154-37e297868759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:37.625376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5625d6-351d-417c-9154-37e297868759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:37.627241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5625d6-351d-417c-9154-37e297868759 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:37.643984 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1075/2144] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:37.645836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5a274-3690-4dee-9c67-7fa57dc9de9c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:37.661159 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5a274-3690-4dee-9c67-7fa57dc9de9c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:37.672091 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a7954-4861-44ae-82dd-99ac5eaed2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:37.673492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a7954-4861-44ae-82dd-99ac5eaed2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:37.674224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a7954-4861-44ae-82dd-99ac5eaed2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:37.674752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a7954-4861-44ae-82dd-99ac5eaed2d0 admin admin] PATH_INFO: `/v3/projects/be4e8c5f31b24095a147e1d5509a360c/users/e551c8ab610a4c9eb5daf47da8fd29e8/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:37.698588 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a7954-4861-44ae-82dd-99ac5eaed2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4e8c5f31b24095a147e1d5509a360c, user_id=e551c8ab610a4c9eb5daf47da8fd29e8, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:37.702818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a7954-4861-44ae-82dd-99ac5eaed2d0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:37.728135 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1070/2145] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:37 2022] PUT /identity/v3/projects/be4e8c5f31b24095a147e1d5509a360c/users/e551c8ab610a4c9eb5daf47da8fd29e8/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:37.739442 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14308d81-165d-4b15-acc2-2c8d22bef6db None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:37.740007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14308d81-165d-4b15-acc2-2c8d22bef6db None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:37.740517 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14308d81-165d-4b15-acc2-2c8d22bef6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:37.809530 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-14308d81-165d-4b15-acc2-2c8d22bef6db None None] MFA Rules not processed for user `e551c8ab610a4c9eb5daf47da8fd29e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:37.810984 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-14308d81-165d-4b15-acc2-2c8d22bef6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:37.879359 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:37.927203 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1076/2146] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:37.947280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a7954-4861-44ae-82dd-99ac5eaed2d0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:37.949277 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-141a7954-4861-44ae-82dd-99ac5eaed2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:38.024884 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a7954-4861-44ae-82dd-99ac5eaed2d0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:38.028707 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248fb9c-3d8e-4775-9352-185827f626a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:38.029498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248fb9c-3d8e-4775-9352-185827f626a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:38.029938 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248fb9c-3d8e-4775-9352-185827f626a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:38.030321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248fb9c-3d8e-4775-9352-185827f626a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:38.041019 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248fb9c-3d8e-4775-9352-185827f626a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:38.042833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248fb9c-3d8e-4775-9352-185827f626a1 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:38.053583 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1071/2147] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:38.698573 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14308d81-165d-4b15-acc2-2c8d22bef6db None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:38.700160 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-14308d81-165d-4b15-acc2-2c8d22bef6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:38.766789 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14308d81-165d-4b15-acc2-2c8d22bef6db None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:38.771324 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bedd3-08a3-424b-bc29-ea1f7361ed10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:38.772231 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bedd3-08a3-424b-bc29-ea1f7361ed10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:38.772637 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bedd3-08a3-424b-bc29-ea1f7361ed10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:38.772919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bedd3-08a3-424b-bc29-ea1f7361ed10 admin admin] PATH_INFO: `/v3/users/a4eb36a9d7d44022b7156c75f8496a5f` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:38.775434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bedd3-08a3-424b-bc29-ea1f7361ed10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4eb36a9d7d44022b7156c75f8496a5f)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:38.777407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bedd3-08a3-424b-bc29-ea1f7361ed10 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:38.823711 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a55bedd3-08a3-424b-bc29-ea1f7361ed10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4eb36a9d7d44022b7156c75f8496a5f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:38.824394 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a55bedd3-08a3-424b-bc29-ea1f7361ed10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4eb36a9d7d44022b7156c75f8496a5f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:38.832339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a55bedd3-08a3-424b-bc29-ea1f7361ed10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4eb36a9d7d44022b7156c75f8496a5f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:38.841048 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a55bedd3-08a3-424b-bc29-ea1f7361ed10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4eb36a9d7d44022b7156c75f8496a5f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:38.854327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a55bedd3-08a3-424b-bc29-ea1f7361ed10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4eb36a9d7d44022b7156c75f8496a5f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:38.860562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1077/2148] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:38 2022] DELETE /identity/v3/users/a4eb36a9d7d44022b7156c75f8496a5f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:38.865269 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69963255-0674-4118-9d0f-52b9c0120b39 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:38.865689 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69963255-0674-4118-9d0f-52b9c0120b39 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:38.866148 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69963255-0674-4118-9d0f-52b9c0120b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:38.885038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-69963255-0674-4118-9d0f-52b9c0120b39 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:38.886237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-69963255-0674-4118-9d0f-52b9c0120b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:38.961610 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1072/2149] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:38.974624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bedd3-08a3-424b-bc29-ea1f7361ed10 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:38.976464 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a55bedd3-08a3-424b-bc29-ea1f7361ed10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:39.032224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:39.049683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bedd3-08a3-424b-bc29-ea1f7361ed10 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:39.053406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9ac0b-24d8-49da-a25a-60bd6dcfd158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:39.054064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9ac0b-24d8-49da-a25a-60bd6dcfd158 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:39.054348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9ac0b-24d8-49da-a25a-60bd6dcfd158 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:39.054628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9ac0b-24d8-49da-a25a-60bd6dcfd158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:39.065644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9ac0b-24d8-49da-a25a-60bd6dcfd158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:39.067088 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9ac0b-24d8-49da-a25a-60bd6dcfd158 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:39.079853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1078/2150] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:10:39.328988 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69963255-0674-4118-9d0f-52b9c0120b39 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:39.330406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-69963255-0674-4118-9d0f-52b9c0120b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:39.342548 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69963255-0674-4118-9d0f-52b9c0120b39 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:39.351339 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71701f9-c9d7-456e-9482-6c21afbfa598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:39.354599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71701f9-c9d7-456e-9482-6c21afbfa598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:39.355408 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71701f9-c9d7-456e-9482-6c21afbfa598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:39.355520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9ac0b-24d8-49da-a25a-60bd6dcfd158 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:39.355604 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71701f9-c9d7-456e-9482-6c21afbfa598 admin admin] PATH_INFO: `/v3/users/ee031b3dbfd4484abf46c42fe4a32698` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:39.356656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bdd9ac0b-24d8-49da-a25a-60bd6dcfd158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:39.357031 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71701f9-c9d7-456e-9482-6c21afbfa598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee031b3dbfd4484abf46c42fe4a32698)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:39.359594 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71701f9-c9d7-456e-9482-6c21afbfa598 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:39.381012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:39.383598 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9ac0b-24d8-49da-a25a-60bd6dcfd158 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:39.389472 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:39.390316 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:39.390600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:39.390876 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583 admin admin] PATH_INFO: `/v3/projects/d8594e7897224d749d4bbca95b1474f4` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:39.392129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8594e7897224d749d4bbca95b1474f4)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:39.394563 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:39.426228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f71701f9-c9d7-456e-9482-6c21afbfa598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee031b3dbfd4484abf46c42fe4a32698'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:39.434032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f71701f9-c9d7-456e-9482-6c21afbfa598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee031b3dbfd4484abf46c42fe4a32698'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:39.442320 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f71701f9-c9d7-456e-9482-6c21afbfa598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee031b3dbfd4484abf46c42fe4a32698'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:39.443249 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f71701f9-c9d7-456e-9482-6c21afbfa598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee031b3dbfd4484abf46c42fe4a32698'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:39.443862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f71701f9-c9d7-456e-9482-6c21afbfa598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee031b3dbfd4484abf46c42fe4a32698'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:39.450960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8594e7897224d749d4bbca95b1474f4', 'request_id': 'req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:39.462989 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8594e7897224d749d4bbca95b1474f4', 'request_id': 'req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:39.465644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1073/2151] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:39 2022] DELETE /identity/v3/users/ee031b3dbfd4484abf46c42fe4a32698 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:39.470811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17889e93-9206-4ff8-a6e4-1027a69b2fbe None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:39.471113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17889e93-9206-4ff8-a6e4-1027a69b2fbe None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:39.471238 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8594e7897224d749d4bbca95b1474f4', 'request_id': 'req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:39.471403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17889e93-9206-4ff8-a6e4-1027a69b2fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:39.484277 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583 admin admin] The token cache is being invalidate because project d8594e7897224d749d4bbca95b1474f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:39.484574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:39.485241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:39.486810 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1079/2152] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:39 2022] DELETE /identity/v3/projects/d8594e7897224d749d4bbca95b1474f4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:39.489732 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-17889e93-9206-4ff8-a6e4-1027a69b2fbe None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:39.490743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:39.490930 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-17889e93-9206-4ff8-a6e4-1027a69b2fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:39.492229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:39.552191 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1074/2153] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:39.559215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3c819-ad2d-4d4e-ad8b-b5d540e7f583 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:39.561742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17889e93-9206-4ff8-a6e4-1027a69b2fbe None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:39.563562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-17889e93-9206-4ff8-a6e4-1027a69b2fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:39.566163 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b836063-ed86-4138-9e4a-97c8f4584701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:39.567422 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b836063-ed86-4138-9e4a-97c8f4584701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:39.567737 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b836063-ed86-4138-9e4a-97c8f4584701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:39.568051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b836063-ed86-4138-9e4a-97c8f4584701 admin admin] PATH_INFO: `/v3/users/4b0d7a91e1ad428dbb3199035739d59f` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:39.569511 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b836063-ed86-4138-9e4a-97c8f4584701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b0d7a91e1ad428dbb3199035739d59f)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:39.571710 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b836063-ed86-4138-9e4a-97c8f4584701 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:39.620764 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9b836063-ed86-4138-9e4a-97c8f4584701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b0d7a91e1ad428dbb3199035739d59f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:39.622343 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9b836063-ed86-4138-9e4a-97c8f4584701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b0d7a91e1ad428dbb3199035739d59f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:39.626088 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17889e93-9206-4ff8-a6e4-1027a69b2fbe None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:39.630184 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10676c0-e104-4ab6-93de-ed659d6bdaab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:39.630843 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10676c0-e104-4ab6-93de-ed659d6bdaab service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:39.631168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10676c0-e104-4ab6-93de-ed659d6bdaab service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:39.631415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10676c0-e104-4ab6-93de-ed659d6bdaab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:39.633841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9b836063-ed86-4138-9e4a-97c8f4584701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b0d7a91e1ad428dbb3199035739d59f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:39.641636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9b836063-ed86-4138-9e4a-97c8f4584701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b0d7a91e1ad428dbb3199035739d59f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:39.641792 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10676c0-e104-4ab6-93de-ed659d6bdaab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:39.643243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10676c0-e104-4ab6-93de-ed659d6bdaab service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:39.650092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:39.655634 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1075/2154] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:39.660252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9b836063-ed86-4138-9e4a-97c8f4584701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b0d7a91e1ad428dbb3199035739d59f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:39.668457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1080/2155] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:39 2022] DELETE /identity/v3/users/4b0d7a91e1ad428dbb3199035739d59f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:40.032284 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10676c0-e104-4ab6-93de-ed659d6bdaab service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:40.055277 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10676c0-e104-4ab6-93de-ed659d6bdaab service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:40.068208 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b836063-ed86-4138-9e4a-97c8f4584701 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:40.070979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9b836063-ed86-4138-9e4a-97c8f4584701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:40.140027 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:40.186032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f9809-4a91-4c1c-b80c-01c4c8a907aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:40.188862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f9809-4a91-4c1c-b80c-01c4c8a907aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.189170 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f9809-4a91-4c1c-b80c-01c4c8a907aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.189510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f9809-4a91-4c1c-b80c-01c4c8a907aa admin admin] PATH_INFO: `/v3/projects/9b3ce3faac6c46369e79e66b35976e93` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.191513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b836063-ed86-4138-9e4a-97c8f4584701 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:40.192966 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f9809-4a91-4c1c-b80c-01c4c8a907aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b3ce3faac6c46369e79e66b35976e93)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:40.196975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f9809-4a91-4c1c-b80c-01c4c8a907aa admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:40.197919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68f1ea-3d6d-4024-bd72-1be4f794c4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:40.198974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68f1ea-3d6d-4024-bd72-1be4f794c4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.199265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68f1ea-3d6d-4024-bd72-1be4f794c4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.199547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68f1ea-3d6d-4024-bd72-1be4f794c4bf admin admin] PATH_INFO: `/v3/projects/b8ec39451801415bb6b5560d2795b301` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.201640 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68f1ea-3d6d-4024-bd72-1be4f794c4bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ec39451801415bb6b5560d2795b301)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:40.203666 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68f1ea-3d6d-4024-bd72-1be4f794c4bf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:40.267793 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-513f9809-4a91-4c1c-b80c-01c4c8a907aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b3ce3faac6c46369e79e66b35976e93', 'request_id': 'req-513f9809-4a91-4c1c-b80c-01c4c8a907aa'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:40.273713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-513f9809-4a91-4c1c-b80c-01c4c8a907aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b3ce3faac6c46369e79e66b35976e93', 'request_id': 'req-513f9809-4a91-4c1c-b80c-01c4c8a907aa'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:40.283429 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3d68f1ea-3d6d-4024-bd72-1be4f794c4bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ec39451801415bb6b5560d2795b301', 'request_id': 'req-3d68f1ea-3d6d-4024-bd72-1be4f794c4bf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:40.283574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-513f9809-4a91-4c1c-b80c-01c4c8a907aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b3ce3faac6c46369e79e66b35976e93', 'request_id': 'req-513f9809-4a91-4c1c-b80c-01c4c8a907aa'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:40.291817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3d68f1ea-3d6d-4024-bd72-1be4f794c4bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ec39451801415bb6b5560d2795b301', 'request_id': 'req-3d68f1ea-3d6d-4024-bd72-1be4f794c4bf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:40.296085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-513f9809-4a91-4c1c-b80c-01c4c8a907aa admin admin] The token cache is being invalidate because project 9b3ce3faac6c46369e79e66b35976e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:40.296374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-513f9809-4a91-4c1c-b80c-01c4c8a907aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:40.296998 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-513f9809-4a91-4c1c-b80c-01c4c8a907aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:40.298246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3d68f1ea-3d6d-4024-bd72-1be4f794c4bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ec39451801415bb6b5560d2795b301', 'request_id': 'req-3d68f1ea-3d6d-4024-bd72-1be4f794c4bf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:40.298741 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1076/2156] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:40 2022] DELETE /identity/v3/projects/9b3ce3faac6c46369e79e66b35976e93 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:40.303482 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3dd26-4a7a-445d-9360-5b2cac4a396e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.303881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3dd26-4a7a-445d-9360-5b2cac4a396e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.304298 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3dd26-4a7a-445d-9360-5b2cac4a396e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.310642 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3d68f1ea-3d6d-4024-bd72-1be4f794c4bf admin admin] The token cache is being invalidate because project b8ec39451801415bb6b5560d2795b301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:40.310935 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3d68f1ea-3d6d-4024-bd72-1be4f794c4bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:40.311587 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3d68f1ea-3d6d-4024-bd72-1be4f794c4bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:40.313184 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1081/2157] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:40 2022] DELETE /identity/v3/projects/b8ec39451801415bb6b5560d2795b301 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:40.319423 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41cc0f-8bf1-4e76-a252-43df3dbbd6d1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.319600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41cc0f-8bf1-4e76-a252-43df3dbbd6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.319869 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41cc0f-8bf1-4e76-a252-43df3dbbd6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.323690 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3aa3dd26-4a7a-445d-9360-5b2cac4a396e None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:40.324958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3aa3dd26-4a7a-445d-9360-5b2cac4a396e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:40.339545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ee41cc0f-8bf1-4e76-a252-43df3dbbd6d1 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:40.340791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ee41cc0f-8bf1-4e76-a252-43df3dbbd6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:40.390162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1077/2158] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:40.398849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfeeba9-745c-49ca-9f86-4b1995aff4d4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.399176 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfeeba9-745c-49ca-9f86-4b1995aff4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.399470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfeeba9-745c-49ca-9f86-4b1995aff4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.405443 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1082/2159] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:40.412843 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b9882-501a-4e7a-ae80-d32c7be9ccc7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.413139 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b9882-501a-4e7a-ae80-d32c7be9ccc7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.413425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b9882-501a-4e7a-ae80-d32c7be9ccc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.418102 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-dcfeeba9-745c-49ca-9f86-4b1995aff4d4 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:40.419325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dcfeeba9-745c-49ca-9f86-4b1995aff4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:40.427792 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1078/2160] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:40.431454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfeeba9-745c-49ca-9f86-4b1995aff4d4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:40.431862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-324b9882-501a-4e7a-ae80-d32c7be9ccc7 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:40.433092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-324b9882-501a-4e7a-ae80-d32c7be9ccc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:40.441126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfeeba9-745c-49ca-9f86-4b1995aff4d4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:40.441410 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1083/2161] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:40.445154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b9882-501a-4e7a-ae80-d32c7be9ccc7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:40.445987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287904c-fb94-4db2-8fb4-5048c4d77282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:40.446633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287904c-fb94-4db2-8fb4-5048c4d77282 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.446920 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287904c-fb94-4db2-8fb4-5048c4d77282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.447202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287904c-fb94-4db2-8fb4-5048c4d77282 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.447951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287904c-fb94-4db2-8fb4-5048c4d77282 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:10:40.448270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287904c-fb94-4db2-8fb4-5048c4d77282 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:40.449877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287904c-fb94-4db2-8fb4-5048c4d77282 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:40.455622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b9882-501a-4e7a-ae80-d32c7be9ccc7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:40.460878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74d374-3821-4cc1-a777-0bad58384926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:40.461572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74d374-3821-4cc1-a777-0bad58384926 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.461856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74d374-3821-4cc1-a777-0bad58384926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.462135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74d374-3821-4cc1-a777-0bad58384926 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.462866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74d374-3821-4cc1-a777-0bad58384926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:10:40.463178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74d374-3821-4cc1-a777-0bad58384926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:40.467528 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1079/2162] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:10:40.468137 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74d374-3821-4cc1-a777-0bad58384926 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:40.469127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287904c-fb94-4db2-8fb4-5048c4d77282 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:40.474384 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:40.481772 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1084/2163] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:10:40.482445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287904c-fb94-4db2-8fb4-5048c4d77282 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:40.483434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74d374-3821-4cc1-a777-0bad58384926 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:40.488012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adaecad-f4b0-4f61-8849-a1e0052a9bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:40.488611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaecad-f4b0-4f61-8849-a1e0052a9bab admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.488901 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaecad-f4b0-4f61-8849-a1e0052a9bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.489187 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaecad-f4b0-4f61-8849-a1e0052a9bab admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.489898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adaecad-f4b0-4f61-8849-a1e0052a9bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:40.491816 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adaecad-f4b0-4f61-8849-a1e0052a9bab admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:40.497494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74d374-3821-4cc1-a777-0bad58384926 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:40.503275 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7e0c9-6013-4055-90c6-e195a593c47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:40.508022 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e0c9-6013-4055-90c6-e195a593c47c admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.508407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e0c9-6013-4055-90c6-e195a593c47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.508821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e0c9-6013-4055-90c6-e195a593c47c admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.509415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7e0c9-6013-4055-90c6-e195a593c47c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:40.511312 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7e0c9-6013-4055-90c6-e195a593c47c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:40.524906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1080/2164] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:40 2022] POST /identity/v3/projects => generated 407 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:10:40.528369 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adaecad-f4b0-4f61-8849-a1e0052a9bab admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:40.541705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1085/2165] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:40 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:40.548676 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7e0c9-6013-4055-90c6-e195a593c47c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:40.577030 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:40.618834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adaecad-f4b0-4f61-8849-a1e0052a9bab admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:40.623643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7e0c9-6013-4055-90c6-e195a593c47c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:40.625321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a766a83-eacb-481e-bb77-88d57f941c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:40.626064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a766a83-eacb-481e-bb77-88d57f941c1c admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.626361 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a766a83-eacb-481e-bb77-88d57f941c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.626647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a766a83-eacb-481e-bb77-88d57f941c1c admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.627566 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a766a83-eacb-481e-bb77-88d57f941c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:40.628804 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87af54-5b8d-44c0-a3dc-781ca421e8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:40.629492 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87af54-5b8d-44c0-a3dc-781ca421e8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.629908 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a766a83-eacb-481e-bb77-88d57f941c1c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:40.630048 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87af54-5b8d-44c0-a3dc-781ca421e8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.630252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87af54-5b8d-44c0-a3dc-781ca421e8e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.631941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87af54-5b8d-44c0-a3dc-781ca421e8e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:40.632843 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87af54-5b8d-44c0-a3dc-781ca421e8e6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:40.655963 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1081/2166] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:40 2022] POST /identity/v3/users => generated 304 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:10:40.656267 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1086/2167] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:40 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:10:40.657666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a766a83-eacb-481e-bb77-88d57f941c1c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:40.659746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87af54-5b8d-44c0-a3dc-781ca421e8e6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:40.670824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a766a83-eacb-481e-bb77-88d57f941c1c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:40.673649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87af54-5b8d-44c0-a3dc-781ca421e8e6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:40.676028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963f7aa-e5a8-450a-a3ce-5261c09a77c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:40.676765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963f7aa-e5a8-450a-a3ce-5261c09a77c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.677137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963f7aa-e5a8-450a-a3ce-5261c09a77c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.677674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963f7aa-e5a8-450a-a3ce-5261c09a77c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.678173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963f7aa-e5a8-450a-a3ce-5261c09a77c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:40.679181 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53815063-f3a5-4bde-aeb6-bb8e6a086286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:40.679844 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53815063-f3a5-4bde-aeb6-bb8e6a086286 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.679992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963f7aa-e5a8-450a-a3ce-5261c09a77c5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:40.680159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53815063-f3a5-4bde-aeb6-bb8e6a086286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.680438 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53815063-f3a5-4bde-aeb6-bb8e6a086286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.681165 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53815063-f3a5-4bde-aeb6-bb8e6a086286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:40.682752 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53815063-f3a5-4bde-aeb6-bb8e6a086286 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:40.694833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1082/2168] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:10:40.700030 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1087/2169] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:40.706909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53815063-f3a5-4bde-aeb6-bb8e6a086286 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:40.707957 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963f7aa-e5a8-450a-a3ce-5261c09a77c5 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:40.719532 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963f7aa-e5a8-450a-a3ce-5261c09a77c5 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:40.725069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcbe54-1292-4f8f-af55-2cebe3268801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:40.725930 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcbe54-1292-4f8f-af55-2cebe3268801 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.726293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcbe54-1292-4f8f-af55-2cebe3268801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.726797 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcbe54-1292-4f8f-af55-2cebe3268801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.727365 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53815063-f3a5-4bde-aeb6-bb8e6a086286 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:40.727642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcbe54-1292-4f8f-af55-2cebe3268801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:40.729359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcbe54-1292-4f8f-af55-2cebe3268801 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:40.736564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49843c04-720d-483d-8a24-60b1399e897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:40.737766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49843c04-720d-483d-8a24-60b1399e897b admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.738060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49843c04-720d-483d-8a24-60b1399e897b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.738983 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49843c04-720d-483d-8a24-60b1399e897b admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.739956 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49843c04-720d-483d-8a24-60b1399e897b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:40.741563 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49843c04-720d-483d-8a24-60b1399e897b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:40.750520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1083/2170] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:40.751588 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcbe54-1292-4f8f-af55-2cebe3268801 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:40.757472 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1088/2171] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:40.759427 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49843c04-720d-483d-8a24-60b1399e897b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:40.763679 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcbe54-1292-4f8f-af55-2cebe3268801 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:40.768977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870062a-3f63-4a45-bdd3-ec754ea080ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:40.770027 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870062a-3f63-4a45-bdd3-ec754ea080ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.770394 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870062a-3f63-4a45-bdd3-ec754ea080ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.770724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870062a-3f63-4a45-bdd3-ec754ea080ae admin admin] PATH_INFO: `/v3/projects/af228a70870847758c9876f134a10e6f/users/1a447dbc3c5f4b94b6a4cc6dfbb0b87d/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.770990 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49843c04-720d-483d-8a24-60b1399e897b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:40.779321 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d39a25-0bd8-45ea-bf0e-2828b2a6b595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:40.780710 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d39a25-0bd8-45ea-bf0e-2828b2a6b595 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.781006 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d39a25-0bd8-45ea-bf0e-2828b2a6b595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.781309 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d39a25-0bd8-45ea-bf0e-2828b2a6b595 admin admin] PATH_INFO: `/v3/projects/fbd650dea3ca494ab0784cf75c959d3c/users/c209b070f8454fa9921e4264621a5003/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.786545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870062a-3f63-4a45-bdd3-ec754ea080ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=af228a70870847758c9876f134a10e6f, user_id=1a447dbc3c5f4b94b6a4cc6dfbb0b87d, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:40.789243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870062a-3f63-4a45-bdd3-ec754ea080ae admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:40.797741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d39a25-0bd8-45ea-bf0e-2828b2a6b595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd650dea3ca494ab0784cf75c959d3c, user_id=c209b070f8454fa9921e4264621a5003, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:40.800430 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d39a25-0bd8-45ea-bf0e-2828b2a6b595 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:40.802703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1084/2172] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:40 2022] PUT /identity/v3/projects/af228a70870847758c9876f134a10e6f/users/1a447dbc3c5f4b94b6a4cc6dfbb0b87d/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:40.814402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6c514-e793-4d2d-a1d7-09b5a1d4e20d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.814711 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6c514-e793-4d2d-a1d7-09b5a1d4e20d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.814997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6c514-e793-4d2d-a1d7-09b5a1d4e20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.818671 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1089/2173] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:40 2022] PUT /identity/v3/projects/fbd650dea3ca494ab0784cf75c959d3c/users/c209b070f8454fa9921e4264621a5003/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:40.828787 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d04532-cfaf-4e39-bd57-e4deb6aa5113 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:40.829083 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d04532-cfaf-4e39-bd57-e4deb6aa5113 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:40.829369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d04532-cfaf-4e39-bd57-e4deb6aa5113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:40.843579 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f9d6c514-e793-4d2d-a1d7-09b5a1d4e20d None None] MFA Rules not processed for user `1a447dbc3c5f4b94b6a4cc6dfbb0b87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:40.844835 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f9d6c514-e793-4d2d-a1d7-09b5a1d4e20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:40.859736 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e8d04532-cfaf-4e39-bd57-e4deb6aa5113 None None] MFA Rules not processed for user `c209b070f8454fa9921e4264621a5003`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:40.860978 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e8d04532-cfaf-4e39-bd57-e4deb6aa5113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:40.915952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1085/2174] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:40.925452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6c514-e793-4d2d-a1d7-09b5a1d4e20d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:40.926834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f9d6c514-e793-4d2d-a1d7-09b5a1d4e20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:40.933254 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1090/2175] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:40.937389 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d04532-cfaf-4e39-bd57-e4deb6aa5113 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:40.952545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:40.998078 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6c514-e793-4d2d-a1d7-09b5a1d4e20d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:41.002305 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aba822-3857-40c4-b196-bdd53d5c4ef3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:41.003131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aba822-3857-40c4-b196-bdd53d5c4ef3 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:41.003602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aba822-3857-40c4-b196-bdd53d5c4ef3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:41.003885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aba822-3857-40c4-b196-bdd53d5c4ef3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:41.013246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aba822-3857-40c4-b196-bdd53d5c4ef3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:41.014531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aba822-3857-40c4-b196-bdd53d5c4ef3 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:41.026981 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d04532-cfaf-4e39-bd57-e4deb6aa5113 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:41.027715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1086/2176] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:10:41.032732 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea044f-9867-4ebc-b8a0-805dc40f7e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:41.033714 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea044f-9867-4ebc-b8a0-805dc40f7e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:41.034002 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea044f-9867-4ebc-b8a0-805dc40f7e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:41.034285 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea044f-9867-4ebc-b8a0-805dc40f7e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:41.034990 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea044f-9867-4ebc-b8a0-805dc40f7e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:41.036966 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea044f-9867-4ebc-b8a0-805dc40f7e92 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:41.071356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1091/2177] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:40 2022] POST /identity/v3/projects => generated 409 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:10:41.075477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aba822-3857-40c4-b196-bdd53d5c4ef3 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:41.082064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:41.088642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aba822-3857-40c4-b196-bdd53d5c4ef3 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:41.163183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba81b46-545a-44f8-b856-eb33974b108f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:41.164252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba81b46-545a-44f8-b856-eb33974b108f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:41.164526 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba81b46-545a-44f8-b856-eb33974b108f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:41.165063 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba81b46-545a-44f8-b856-eb33974b108f admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:41.165800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba81b46-545a-44f8-b856-eb33974b108f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:41.167771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba81b46-545a-44f8-b856-eb33974b108f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:41.190397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1087/2178] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:41 2022] POST /identity/v3/users => generated 311 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:41.194932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea044f-9867-4ebc-b8a0-805dc40f7e92 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:41.207222 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea044f-9867-4ebc-b8a0-805dc40f7e92 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:41.212074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6141b6-01f5-4e29-9e4d-cc9718bf5e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:41.212743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6141b6-01f5-4e29-9e4d-cc9718bf5e24 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:41.213034 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6141b6-01f5-4e29-9e4d-cc9718bf5e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:41.213345 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6141b6-01f5-4e29-9e4d-cc9718bf5e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:41.214221 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6141b6-01f5-4e29-9e4d-cc9718bf5e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:41.215842 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6141b6-01f5-4e29-9e4d-cc9718bf5e24 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:41.233503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1092/2179] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:41.237792 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba81b46-545a-44f8-b856-eb33974b108f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:41.247874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba81b46-545a-44f8-b856-eb33974b108f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:41.253923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7c717-ce2a-4826-8ec3-9663fefca20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:41.254800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7c717-ce2a-4826-8ec3-9663fefca20b admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:41.255089 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7c717-ce2a-4826-8ec3-9663fefca20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:41.255360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7c717-ce2a-4826-8ec3-9663fefca20b admin admin] PATH_INFO: `/v3/projects/0f494de6b4a24d7f83bf64bf4e73c844/users/8a6f1551d2a5493db42d183e326211f0/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:41.278028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7c717-ce2a-4826-8ec3-9663fefca20b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f494de6b4a24d7f83bf64bf4e73c844, user_id=8a6f1551d2a5493db42d183e326211f0, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:41.282052 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7c717-ce2a-4826-8ec3-9663fefca20b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:41.299563 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1088/2180] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:41 2022] PUT /identity/v3/projects/0f494de6b4a24d7f83bf64bf4e73c844/users/8a6f1551d2a5493db42d183e326211f0/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:41.303504 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6141b6-01f5-4e29-9e4d-cc9718bf5e24 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:41.320206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6141b6-01f5-4e29-9e4d-cc9718bf5e24 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:41.434500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4f80c-820f-4aa6-b630-247826961790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:41.435290 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4f80c-820f-4aa6-b630-247826961790 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:41.435656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4f80c-820f-4aa6-b630-247826961790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:41.435909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4f80c-820f-4aa6-b630-247826961790 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:41.436743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4f80c-820f-4aa6-b630-247826961790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:41.438530 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4f80c-820f-4aa6-b630-247826961790 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:41.455574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1093/2181] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:41.459800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7c717-ce2a-4826-8ec3-9663fefca20b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:41.472134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7c717-ce2a-4826-8ec3-9663fefca20b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:41.483698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dd2ec-d014-4144-b800-5f93964bbbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:41.484630 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dd2ec-d014-4144-b800-5f93964bbbe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:41.484915 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dd2ec-d014-4144-b800-5f93964bbbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:41.485191 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dd2ec-d014-4144-b800-5f93964bbbe4 admin admin] PATH_INFO: `/v3/projects/0f494de6b4a24d7f83bf64bf4e73c844/users/8a6f1551d2a5493db42d183e326211f0/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:41.495989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dd2ec-d014-4144-b800-5f93964bbbe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f494de6b4a24d7f83bf64bf4e73c844, user_id=8a6f1551d2a5493db42d183e326211f0, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:41.498749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dd2ec-d014-4144-b800-5f93964bbbe4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:41.510048 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1089/2182] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:41 2022] PUT /identity/v3/projects/0f494de6b4a24d7f83bf64bf4e73c844/users/8a6f1551d2a5493db42d183e326211f0/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:41.520772 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa1186-ef2c-4b79-bb7f-8fb0d142cb64 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:41.521112 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa1186-ef2c-4b79-bb7f-8fb0d142cb64 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:41.521392 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa1186-ef2c-4b79-bb7f-8fb0d142cb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:41.548228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-49fa1186-ef2c-4b79-bb7f-8fb0d142cb64 None None] MFA Rules not processed for user `8a6f1551d2a5493db42d183e326211f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:41.549427 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-49fa1186-ef2c-4b79-bb7f-8fb0d142cb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:41.616563 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1094/2183] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:41 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:41.628143 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dd2ec-d014-4144-b800-5f93964bbbe4 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:41.682595 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dd2ec-d014-4144-b800-5f93964bbbe4 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:41.686726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e36b4c-affc-4ba1-87bc-91a0f2e49609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:41.687357 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e36b4c-affc-4ba1-87bc-91a0f2e49609 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:41.687641 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e36b4c-affc-4ba1-87bc-91a0f2e49609 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:41.687936 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e36b4c-affc-4ba1-87bc-91a0f2e49609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:41.696762 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e36b4c-affc-4ba1-87bc-91a0f2e49609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:41.698178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e36b4c-affc-4ba1-87bc-91a0f2e49609 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:41.708217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1090/2184] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:41 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:41.852903 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa1186-ef2c-4b79-bb7f-8fb0d142cb64 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:41.854299 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-49fa1186-ef2c-4b79-bb7f-8fb0d142cb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:41.867961 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa1186-ef2c-4b79-bb7f-8fb0d142cb64 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:41.871457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e9c4d-0f01-4964-b4e6-2f414050c68d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:41.872124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e9c4d-0f01-4964-b4e6-2f414050c68d service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:41.872430 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e9c4d-0f01-4964-b4e6-2f414050c68d service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:41.873250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e9c4d-0f01-4964-b4e6-2f414050c68d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:41.877335 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:41.930821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e9c4d-0f01-4964-b4e6-2f414050c68d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:41.932302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e9c4d-0f01-4964-b4e6-2f414050c68d service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:41.941611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1095/2185] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:41 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:49.928296 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e36b4c-affc-4ba1-87bc-91a0f2e49609 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:49.998108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:50.003022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e36b4c-affc-4ba1-87bc-91a0f2e49609 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:50.008685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd03c9-74c9-4baf-af9c-790c41bc3fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:50.009566 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd03c9-74c9-4baf-af9c-790c41bc3fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:50.009846 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd03c9-74c9-4baf-af9c-790c41bc3fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:50.010121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd03c9-74c9-4baf-af9c-790c41bc3fb4 admin admin] PATH_INFO: `/v3/users/1a447dbc3c5f4b94b6a4cc6dfbb0b87d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:50.011364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd03c9-74c9-4baf-af9c-790c41bc3fb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a447dbc3c5f4b94b6a4cc6dfbb0b87d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:50.013333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd03c9-74c9-4baf-af9c-790c41bc3fb4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:50.062811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cbcd03c9-74c9-4baf-af9c-790c41bc3fb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a447dbc3c5f4b94b6a4cc6dfbb0b87d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:50.069997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cbcd03c9-74c9-4baf-af9c-790c41bc3fb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a447dbc3c5f4b94b6a4cc6dfbb0b87d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:50.077205 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cbcd03c9-74c9-4baf-af9c-790c41bc3fb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a447dbc3c5f4b94b6a4cc6dfbb0b87d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:50.078462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cbcd03c9-74c9-4baf-af9c-790c41bc3fb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a447dbc3c5f4b94b6a4cc6dfbb0b87d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:50.079065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cbcd03c9-74c9-4baf-af9c-790c41bc3fb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a447dbc3c5f4b94b6a4cc6dfbb0b87d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:50.096227 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1091/2186] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:49 2022] DELETE /identity/v3/users/1a447dbc3c5f4b94b6a4cc6dfbb0b87d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:50.100573 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0d485-7001-480c-8e8a-3f6d76768223 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:50.101068 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0d485-7001-480c-8e8a-3f6d76768223 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:50.101157 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0d485-7001-480c-8e8a-3f6d76768223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:50.117682 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3de0d485-7001-480c-8e8a-3f6d76768223 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:50.118860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3de0d485-7001-480c-8e8a-3f6d76768223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:50.179651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1096/2187] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:50.191205 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd03c9-74c9-4baf-af9c-790c41bc3fb4 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:50.192698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cbcd03c9-74c9-4baf-af9c-790c41bc3fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:50.248694 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd03c9-74c9-4baf-af9c-790c41bc3fb4 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:50.252875 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d308f57-f2b0-48bd-a2f1-e958c20e2017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:50.253520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d308f57-f2b0-48bd-a2f1-e958c20e2017 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:50.253800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d308f57-f2b0-48bd-a2f1-e958c20e2017 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:50.254072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d308f57-f2b0-48bd-a2f1-e958c20e2017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:50.262818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d308f57-f2b0-48bd-a2f1-e958c20e2017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:50.264273 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d308f57-f2b0-48bd-a2f1-e958c20e2017 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:50.273519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1092/2188] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:50.569582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0d485-7001-480c-8e8a-3f6d76768223 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:50.571162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3de0d485-7001-480c-8e8a-3f6d76768223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:50.589010 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0d485-7001-480c-8e8a-3f6d76768223 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:50.595331 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bfffc-98a9-4b0b-922f-646d58187865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:50.596236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bfffc-98a9-4b0b-922f-646d58187865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:50.596554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bfffc-98a9-4b0b-922f-646d58187865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:50.596867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bfffc-98a9-4b0b-922f-646d58187865 admin admin] PATH_INFO: `/v3/projects/af228a70870847758c9876f134a10e6f` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:50.598505 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bfffc-98a9-4b0b-922f-646d58187865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af228a70870847758c9876f134a10e6f)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:50.600476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bfffc-98a9-4b0b-922f-646d58187865 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:50.645918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-df5bfffc-98a9-4b0b-922f-646d58187865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af228a70870847758c9876f134a10e6f', 'request_id': 'req-df5bfffc-98a9-4b0b-922f-646d58187865'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:50.653136 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-df5bfffc-98a9-4b0b-922f-646d58187865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af228a70870847758c9876f134a10e6f', 'request_id': 'req-df5bfffc-98a9-4b0b-922f-646d58187865'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:50.659851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-df5bfffc-98a9-4b0b-922f-646d58187865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af228a70870847758c9876f134a10e6f', 'request_id': 'req-df5bfffc-98a9-4b0b-922f-646d58187865'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:50.670366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-df5bfffc-98a9-4b0b-922f-646d58187865 admin admin] The token cache is being invalidate because project af228a70870847758c9876f134a10e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:50.670661 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-df5bfffc-98a9-4b0b-922f-646d58187865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:50.671854 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-df5bfffc-98a9-4b0b-922f-646d58187865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:50.673591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1097/2189] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:50 2022] DELETE /identity/v3/projects/af228a70870847758c9876f134a10e6f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:50.678529 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e430d-06ea-4814-ab40-49c658f9af08 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:50.678894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e430d-06ea-4814-ab40-49c658f9af08 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:50.679182 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e430d-06ea-4814-ab40-49c658f9af08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:50.696928 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-723e430d-06ea-4814-ab40-49c658f9af08 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:50.698128 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-723e430d-06ea-4814-ab40-49c658f9af08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:50.761759 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1093/2190] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:50.770550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abf1b7-a227-4f43-8c20-df42086e8999 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:50.770848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abf1b7-a227-4f43-8c20-df42086e8999 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:50.771132 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abf1b7-a227-4f43-8c20-df42086e8999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:50.793142 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-38abf1b7-a227-4f43-8c20-df42086e8999 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:50.794417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-38abf1b7-a227-4f43-8c20-df42086e8999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:50.803099 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1098/2191] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:50.807395 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e430d-06ea-4814-ab40-49c658f9af08 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:50.817010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e430d-06ea-4814-ab40-49c658f9af08 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:50.821671 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f2dff-757b-4b91-91bc-d0e4a28a405f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:50.822275 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f2dff-757b-4b91-91bc-d0e4a28a405f admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:50.822567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f2dff-757b-4b91-91bc-d0e4a28a405f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:50.822850 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f2dff-757b-4b91-91bc-d0e4a28a405f admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:50.823607 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f2dff-757b-4b91-91bc-d0e4a28a405f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:10:50.823943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f2dff-757b-4b91-91bc-d0e4a28a405f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:50.825586 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f2dff-757b-4b91-91bc-d0e4a28a405f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:50.840836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1094/2192] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:10:50.842068 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abf1b7-a227-4f43-8c20-df42086e8999 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:50.851680 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abf1b7-a227-4f43-8c20-df42086e8999 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:50.856337 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf83cc3-014b-4dbf-a4d4-aecda6b680b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:50.856989 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf83cc3-014b-4dbf-a4d4-aecda6b680b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:50.857271 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf83cc3-014b-4dbf-a4d4-aecda6b680b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:50.857545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf83cc3-014b-4dbf-a4d4-aecda6b680b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:50.858256 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf83cc3-014b-4dbf-a4d4-aecda6b680b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:50.860756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf83cc3-014b-4dbf-a4d4-aecda6b680b1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:50.882054 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:50.891420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1099/2193] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:50 2022] POST /identity/v3/projects => generated 397 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:50.895389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f2dff-757b-4b91-91bc-d0e4a28a405f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:50.905303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f2dff-757b-4b91-91bc-d0e4a28a405f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:50.909396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:50.963490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380af19-df64-414e-a66e-dff4ae5e95ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:50.964201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380af19-df64-414e-a66e-dff4ae5e95ef admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:50.964488 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380af19-df64-414e-a66e-dff4ae5e95ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:50.964770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380af19-df64-414e-a66e-dff4ae5e95ef admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:50.965460 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380af19-df64-414e-a66e-dff4ae5e95ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:50.967385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380af19-df64-414e-a66e-dff4ae5e95ef admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:50.988894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1095/2194] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:50 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:50.993071 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf83cc3-014b-4dbf-a4d4-aecda6b680b1 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:51.003526 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf83cc3-014b-4dbf-a4d4-aecda6b680b1 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:51.008366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec48ff-a454-4cb5-a0d5-70b709afff53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:51.009030 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec48ff-a454-4cb5-a0d5-70b709afff53 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:51.009348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec48ff-a454-4cb5-a0d5-70b709afff53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:51.009630 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec48ff-a454-4cb5-a0d5-70b709afff53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:51.010420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec48ff-a454-4cb5-a0d5-70b709afff53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:51.012081 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec48ff-a454-4cb5-a0d5-70b709afff53 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:51.022953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1100/2195] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:51.026796 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380af19-df64-414e-a66e-dff4ae5e95ef admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:51.037226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380af19-df64-414e-a66e-dff4ae5e95ef admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:51.042146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e86c11-1f81-4c83-8ae0-da7c2d0e61b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:51.042791 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e86c11-1f81-4c83-8ae0-da7c2d0e61b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:51.043079 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e86c11-1f81-4c83-8ae0-da7c2d0e61b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:51.043356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e86c11-1f81-4c83-8ae0-da7c2d0e61b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:51.044149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e86c11-1f81-4c83-8ae0-da7c2d0e61b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:51.045720 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e86c11-1f81-4c83-8ae0-da7c2d0e61b6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:51.055367 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1096/2196] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:51.059201 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec48ff-a454-4cb5-a0d5-70b709afff53 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:51.069193 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec48ff-a454-4cb5-a0d5-70b709afff53 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:51.073897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718a54f-7767-4811-865b-e871dff10532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:51.074710 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718a54f-7767-4811-865b-e871dff10532 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:51.074999 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718a54f-7767-4811-865b-e871dff10532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:51.075278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718a54f-7767-4811-865b-e871dff10532 admin admin] PATH_INFO: `/v3/projects/78a4947b3c7542ae93d487017362669d/users/5e90eba948bf4ba3bd9f44f2426da5ec/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:51.091658 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718a54f-7767-4811-865b-e871dff10532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a4947b3c7542ae93d487017362669d, user_id=5e90eba948bf4ba3bd9f44f2426da5ec, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:51.095001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718a54f-7767-4811-865b-e871dff10532 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:51.109392 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1101/2197] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:51 2022] PUT /identity/v3/projects/78a4947b3c7542ae93d487017362669d/users/5e90eba948bf4ba3bd9f44f2426da5ec/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:10:51.119824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea789e-6205-44a5-854f-ceca69d432b6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:51.120180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea789e-6205-44a5-854f-ceca69d432b6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:51.120468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea789e-6205-44a5-854f-ceca69d432b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:51.149186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-50ea789e-6205-44a5-854f-ceca69d432b6 None None] MFA Rules not processed for user `5e90eba948bf4ba3bd9f44f2426da5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:51.150419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-50ea789e-6205-44a5-854f-ceca69d432b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:51.240686 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1097/2198] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:51.252261 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718a54f-7767-4811-865b-e871dff10532 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:51.253975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f718a54f-7767-4811-865b-e871dff10532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:51.316825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718a54f-7767-4811-865b-e871dff10532 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:51.320477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7c04e-71eb-4ecd-84c4-e2d886d5ea7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:51.321121 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7c04e-71eb-4ecd-84c4-e2d886d5ea7b service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:51.321408 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7c04e-71eb-4ecd-84c4-e2d886d5ea7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:51.321690 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7c04e-71eb-4ecd-84c4-e2d886d5ea7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:51.331019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7c04e-71eb-4ecd-84c4-e2d886d5ea7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:51.332452 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7c04e-71eb-4ecd-84c4-e2d886d5ea7b service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:51.341131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1102/2199] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:54.738787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44176b46-0357-4b4d-a13b-3a2176c5b501 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:54.739239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44176b46-0357-4b4d-a13b-3a2176c5b501 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:54.739351 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44176b46-0357-4b4d-a13b-3a2176c5b501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:54.756623 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-44176b46-0357-4b4d-a13b-3a2176c5b501 None None] MFA Rules not processed for user `b6c5da324ab2405a84036db91a1366a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:54.757810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-44176b46-0357-4b4d-a13b-3a2176c5b501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:54.815730 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1098/2200] 10.222.0.73 () {58 vars in 1009 bytes} [Thu May 19 12:10:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:54.857980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7c04e-71eb-4ecd-84c4-e2d886d5ea7b service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:54.859442 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-95b7c04e-71eb-4ecd-84c4-e2d886d5ea7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:54.931219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7c04e-71eb-4ecd-84c4-e2d886d5ea7b service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:54.936586 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d3fb5-16ee-4ac5-bb7f-c287e84ce526 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371dae58e95d403b97e311c6616adab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:54.937273 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d3fb5-16ee-4ac5-bb7f-c287e84ce526 service swift] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:54.937562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d3fb5-16ee-4ac5-bb7f-c287e84ce526 service swift] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:54.937848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d3fb5-16ee-4ac5-bb7f-c287e84ce526 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:54.946361 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d3fb5-16ee-4ac5-bb7f-c287e84ce526 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:54.947981 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d3fb5-16ee-4ac5-bb7f-c287e84ce526 service swift] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:54.957231 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1103/2201] 10.222.0.73 () {60 vars in 1384 bytes} [Thu May 19 12:10:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:10:55.120329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44176b46-0357-4b4d-a13b-3a2176c5b501 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:55.121786 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-44176b46-0357-4b4d-a13b-3a2176c5b501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:55.162709 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:55.231111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44176b46-0357-4b4d-a13b-3a2176c5b501 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:55.231111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e499abd-697f-4caf-b838-14949a24f0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:55.231111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e499abd-697f-4caf-b838-14949a24f0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:55.231111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e499abd-697f-4caf-b838-14949a24f0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:55.232168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e499abd-697f-4caf-b838-14949a24f0d4 admin admin] PATH_INFO: `/v3/users/e551c8ab610a4c9eb5daf47da8fd29e8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:55.232168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e499abd-697f-4caf-b838-14949a24f0d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e551c8ab610a4c9eb5daf47da8fd29e8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:55.233704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e499abd-697f-4caf-b838-14949a24f0d4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:55.304389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3e499abd-697f-4caf-b838-14949a24f0d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e551c8ab610a4c9eb5daf47da8fd29e8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:55.312878 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3e499abd-697f-4caf-b838-14949a24f0d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e551c8ab610a4c9eb5daf47da8fd29e8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:55.321852 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3e499abd-697f-4caf-b838-14949a24f0d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e551c8ab610a4c9eb5daf47da8fd29e8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:55.322556 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3e499abd-697f-4caf-b838-14949a24f0d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e551c8ab610a4c9eb5daf47da8fd29e8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:55.323210 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3e499abd-697f-4caf-b838-14949a24f0d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e551c8ab610a4c9eb5daf47da8fd29e8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:55.347022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1099/2202] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:55 2022] DELETE /identity/v3/users/e551c8ab610a4c9eb5daf47da8fd29e8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:55.351333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfede832-8b00-496f-b1b0-35a92d73cad7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:55.351635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfede832-8b00-496f-b1b0-35a92d73cad7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:55.352347 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfede832-8b00-496f-b1b0-35a92d73cad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:55.407135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-dfede832-8b00-496f-b1b0-35a92d73cad7 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:55.408687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-dfede832-8b00-496f-b1b0-35a92d73cad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:55.548157 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:55.569385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1104/2203] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:55.579682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e499abd-697f-4caf-b838-14949a24f0d4 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:55.581175 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3e499abd-697f-4caf-b838-14949a24f0d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:55.630200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a13e8-783b-4ade-b747-4e3b8fcaefac None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:55.631021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a13e8-783b-4ade-b747-4e3b8fcaefac None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:55.631021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a13e8-783b-4ade-b747-4e3b8fcaefac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:55.649144 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-996a13e8-783b-4ade-b747-4e3b8fcaefac None None] MFA Rules not processed for user `b6c5da324ab2405a84036db91a1366a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:55.650409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-996a13e8-783b-4ade-b747-4e3b8fcaefac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:55.656044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e499abd-697f-4caf-b838-14949a24f0d4 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:55.660377 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ac097-e803-4456-a200-920ece7c84de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:55.661045 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ac097-e803-4456-a200-920ece7c84de service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:55.661333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ac097-e803-4456-a200-920ece7c84de service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:55.661614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ac097-e803-4456-a200-920ece7c84de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:55.672957 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ac097-e803-4456-a200-920ece7c84de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:55.674823 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ac097-e803-4456-a200-920ece7c84de service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:55.688717 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1100/2204] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:55.724474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1105/2205] 10.222.0.73 () {58 vars in 967 bytes} [Thu May 19 12:10:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:55.737993 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ac097-e803-4456-a200-920ece7c84de service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:55.739738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-119ac097-e803-4456-a200-920ece7c84de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:55.802537 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:55.844942 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ac097-e803-4456-a200-920ece7c84de service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:55.850989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc73869-f139-43e1-ac6f-aedcea731ae2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371dae58e95d403b97e311c6616adab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:55.851418 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc73869-f139-43e1-ac6f-aedcea731ae2 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:55.851766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc73869-f139-43e1-ac6f-aedcea731ae2 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:55.852133 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc73869-f139-43e1-ac6f-aedcea731ae2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:55.863458 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc73869-f139-43e1-ac6f-aedcea731ae2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:55.865881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc73869-f139-43e1-ac6f-aedcea731ae2 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:55.878038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1101/2206] 10.222.0.73 () {60 vars in 1384 bytes} [Thu May 19 12:10:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:10:55.910313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a13e8-783b-4ade-b747-4e3b8fcaefac None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:55.911786 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-996a13e8-783b-4ade-b747-4e3b8fcaefac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:55.929659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a13e8-783b-4ade-b747-4e3b8fcaefac None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:55.935212 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004fd89-f128-4b80-be29-81016e05bbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:55.936135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004fd89-f128-4b80-be29-81016e05bbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:55.936588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004fd89-f128-4b80-be29-81016e05bbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:55.937219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004fd89-f128-4b80-be29-81016e05bbee admin admin] PATH_INFO: `/v3/users/742acbf02db44496afd7dafdb7ca0091` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:55.938848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004fd89-f128-4b80-be29-81016e05bbee admin admin] RBAC: Authorizing `identity:delete_user(user_id=742acbf02db44496afd7dafdb7ca0091)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:55.941142 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004fd89-f128-4b80-be29-81016e05bbee admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:55.978218 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc73869-f139-43e1-ac6f-aedcea731ae2 service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:55.980807 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3dc73869-f139-43e1-ac6f-aedcea731ae2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:56.008431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9004fd89-f128-4b80-be29-81016e05bbee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742acbf02db44496afd7dafdb7ca0091'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:56.009239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9004fd89-f128-4b80-be29-81016e05bbee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742acbf02db44496afd7dafdb7ca0091'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:56.016491 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc73869-f139-43e1-ac6f-aedcea731ae2 service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:56.022953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9004fd89-f128-4b80-be29-81016e05bbee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742acbf02db44496afd7dafdb7ca0091'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:56.027954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9756a-4379-40db-8024-700ff2e45475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:56.029168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9756a-4379-40db-8024-700ff2e45475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.029451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9756a-4379-40db-8024-700ff2e45475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.029859 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9756a-4379-40db-8024-700ff2e45475 admin admin] PATH_INFO: `/v3/projects/be4e8c5f31b24095a147e1d5509a360c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.032427 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9756a-4379-40db-8024-700ff2e45475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be4e8c5f31b24095a147e1d5509a360c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:56.032683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9004fd89-f128-4b80-be29-81016e05bbee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742acbf02db44496afd7dafdb7ca0091'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:56.034832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9756a-4379-40db-8024-700ff2e45475 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:56.051850 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9004fd89-f128-4b80-be29-81016e05bbee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742acbf02db44496afd7dafdb7ca0091'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:56.058824 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1106/2207] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:55 2022] DELETE /identity/v3/users/742acbf02db44496afd7dafdb7ca0091 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:56.101958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2cb9756a-4379-40db-8024-700ff2e45475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be4e8c5f31b24095a147e1d5509a360c', 'request_id': 'req-2cb9756a-4379-40db-8024-700ff2e45475'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:56.110713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2cb9756a-4379-40db-8024-700ff2e45475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be4e8c5f31b24095a147e1d5509a360c', 'request_id': 'req-2cb9756a-4379-40db-8024-700ff2e45475'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:56.119036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2cb9756a-4379-40db-8024-700ff2e45475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be4e8c5f31b24095a147e1d5509a360c', 'request_id': 'req-2cb9756a-4379-40db-8024-700ff2e45475'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:56.133260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2cb9756a-4379-40db-8024-700ff2e45475 admin admin] The token cache is being invalidate because project be4e8c5f31b24095a147e1d5509a360c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:56.133964 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2cb9756a-4379-40db-8024-700ff2e45475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:56.134995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2cb9756a-4379-40db-8024-700ff2e45475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:56.141028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1102/2208] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:55 2022] DELETE /identity/v3/projects/be4e8c5f31b24095a147e1d5509a360c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:56.142848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9cd5-3ca5-4b4d-94bf-0c3f00983a99 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.143197 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9cd5-3ca5-4b4d-94bf-0c3f00983a99 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.143574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9cd5-3ca5-4b4d-94bf-0c3f00983a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.165101 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-446d9cd5-3ca5-4b4d-94bf-0c3f00983a99 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:56.166544 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-446d9cd5-3ca5-4b4d-94bf-0c3f00983a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:56.176224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c840c34-45ce-4fce-916f-53a1a02b0669 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.176493 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c840c34-45ce-4fce-916f-53a1a02b0669 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.176775 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c840c34-45ce-4fce-916f-53a1a02b0669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.200414 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5c840c34-45ce-4fce-916f-53a1a02b0669 None None] MFA Rules not processed for user `b6c5da324ab2405a84036db91a1366a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:56.202146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5c840c34-45ce-4fce-916f-53a1a02b0669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:56.242778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1107/2209] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:56.249378 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9cd5-3ca5-4b4d-94bf-0c3f00983a99 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:56.251574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-446d9cd5-3ca5-4b4d-94bf-0c3f00983a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:56.263962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1103/2210] 10.222.0.73 () {58 vars in 1009 bytes} [Thu May 19 12:10:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:56.264749 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d9cd5-3ca5-4b4d-94bf-0c3f00983a99 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:56.265248 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebae4de-1f42-4c9b-a205-9bef2112b665 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.265544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebae4de-1f42-4c9b-a205-9bef2112b665 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.265825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebae4de-1f42-4c9b-a205-9bef2112b665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.284194 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:56.285479 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9ebae4de-1f42-4c9b-a205-9bef2112b665 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:56.286959 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9ebae4de-1f42-4c9b-a205-9bef2112b665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:56.287779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.288263 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.288697 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0 admin admin] PATH_INFO: `/v3/projects/7a4583d722934c65ac491706596c5538` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.290214 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a4583d722934c65ac491706596c5538)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:56.292261 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:56.295437 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1104/2211] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:56.296203 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebae4de-1f42-4c9b-a205-9bef2112b665 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:56.298006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9ebae4de-1f42-4c9b-a205-9bef2112b665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:56.304664 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:56.342318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a4583d722934c65ac491706596c5538', 'request_id': 'req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:56.350883 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a4583d722934c65ac491706596c5538', 'request_id': 'req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:56.353173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:56.357815 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a4583d722934c65ac491706596c5538', 'request_id': 'req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:56.369750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0 admin admin] The token cache is being invalidate because project 7a4583d722934c65ac491706596c5538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:56.370056 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:56.370718 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:56.376448 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebae4de-1f42-4c9b-a205-9bef2112b665 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:56.376585 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1108/2212] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:56 2022] DELETE /identity/v3/projects/7a4583d722934c65ac491706596c5538 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:56.377048 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:56.379066 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:56.435583 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a32e2-2e98-4527-a97a-778cace7f5ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371dae58e95d403b97e311c6616adab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:56.436187 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a32e2-2e98-4527-a97a-778cace7f5ec service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.436497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a32e2-2e98-4527-a97a-778cace7f5ec service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.436776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a32e2-2e98-4527-a97a-778cace7f5ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.439292 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dc5a32e2-2e98-4527-a97a-778cace7f5ec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:56.455650 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a415e-b1d0-48d4-b36b-5dad18fe9ca0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:56.460456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467b3f4-92e7-4d34-828f-46bf2e5d5ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:56.461147 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467b3f4-92e7-4d34-828f-46bf2e5d5ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.461454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467b3f4-92e7-4d34-828f-46bf2e5d5ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.461758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467b3f4-92e7-4d34-828f-46bf2e5d5ac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.462489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467b3f4-92e7-4d34-828f-46bf2e5d5ac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:10:56.462800 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467b3f4-92e7-4d34-828f-46bf2e5d5ac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:56.464484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467b3f4-92e7-4d34-828f-46bf2e5d5ac7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:56.476161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1109/2213] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:10:56.477549 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce13129-9fc9-4dee-852d-268b24eacaaf None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.477844 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce13129-9fc9-4dee-852d-268b24eacaaf None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.478126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce13129-9fc9-4dee-852d-268b24eacaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.499385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a32e2-2e98-4527-a97a-778cace7f5ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:56.501657 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a32e2-2e98-4527-a97a-778cace7f5ec service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:56.509786 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1105/2214] 10.222.0.73 () {60 vars in 1384 bytes} [Thu May 19 12:10:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:10:56.510551 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a32e2-2e98-4527-a97a-778cace7f5ec service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:56.544073 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6ce13129-9fc9-4dee-852d-268b24eacaaf None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:56.546064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6ce13129-9fc9-4dee-852d-268b24eacaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:56.570542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a32e2-2e98-4527-a97a-778cace7f5ec service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:56.575673 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41215392-916d-4619-81d7-cdbdc058e2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:56.576108 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1110/2215] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:56.576533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41215392-916d-4619-81d7-cdbdc058e2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.576820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41215392-916d-4619-81d7-cdbdc058e2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.577097 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41215392-916d-4619-81d7-cdbdc058e2c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.577834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41215392-916d-4619-81d7-cdbdc058e2c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:56.579755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41215392-916d-4619-81d7-cdbdc058e2c2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:56.585521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ec554-085e-480e-bb71-eef6b35dfc7d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.586080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ec554-085e-480e-bb71-eef6b35dfc7d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.586380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ec554-085e-480e-bb71-eef6b35dfc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.610515 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-dd2ec554-085e-480e-bb71-eef6b35dfc7d None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:56.611848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-dd2ec554-085e-480e-bb71-eef6b35dfc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:56.619498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1106/2216] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:56 2022] POST /identity/v3/projects => generated 361 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:56.624372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41215392-916d-4619-81d7-cdbdc058e2c2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:56.630687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1111/2217] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:10:56.634985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ec554-085e-480e-bb71-eef6b35dfc7d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:56.649165 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ec554-085e-480e-bb71-eef6b35dfc7d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:56.670073 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:56.686747 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:56.721220 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41215392-916d-4619-81d7-cdbdc058e2c2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:56.726787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59347e1-8c48-44c7-b4d4-45889fcc83ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:56.726929 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b02f78-217e-48c6-a1a5-e46d8950d16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:56.727519 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b02f78-217e-48c6-a1a5-e46d8950d16e admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.727630 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59347e1-8c48-44c7-b4d4-45889fcc83ae admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.727808 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59347e1-8c48-44c7-b4d4-45889fcc83ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.727904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b02f78-217e-48c6-a1a5-e46d8950d16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.728108 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b02f78-217e-48c6-a1a5-e46d8950d16e admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.728201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59347e1-8c48-44c7-b4d4-45889fcc83ae admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.728805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59347e1-8c48-44c7-b4d4-45889fcc83ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:56.728920 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b02f78-217e-48c6-a1a5-e46d8950d16e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:10:56.729162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b02f78-217e-48c6-a1a5-e46d8950d16e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:56.730756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b02f78-217e-48c6-a1a5-e46d8950d16e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:56.738094 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59347e1-8c48-44c7-b4d4-45889fcc83ae admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:56.745511 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1112/2218] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:10:56.752359 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b02f78-217e-48c6-a1a5-e46d8950d16e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:56.767740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b02f78-217e-48c6-a1a5-e46d8950d16e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:56.773649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf73f52-49bd-4464-aee9-4ddcd69471eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:56.774384 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf73f52-49bd-4464-aee9-4ddcd69471eb admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.774706 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf73f52-49bd-4464-aee9-4ddcd69471eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.775017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf73f52-49bd-4464-aee9-4ddcd69471eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.775811 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf73f52-49bd-4464-aee9-4ddcd69471eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:56.778076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf73f52-49bd-4464-aee9-4ddcd69471eb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:56.780805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1107/2219] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:56 2022] POST /identity/v3/users => generated 281 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:56.784891 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59347e1-8c48-44c7-b4d4-45889fcc83ae admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:56.797833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59347e1-8c48-44c7-b4d4-45889fcc83ae admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:56.804309 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be372e4-e25f-4f59-a89a-898af30dc219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:56.805005 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be372e4-e25f-4f59-a89a-898af30dc219 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.805316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be372e4-e25f-4f59-a89a-898af30dc219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.805597 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be372e4-e25f-4f59-a89a-898af30dc219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.806391 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be372e4-e25f-4f59-a89a-898af30dc219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:56.808247 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be372e4-e25f-4f59-a89a-898af30dc219 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:56.820956 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1113/2220] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:56 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:56.824868 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf73f52-49bd-4464-aee9-4ddcd69471eb admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:56.825807 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1108/2221] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:56.830053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be372e4-e25f-4f59-a89a-898af30dc219 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:56.843603 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be372e4-e25f-4f59-a89a-898af30dc219 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:56.913199 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf73f52-49bd-4464-aee9-4ddcd69471eb admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:56.919155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c9cce-2ca9-46aa-a62b-99ee73b9cedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:56.919833 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c9cce-2ca9-46aa-a62b-99ee73b9cedd admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.920544 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c9cce-2ca9-46aa-a62b-99ee73b9cedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.920835 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c9cce-2ca9-46aa-a62b-99ee73b9cedd admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.922365 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c9cce-2ca9-46aa-a62b-99ee73b9cedd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:56.930914 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c9cce-2ca9-46aa-a62b-99ee73b9cedd admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:56.931022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb2eb6-3dd1-4868-a01a-d04713e7d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:56.931022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb2eb6-3dd1-4868-a01a-d04713e7d4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.931022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb2eb6-3dd1-4868-a01a-d04713e7d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.931022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb2eb6-3dd1-4868-a01a-d04713e7d4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.931319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb2eb6-3dd1-4868-a01a-d04713e7d4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:56.931319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb2eb6-3dd1-4868-a01a-d04713e7d4e6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:56.945880 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1109/2222] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:10:56.946653 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb2eb6-3dd1-4868-a01a-d04713e7d4e6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:56.952128 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1114/2223] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:56 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:10:56.953850 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c9cce-2ca9-46aa-a62b-99ee73b9cedd admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:56.957567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb2eb6-3dd1-4868-a01a-d04713e7d4e6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:56.963570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc5142-f3f2-43c3-bb22-2d214855e481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:56.964124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c9cce-2ca9-46aa-a62b-99ee73b9cedd admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:56.964625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc5142-f3f2-43c3-bb22-2d214855e481 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.964999 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc5142-f3f2-43c3-bb22-2d214855e481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.965347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc5142-f3f2-43c3-bb22-2d214855e481 admin admin] PATH_INFO: `/v3/projects/d13b114bf0a740de8526bfad6408a7fc/users/9a88fd15674f478a9121afb736d8f83d/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.969244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242e04d-afdc-449d-a39c-b568735a3ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:56.970014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242e04d-afdc-449d-a39c-b568735a3ace admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.970298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242e04d-afdc-449d-a39c-b568735a3ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.970562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242e04d-afdc-449d-a39c-b568735a3ace admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.971344 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242e04d-afdc-449d-a39c-b568735a3ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:56.973082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242e04d-afdc-449d-a39c-b568735a3ace admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:56.982194 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc5142-f3f2-43c3-bb22-2d214855e481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d13b114bf0a740de8526bfad6408a7fc, user_id=9a88fd15674f478a9121afb736d8f83d, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:56.985150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1115/2224] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:56.985475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc5142-f3f2-43c3-bb22-2d214855e481 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:56.986356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e1fb8-026e-4cb8-82cf-4f1962b0d7b7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:56.986648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e1fb8-026e-4cb8-82cf-4f1962b0d7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:56.986959 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e1fb8-026e-4cb8-82cf-4f1962b0d7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:56.998288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1110/2225] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:56 2022] PUT /identity/v3/projects/d13b114bf0a740de8526bfad6408a7fc/users/9a88fd15674f478a9121afb736d8f83d/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:56.999595 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc5142-f3f2-43c3-bb22-2d214855e481 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:57.006158 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f64e1fb8-026e-4cb8-82cf-4f1962b0d7b7 None None] MFA Rules not processed for user `b6c5da324ab2405a84036db91a1366a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:57.007366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f64e1fb8-026e-4cb8-82cf-4f1962b0d7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:57.062879 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc5142-f3f2-43c3-bb22-2d214855e481 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:57.067645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a1149-2fc7-45d2-8290-8b54c946d3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:57.068361 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a1149-2fc7-45d2-8290-8b54c946d3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:57.068633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a1149-2fc7-45d2-8290-8b54c946d3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:57.068911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a1149-2fc7-45d2-8290-8b54c946d3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:57.069665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a1149-2fc7-45d2-8290-8b54c946d3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:57.071260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a1149-2fc7-45d2-8290-8b54c946d3f5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:57.073594 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:57.082111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1111/2226] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:57.082663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1116/2227] 10.222.0.73 () {58 vars in 967 bytes} [Thu May 19 12:10:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:57.085685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb605d19-5422-45d1-abdd-53bc04e89495 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:57.086034 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb605d19-5422-45d1-abdd-53bc04e89495 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:57.086365 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb605d19-5422-45d1-abdd-53bc04e89495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:57.086833 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e1fb8-026e-4cb8-82cf-4f1962b0d7b7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:57.098583 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e1fb8-026e-4cb8-82cf-4f1962b0d7b7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:57.103214 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689b4ac-db03-4498-b6f4-d3d81c0d3d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:57.104123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689b4ac-db03-4498-b6f4-d3d81c0d3d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:57.104403 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689b4ac-db03-4498-b6f4-d3d81c0d3d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:57.104677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689b4ac-db03-4498-b6f4-d3d81c0d3d82 admin admin] PATH_INFO: `/v3/projects/072c0221130e445f974fdcbf289c79d8/users/28ab60df0ab542279092f80971a74204/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:57.114072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bb605d19-5422-45d1-abdd-53bc04e89495 None None] MFA Rules not processed for user `9a88fd15674f478a9121afb736d8f83d`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:57.115330 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bb605d19-5422-45d1-abdd-53bc04e89495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:57.119328 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689b4ac-db03-4498-b6f4-d3d81c0d3d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=072c0221130e445f974fdcbf289c79d8, user_id=28ab60df0ab542279092f80971a74204, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:57.122048 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689b4ac-db03-4498-b6f4-d3d81c0d3d82 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:57.124715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:57.139145 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1117/2228] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:57 2022] PUT /identity/v3/projects/072c0221130e445f974fdcbf289c79d8/users/28ab60df0ab542279092f80971a74204/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:57.140011 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689b4ac-db03-4498-b6f4-d3d81c0d3d82 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:57.142297 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2689b4ac-db03-4498-b6f4-d3d81c0d3d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:57.190171 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1112/2229] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:57.198635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56155ec-b38a-41d3-83ea-187084e26a57 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:57.199177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56155ec-b38a-41d3-83ea-187084e26a57 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:57.199465 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56155ec-b38a-41d3-83ea-187084e26a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:57.222640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c56155ec-b38a-41d3-83ea-187084e26a57 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:57.223836 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c56155ec-b38a-41d3-83ea-187084e26a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:57.227782 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689b4ac-db03-4498-b6f4-d3d81c0d3d82 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:57.232808 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bfa8d-53a2-43e0-a299-f7b9d8a523c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371dae58e95d403b97e311c6616adab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:57.233463 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bfa8d-53a2-43e0-a299-f7b9d8a523c2 service swift] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:57.233750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bfa8d-53a2-43e0-a299-f7b9d8a523c2 service swift] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:57.234081 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bfa8d-53a2-43e0-a299-f7b9d8a523c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:57.282835 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1113/2230] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:57.283484 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56155ec-b38a-41d3-83ea-187084e26a57 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:57.284776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c56155ec-b38a-41d3-83ea-187084e26a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:57.295282 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bfa8d-53a2-43e0-a299-f7b9d8a523c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:57.297045 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bfa8d-53a2-43e0-a299-f7b9d8a523c2 service swift] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:57.305368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1118/2231] 10.222.0.73 () {60 vars in 1384 bytes} [Thu May 19 12:10:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:10:57.306165 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bfa8d-53a2-43e0-a299-f7b9d8a523c2 service swift] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:57.307484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-361bfa8d-53a2-43e0-a299-f7b9d8a523c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:57.350073 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56155ec-b38a-41d3-83ea-187084e26a57 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:57.354336 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e1c4c-342a-4ec8-a02e-0b102881c571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:57.355070 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e1c4c-342a-4ec8-a02e-0b102881c571 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:57.355425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e1c4c-342a-4ec8-a02e-0b102881c571 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:57.355828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e1c4c-342a-4ec8-a02e-0b102881c571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:57.402129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bfa8d-53a2-43e0-a299-f7b9d8a523c2 service swift] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:57.406798 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b47259-9e7b-4128-b049-2178971c99a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:57.407522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b47259-9e7b-4128-b049-2178971c99a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:57.407873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b47259-9e7b-4128-b049-2178971c99a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:57.408317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b47259-9e7b-4128-b049-2178971c99a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:57.418635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b47259-9e7b-4128-b049-2178971c99a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:57.420423 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b47259-9e7b-4128-b049-2178971c99a7 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:57.425821 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:57.432142 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1119/2232] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:57.437941 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e1c4c-342a-4ec8-a02e-0b102881c571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:57.439331 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e1c4c-342a-4ec8-a02e-0b102881c571 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:57.448917 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1114/2233] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:57.464082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b47259-9e7b-4128-b049-2178971c99a7 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:57.475406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b47259-9e7b-4128-b049-2178971c99a7 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:57.481532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d18241-55c4-474d-93b1-b3b28d710bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:57.482582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d18241-55c4-474d-93b1-b3b28d710bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:57.482947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d18241-55c4-474d-93b1-b3b28d710bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:57.483350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d18241-55c4-474d-93b1-b3b28d710bb4 admin admin] PATH_INFO: `/v3/users/9a88fd15674f478a9121afb736d8f83d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:57.484900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d18241-55c4-474d-93b1-b3b28d710bb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a88fd15674f478a9121afb736d8f83d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:57.486847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d18241-55c4-474d-93b1-b3b28d710bb4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:57.557144 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-11d18241-55c4-474d-93b1-b3b28d710bb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a88fd15674f478a9121afb736d8f83d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:57.557835 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-11d18241-55c4-474d-93b1-b3b28d710bb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a88fd15674f478a9121afb736d8f83d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:57.568353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-11d18241-55c4-474d-93b1-b3b28d710bb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a88fd15674f478a9121afb736d8f83d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:57.576635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-11d18241-55c4-474d-93b1-b3b28d710bb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a88fd15674f478a9121afb736d8f83d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:57.596473 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-11d18241-55c4-474d-93b1-b3b28d710bb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a88fd15674f478a9121afb736d8f83d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:57.603659 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1120/2234] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:10:57 2022] DELETE /identity/v3/users/9a88fd15674f478a9121afb736d8f83d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:57.608561 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e418c9-497b-452a-8782-3e5ff297bff3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:57.608881 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e418c9-497b-452a-8782-3e5ff297bff3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:57.609164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e418c9-497b-452a-8782-3e5ff297bff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:57.628576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:57.636906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b1e418c9-497b-452a-8782-3e5ff297bff3 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:57.638808 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b1e418c9-497b-452a-8782-3e5ff297bff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:57.714202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1115/2235] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:57.725041 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d18241-55c4-474d-93b1-b3b28d710bb4 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:57.727652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-11d18241-55c4-474d-93b1-b3b28d710bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:57.813178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d18241-55c4-474d-93b1-b3b28d710bb4 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:57.830313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555a7a0-037f-4225-bc1a-d96d191053d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:57.831171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555a7a0-037f-4225-bc1a-d96d191053d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:57.831463 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555a7a0-037f-4225-bc1a-d96d191053d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:57.831744 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555a7a0-037f-4225-bc1a-d96d191053d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:57.844969 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555a7a0-037f-4225-bc1a-d96d191053d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:57.846418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555a7a0-037f-4225-bc1a-d96d191053d3 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:57.863835 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1121/2236] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:10:58.324929 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e418c9-497b-452a-8782-3e5ff297bff3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:58.326368 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b1e418c9-497b-452a-8782-3e5ff297bff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:58.349339 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e418c9-497b-452a-8782-3e5ff297bff3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:58.371750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de868f7-6165-4c32-90bd-60a0f2db193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:58.372665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de868f7-6165-4c32-90bd-60a0f2db193c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:58.372951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de868f7-6165-4c32-90bd-60a0f2db193c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:58.373228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de868f7-6165-4c32-90bd-60a0f2db193c admin admin] PATH_INFO: `/v3/projects/d13b114bf0a740de8526bfad6408a7fc` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:58.374586 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de868f7-6165-4c32-90bd-60a0f2db193c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d13b114bf0a740de8526bfad6408a7fc)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:58.376790 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de868f7-6165-4c32-90bd-60a0f2db193c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:58.485891 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9de868f7-6165-4c32-90bd-60a0f2db193c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd13b114bf0a740de8526bfad6408a7fc', 'request_id': 'req-9de868f7-6165-4c32-90bd-60a0f2db193c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:58.503837 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9de868f7-6165-4c32-90bd-60a0f2db193c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd13b114bf0a740de8526bfad6408a7fc', 'request_id': 'req-9de868f7-6165-4c32-90bd-60a0f2db193c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:58.516788 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9de868f7-6165-4c32-90bd-60a0f2db193c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd13b114bf0a740de8526bfad6408a7fc', 'request_id': 'req-9de868f7-6165-4c32-90bd-60a0f2db193c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:58.533280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9de868f7-6165-4c32-90bd-60a0f2db193c admin admin] The token cache is being invalidate because project d13b114bf0a740de8526bfad6408a7fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:10:58.534406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9de868f7-6165-4c32-90bd-60a0f2db193c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:58.534406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9de868f7-6165-4c32-90bd-60a0f2db193c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:10:58.536003 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1116/2237] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:10:58 2022] DELETE /identity/v3/projects/d13b114bf0a740de8526bfad6408a7fc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:58.541773 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b88d86-d0d6-44d9-98b2-1c511cf702a9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:58.542339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b88d86-d0d6-44d9-98b2-1c511cf702a9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:58.542339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b88d86-d0d6-44d9-98b2-1c511cf702a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:58.568243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-10b88d86-d0d6-44d9-98b2-1c511cf702a9 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:58.572324 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-10b88d86-d0d6-44d9-98b2-1c511cf702a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:58.654138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1122/2238] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:58.663289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecc1db-4282-41c4-b830-f68932796217 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:58.663584 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecc1db-4282-41c4-b830-f68932796217 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:58.663870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecc1db-4282-41c4-b830-f68932796217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:58.684375 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-92ecc1db-4282-41c4-b830-f68932796217 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:58.685774 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-92ecc1db-4282-41c4-b830-f68932796217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:58.697247 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1117/2239] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:58.701454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b88d86-d0d6-44d9-98b2-1c511cf702a9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:58.712850 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b88d86-d0d6-44d9-98b2-1c511cf702a9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:58.718020 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df1f1f-8d8f-4b7d-a199-997714975725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:58.719285 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df1f1f-8d8f-4b7d-a199-997714975725 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:58.719571 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df1f1f-8d8f-4b7d-a199-997714975725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:58.719863 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df1f1f-8d8f-4b7d-a199-997714975725 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:58.720661 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df1f1f-8d8f-4b7d-a199-997714975725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:10:58.721008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df1f1f-8d8f-4b7d-a199-997714975725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:58.722630 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df1f1f-8d8f-4b7d-a199-997714975725 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:58.736111 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1123/2240] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:10:58.740386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecc1db-4282-41c4-b830-f68932796217 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:58.753378 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecc1db-4282-41c4-b830-f68932796217 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:58.761885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e5677-744d-48df-a57e-52b35a87fd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:58.762789 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e5677-744d-48df-a57e-52b35a87fd09 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:58.763302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e5677-744d-48df-a57e-52b35a87fd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:58.763846 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e5677-744d-48df-a57e-52b35a87fd09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:58.765510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e5677-744d-48df-a57e-52b35a87fd09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:58.768004 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e5677-744d-48df-a57e-52b35a87fd09 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:58.808724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1118/2241] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:10:58 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:10:58.820854 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df1f1f-8d8f-4b7d-a199-997714975725 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:58.826158 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:58.840694 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df1f1f-8d8f-4b7d-a199-997714975725 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:58.906236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af0451-8683-4596-95b6-75509ff46877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:58.906914 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af0451-8683-4596-95b6-75509ff46877 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:58.907306 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af0451-8683-4596-95b6-75509ff46877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:58.907595 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af0451-8683-4596-95b6-75509ff46877 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:58.908429 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af0451-8683-4596-95b6-75509ff46877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:58.910455 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af0451-8683-4596-95b6-75509ff46877 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:58.932874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1124/2242] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:10:58 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:10:58.937455 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e5677-744d-48df-a57e-52b35a87fd09 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:58.948391 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e5677-744d-48df-a57e-52b35a87fd09 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:58.954714 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a2989-09a7-4ab3-80cc-78dcc0caf86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:58.955394 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2989-09a7-4ab3-80cc-78dcc0caf86b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:58.955696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2989-09a7-4ab3-80cc-78dcc0caf86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:58.955993 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2989-09a7-4ab3-80cc-78dcc0caf86b admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:58.956738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a2989-09a7-4ab3-80cc-78dcc0caf86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:58.958653 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a2989-09a7-4ab3-80cc-78dcc0caf86b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:58.972985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1119/2243] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:58.975211 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af0451-8683-4596-95b6-75509ff46877 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:58.987722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af0451-8683-4596-95b6-75509ff46877 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:58.993395 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ec9d6-cada-4e5b-967b-4532cf359898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:58.994280 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ec9d6-cada-4e5b-967b-4532cf359898 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:58.994647 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ec9d6-cada-4e5b-967b-4532cf359898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:58.994893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ec9d6-cada-4e5b-967b-4532cf359898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:58.995834 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ec9d6-cada-4e5b-967b-4532cf359898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:58.997502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ec9d6-cada-4e5b-967b-4532cf359898 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:59.009537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1125/2244] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:10:59.014016 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a2989-09a7-4ab3-80cc-78dcc0caf86b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:59.029896 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a2989-09a7-4ab3-80cc-78dcc0caf86b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:59.036812 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8d0ce-b008-4cf9-99ea-e76ad310a16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:59.037917 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8d0ce-b008-4cf9-99ea-e76ad310a16e admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:59.038324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8d0ce-b008-4cf9-99ea-e76ad310a16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:59.038611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8d0ce-b008-4cf9-99ea-e76ad310a16e admin admin] PATH_INFO: `/v3/projects/7ddcb47534db429c872fb835da308f53/users/8b3f130e67ed42df9194469e64e3f192/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:59.057217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8d0ce-b008-4cf9-99ea-e76ad310a16e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ddcb47534db429c872fb835da308f53, user_id=8b3f130e67ed42df9194469e64e3f192, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:59.060004 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8d0ce-b008-4cf9-99ea-e76ad310a16e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:59.078815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1120/2245] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:10:59 2022] PUT /identity/v3/projects/7ddcb47534db429c872fb835da308f53/users/8b3f130e67ed42df9194469e64e3f192/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:10:59.089528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04edf9-6357-475a-876b-766b2368b934 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:59.089830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04edf9-6357-475a-876b-766b2368b934 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:59.090157 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04edf9-6357-475a-876b-766b2368b934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:59.121361 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0a04edf9-6357-475a-876b-766b2368b934 None None] MFA Rules not processed for user `8b3f130e67ed42df9194469e64e3f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:10:59.122775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0a04edf9-6357-475a-876b-766b2368b934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:59.199839 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1126/2246] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:10:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:10:59.216573 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8d0ce-b008-4cf9-99ea-e76ad310a16e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:10:59.218891 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-07f8d0ce-b008-4cf9-99ea-e76ad310a16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:10:59.262249 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:10:59.311289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8d0ce-b008-4cf9-99ea-e76ad310a16e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:10:59.315191 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b47dd-d21c-4144-8af0-8e50a78696b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:10:59.315908 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b47dd-d21c-4144-8af0-8e50a78696b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:10:59.316226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b47dd-d21c-4144-8af0-8e50a78696b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:10:59.316506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b47dd-d21c-4144-8af0-8e50a78696b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:10:59.328976 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b47dd-d21c-4144-8af0-8e50a78696b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:10:59.334092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b47dd-d21c-4144-8af0-8e50a78696b5 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:10:59.341948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1121/2247] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:10:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:02.192503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a6a4f-3000-4cd6-93fb-da1ad847d665 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:02.193327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a6a4f-3000-4cd6-93fb-da1ad847d665 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:02.193327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a6a4f-3000-4cd6-93fb-da1ad847d665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:02.233415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8d2a6a4f-3000-4cd6-93fb-da1ad847d665 None None] MFA Rules not processed for user `28ab60df0ab542279092f80971a74204`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:02.235273 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8d2a6a4f-3000-4cd6-93fb-da1ad847d665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:02.274219 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b47dd-d21c-4144-8af0-8e50a78696b5 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:02.275736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0d9b47dd-d21c-4144-8af0-8e50a78696b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:02.314287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:02.319128 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1127/2248] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:02.333644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a6a4f-3000-4cd6-93fb-da1ad847d665 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:02.335188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8d2a6a4f-3000-4cd6-93fb-da1ad847d665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:02.363496 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b47dd-d21c-4144-8af0-8e50a78696b5 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:02.387839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce26970-0de4-4d5b-843a-c83edaecadd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:02.390391 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce26970-0de4-4d5b-843a-c83edaecadd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:02.390700 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce26970-0de4-4d5b-843a-c83edaecadd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:02.390986 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce26970-0de4-4d5b-843a-c83edaecadd2 admin admin] PATH_INFO: `/v3/users/c209b070f8454fa9921e4264621a5003` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:02.392605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce26970-0de4-4d5b-843a-c83edaecadd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c209b070f8454fa9921e4264621a5003)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:02.394628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce26970-0de4-4d5b-843a-c83edaecadd2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:02.488931 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9ce26970-0de4-4d5b-843a-c83edaecadd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c209b070f8454fa9921e4264621a5003'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:02.498558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a6a4f-3000-4cd6-93fb-da1ad847d665 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:02.503422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9ce26970-0de4-4d5b-843a-c83edaecadd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c209b070f8454fa9921e4264621a5003'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:02.507237 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0506d-ee32-4ef1-b640-dfba6ed78cf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:02.507948 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0506d-ee32-4ef1-b640-dfba6ed78cf4 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:02.508617 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0506d-ee32-4ef1-b640-dfba6ed78cf4 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:02.508923 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0506d-ee32-4ef1-b640-dfba6ed78cf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:02.517144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9ce26970-0de4-4d5b-843a-c83edaecadd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c209b070f8454fa9921e4264621a5003'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:02.519449 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9ce26970-0de4-4d5b-843a-c83edaecadd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c209b070f8454fa9921e4264621a5003'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:02.520318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9ce26970-0de4-4d5b-843a-c83edaecadd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c209b070f8454fa9921e4264621a5003'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:02.520882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0506d-ee32-4ef1-b640-dfba6ed78cf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:02.522735 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0506d-ee32-4ef1-b640-dfba6ed78cf4 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:02.535533 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1128/2249] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:11:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:11:02.554806 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1122/2250] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:11:02 2022] DELETE /identity/v3/users/c209b070f8454fa9921e4264621a5003 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:11:02.559155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61241d04-b5a6-469e-9418-01ed42c17fa3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:02.559530 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61241d04-b5a6-469e-9418-01ed42c17fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:02.559891 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61241d04-b5a6-469e-9418-01ed42c17fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:02.589533 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-61241d04-b5a6-469e-9418-01ed42c17fa3 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:02.593889 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-61241d04-b5a6-469e-9418-01ed42c17fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:02.689291 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1129/2251] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:02.706843 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce26970-0de4-4d5b-843a-c83edaecadd2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:02.708330 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9ce26970-0de4-4d5b-843a-c83edaecadd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:02.767266 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:02.771614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce26970-0de4-4d5b-843a-c83edaecadd2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:02.779872 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6b262-e8a3-428c-a87a-e804fe61f342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:02.780856 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6b262-e8a3-428c-a87a-e804fe61f342 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:02.781217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6b262-e8a3-428c-a87a-e804fe61f342 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:02.781628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6b262-e8a3-428c-a87a-e804fe61f342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:02.795457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6b262-e8a3-428c-a87a-e804fe61f342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:02.797499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6b262-e8a3-428c-a87a-e804fe61f342 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:02.809242 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1123/2252] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:03.212283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61241d04-b5a6-469e-9418-01ed42c17fa3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:03.214436 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-61241d04-b5a6-469e-9418-01ed42c17fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:03.233145 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61241d04-b5a6-469e-9418-01ed42c17fa3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:03.249012 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:03.251156 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:03.251607 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:03.252017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad admin admin] PATH_INFO: `/v3/projects/fbd650dea3ca494ab0784cf75c959d3c` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:03.254963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd650dea3ca494ab0784cf75c959d3c)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:03.260803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:03.372728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd650dea3ca494ab0784cf75c959d3c', 'request_id': 'req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:03.382695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd650dea3ca494ab0784cf75c959d3c', 'request_id': 'req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:03.396228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd650dea3ca494ab0784cf75c959d3c', 'request_id': 'req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:03.404160 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad admin admin] The token cache is being invalidate because project fbd650dea3ca494ab0784cf75c959d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:11:03.404460 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:03.405116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:03.407016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1130/2253] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:11:03 2022] DELETE /identity/v3/projects/fbd650dea3ca494ab0784cf75c959d3c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:03.411218 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6b262-e8a3-428c-a87a-e804fe61f342 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:03.425596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6b262-e8a3-428c-a87a-e804fe61f342 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:03.503668 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e937be5-2664-4e27-ae91-fbcb54487434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:03.504853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e937be5-2664-4e27-ae91-fbcb54487434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:03.505118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e937be5-2664-4e27-ae91-fbcb54487434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:03.506537 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e937be5-2664-4e27-ae91-fbcb54487434 admin admin] PATH_INFO: `/v3/users/8a6f1551d2a5493db42d183e326211f0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:03.509243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e937be5-2664-4e27-ae91-fbcb54487434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a6f1551d2a5493db42d183e326211f0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:03.513703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e937be5-2664-4e27-ae91-fbcb54487434 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:03.574992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e937be5-2664-4e27-ae91-fbcb54487434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a6f1551d2a5493db42d183e326211f0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:03.587371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e937be5-2664-4e27-ae91-fbcb54487434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a6f1551d2a5493db42d183e326211f0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:03.599290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e937be5-2664-4e27-ae91-fbcb54487434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a6f1551d2a5493db42d183e326211f0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:03.600477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e937be5-2664-4e27-ae91-fbcb54487434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a6f1551d2a5493db42d183e326211f0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:03.601580 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9e937be5-2664-4e27-ae91-fbcb54487434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a6f1551d2a5493db42d183e326211f0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:03.636279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1124/2254] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:11:03 2022] DELETE /identity/v3/users/8a6f1551d2a5493db42d183e326211f0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:03.912407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:03.913923 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:03.931326 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387cac1-58d8-4af9-bf07-dc7ce4a308ad admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:03.956404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:04.074993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b1c30-9387-457d-805f-2767f3014cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:04.076954 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1c30-9387-457d-805f-2767f3014cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:04.078432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1c30-9387-457d-805f-2767f3014cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:04.078953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1c30-9387-457d-805f-2767f3014cb2 admin admin] PATH_INFO: `/v3/users/36f307c010ef473e935d1dc2048b9edd` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:04.080835 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b1c30-9387-457d-805f-2767f3014cb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36f307c010ef473e935d1dc2048b9edd)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:04.084226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b1c30-9387-457d-805f-2767f3014cb2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:04.174317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-646b1c30-9387-457d-805f-2767f3014cb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f307c010ef473e935d1dc2048b9edd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:04.175111 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-646b1c30-9387-457d-805f-2767f3014cb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f307c010ef473e935d1dc2048b9edd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:04.192451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-646b1c30-9387-457d-805f-2767f3014cb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f307c010ef473e935d1dc2048b9edd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:04.206174 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-646b1c30-9387-457d-805f-2767f3014cb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f307c010ef473e935d1dc2048b9edd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:04.222236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-646b1c30-9387-457d-805f-2767f3014cb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f307c010ef473e935d1dc2048b9edd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:04.230219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1131/2255] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:11:03 2022] DELETE /identity/v3/users/36f307c010ef473e935d1dc2048b9edd => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:04.235439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f56c8e-b018-4771-be10-a27ffdd2c6cc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:04.235727 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f56c8e-b018-4771-be10-a27ffdd2c6cc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:04.236038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f56c8e-b018-4771-be10-a27ffdd2c6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:04.255950 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-58f56c8e-b018-4771-be10-a27ffdd2c6cc None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:04.256774 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-58f56c8e-b018-4771-be10-a27ffdd2c6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:04.339727 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1125/2256] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:04.351298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b1c30-9387-457d-805f-2767f3014cb2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:04.353366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-646b1c30-9387-457d-805f-2767f3014cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:04.449221 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b1c30-9387-457d-805f-2767f3014cb2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:04.453273 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877323b-2197-4895-b6f6-34ad2f204f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:04.454018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877323b-2197-4895-b6f6-34ad2f204f64 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:04.454390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877323b-2197-4895-b6f6-34ad2f204f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:04.454741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877323b-2197-4895-b6f6-34ad2f204f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:04.457287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f56c8e-b018-4771-be10-a27ffdd2c6cc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:04.460310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-58f56c8e-b018-4771-be10-a27ffdd2c6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:04.471581 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877323b-2197-4895-b6f6-34ad2f204f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:04.474463 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877323b-2197-4895-b6f6-34ad2f204f64 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:04.489382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1132/2257] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:04.505066 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f56c8e-b018-4771-be10-a27ffdd2c6cc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:04.510765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe738ec-a239-454e-8692-c72f01ca8e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:04.511906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe738ec-a239-454e-8692-c72f01ca8e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:04.512882 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe738ec-a239-454e-8692-c72f01ca8e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:04.512882 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe738ec-a239-454e-8692-c72f01ca8e73 admin admin] PATH_INFO: `/v3/projects/0f494de6b4a24d7f83bf64bf4e73c844` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:04.514425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe738ec-a239-454e-8692-c72f01ca8e73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f494de6b4a24d7f83bf64bf4e73c844)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:04.516932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe738ec-a239-454e-8692-c72f01ca8e73 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:04.529354 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:04.618524 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dbe738ec-a239-454e-8692-c72f01ca8e73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f494de6b4a24d7f83bf64bf4e73c844', 'request_id': 'req-dbe738ec-a239-454e-8692-c72f01ca8e73'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:04.636078 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dbe738ec-a239-454e-8692-c72f01ca8e73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f494de6b4a24d7f83bf64bf4e73c844', 'request_id': 'req-dbe738ec-a239-454e-8692-c72f01ca8e73'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:04.647795 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dbe738ec-a239-454e-8692-c72f01ca8e73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f494de6b4a24d7f83bf64bf4e73c844', 'request_id': 'req-dbe738ec-a239-454e-8692-c72f01ca8e73'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:04.666604 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dbe738ec-a239-454e-8692-c72f01ca8e73 admin admin] The token cache is being invalidate because project 0f494de6b4a24d7f83bf64bf4e73c844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:11:04.667263 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dbe738ec-a239-454e-8692-c72f01ca8e73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:04.668332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dbe738ec-a239-454e-8692-c72f01ca8e73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:04.672117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1126/2258] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:11:04 2022] DELETE /identity/v3/projects/0f494de6b4a24d7f83bf64bf4e73c844 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:04.676910 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3a196-915b-46d1-b910-3551ed90d4e9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:04.677209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3a196-915b-46d1-b910-3551ed90d4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:04.677496 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3a196-915b-46d1-b910-3551ed90d4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:04.715423 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3ba3a196-915b-46d1-b910-3551ed90d4e9 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:04.717774 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3ba3a196-915b-46d1-b910-3551ed90d4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:04.736874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe738ec-a239-454e-8692-c72f01ca8e73 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:04.738365 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dbe738ec-a239-454e-8692-c72f01ca8e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:04.776977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:04.839600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1133/2259] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:04.841372 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a3344-b5a2-4f5a-931c-0489091d9b13 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:04.841742 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a3344-b5a2-4f5a-931c-0489091d9b13 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:04.842099 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a3344-b5a2-4f5a-931c-0489091d9b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:04.853656 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe738ec-a239-454e-8692-c72f01ca8e73 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:04.859347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c65f3-9443-46ab-952e-aa971f88b5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:04.860438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c65f3-9443-46ab-952e-aa971f88b5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:04.860786 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c65f3-9443-46ab-952e-aa971f88b5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:04.861129 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c65f3-9443-46ab-952e-aa971f88b5e6 admin admin] PATH_INFO: `/v3/projects/6eaf5369cb0c409b956fd608f07381b7` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:04.862514 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c65f3-9443-46ab-952e-aa971f88b5e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eaf5369cb0c409b956fd608f07381b7)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:04.864652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c65f3-9443-46ab-952e-aa971f88b5e6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:04.869236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8c3a3344-b5a2-4f5a-931c-0489091d9b13 None None] MFA Rules not processed for user `28ab60df0ab542279092f80971a74204`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:04.870553 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8c3a3344-b5a2-4f5a-931c-0489091d9b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:04.929838 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8e3c65f3-9443-46ab-952e-aa971f88b5e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eaf5369cb0c409b956fd608f07381b7', 'request_id': 'req-8e3c65f3-9443-46ab-952e-aa971f88b5e6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:04.938935 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8e3c65f3-9443-46ab-952e-aa971f88b5e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eaf5369cb0c409b956fd608f07381b7', 'request_id': 'req-8e3c65f3-9443-46ab-952e-aa971f88b5e6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:04.953738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8e3c65f3-9443-46ab-952e-aa971f88b5e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eaf5369cb0c409b956fd608f07381b7', 'request_id': 'req-8e3c65f3-9443-46ab-952e-aa971f88b5e6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:04.955129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1134/2260] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:04.956519 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19aae5-22a0-4316-a4cf-b816ec4bf656 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:04.956828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19aae5-22a0-4316-a4cf-b816ec4bf656 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:04.957117 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19aae5-22a0-4316-a4cf-b816ec4bf656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:04.979535 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ab19aae5-22a0-4316-a4cf-b816ec4bf656 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:04.980898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ab19aae5-22a0-4316-a4cf-b816ec4bf656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:04.985059 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8e3c65f3-9443-46ab-952e-aa971f88b5e6 admin admin] The token cache is being invalidate because project 6eaf5369cb0c409b956fd608f07381b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:11:04.986485 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8e3c65f3-9443-46ab-952e-aa971f88b5e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:04.987656 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8e3c65f3-9443-46ab-952e-aa971f88b5e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:04.991593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1127/2261] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:11:04 2022] DELETE /identity/v3/projects/6eaf5369cb0c409b956fd608f07381b7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:05.003381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e6164-cf99-44cc-83a4-369c495db6c1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:05.003740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e6164-cf99-44cc-83a4-369c495db6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:05.004148 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e6164-cf99-44cc-83a4-369c495db6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:05.037819 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e48e6164-cf99-44cc-83a4-369c495db6c1 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:05.040710 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e48e6164-cf99-44cc-83a4-369c495db6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:05.073408 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:05.087520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1135/2262] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:05.092146 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19aae5-22a0-4316-a4cf-b816ec4bf656 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:05.103202 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19aae5-22a0-4316-a4cf-b816ec4bf656 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:05.116088 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f02d1-2015-4fa0-bdb3-2c3437fe8add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:05.116950 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f02d1-2015-4fa0-bdb3-2c3437fe8add admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:05.117368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f02d1-2015-4fa0-bdb3-2c3437fe8add admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:05.117760 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f02d1-2015-4fa0-bdb3-2c3437fe8add admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:05.118843 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f02d1-2015-4fa0-bdb3-2c3437fe8add admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:11:05.119184 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f02d1-2015-4fa0-bdb3-2c3437fe8add admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:05.120955 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f02d1-2015-4fa0-bdb3-2c3437fe8add admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:05.140920 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1136/2263] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:11:05.142086 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f02d1-2015-4fa0-bdb3-2c3437fe8add admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:05.152289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1128/2264] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:05.161285 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9e108-417e-4697-8fe3-a3ab6d812add None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:05.161467 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f02d1-2015-4fa0-bdb3-2c3437fe8add admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:05.162245 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9e108-417e-4697-8fe3-a3ab6d812add None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:05.163140 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9e108-417e-4697-8fe3-a3ab6d812add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:05.166583 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee551af1-9c25-469b-b4d0-c0388af6343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:05.167393 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee551af1-9c25-469b-b4d0-c0388af6343f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:05.167694 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee551af1-9c25-469b-b4d0-c0388af6343f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:05.167984 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee551af1-9c25-469b-b4d0-c0388af6343f admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:05.168782 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee551af1-9c25-469b-b4d0-c0388af6343f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:05.172106 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee551af1-9c25-469b-b4d0-c0388af6343f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:05.199507 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c7b9e108-417e-4697-8fe3-a3ab6d812add None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:05.201088 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c7b9e108-417e-4697-8fe3-a3ab6d812add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:05.208425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1137/2265] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:11:05 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:11:05.213921 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee551af1-9c25-469b-b4d0-c0388af6343f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:05.216171 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1129/2266] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:11:05.217454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9e108-417e-4697-8fe3-a3ab6d812add None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:05.229478 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9e108-417e-4697-8fe3-a3ab6d812add None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:05.281302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:05.316160 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee551af1-9c25-469b-b4d0-c0388af6343f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:05.328692 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4738e8-173d-4f40-916d-dd79f5c5dd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:05.329828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4738e8-173d-4f40-916d-dd79f5c5dd0b admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:05.330114 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4738e8-173d-4f40-916d-dd79f5c5dd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:05.330390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4738e8-173d-4f40-916d-dd79f5c5dd0b admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:05.331096 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4738e8-173d-4f40-916d-dd79f5c5dd0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:05.333074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4738e8-173d-4f40-916d-dd79f5c5dd0b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:05.338869 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735d4bd-f483-4d5d-98fa-f704b743265b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:05.339554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735d4bd-f483-4d5d-98fa-f704b743265b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:05.339838 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735d4bd-f483-4d5d-98fa-f704b743265b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:05.340134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735d4bd-f483-4d5d-98fa-f704b743265b admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:05.340872 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735d4bd-f483-4d5d-98fa-f704b743265b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:11:05.341176 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735d4bd-f483-4d5d-98fa-f704b743265b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:05.342816 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735d4bd-f483-4d5d-98fa-f704b743265b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:05.362154 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1130/2267] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:11:05.371587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735d4bd-f483-4d5d-98fa-f704b743265b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:05.385131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735d4bd-f483-4d5d-98fa-f704b743265b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:05.386010 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1138/2268] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:11:05 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:11:05.390492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed5cbb-29d7-43f9-b55d-b0a0278672bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:05.391167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed5cbb-29d7-43f9-b55d-b0a0278672bc admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:05.391471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed5cbb-29d7-43f9-b55d-b0a0278672bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:05.391652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4738e8-173d-4f40-916d-dd79f5c5dd0b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:05.391764 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed5cbb-29d7-43f9-b55d-b0a0278672bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:05.392457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed5cbb-29d7-43f9-b55d-b0a0278672bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:05.394440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed5cbb-29d7-43f9-b55d-b0a0278672bc admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:05.415206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4738e8-173d-4f40-916d-dd79f5c5dd0b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:05.422225 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202ff94-ff1d-4703-ad5e-7bfe0cb58059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:05.423058 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202ff94-ff1d-4703-ad5e-7bfe0cb58059 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:05.423484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202ff94-ff1d-4703-ad5e-7bfe0cb58059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:05.424075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202ff94-ff1d-4703-ad5e-7bfe0cb58059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:05.424658 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202ff94-ff1d-4703-ad5e-7bfe0cb58059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:05.426702 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202ff94-ff1d-4703-ad5e-7bfe0cb58059 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:05.440177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1131/2269] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:11:05 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:11:05.440310 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1139/2270] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:11:05.441441 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed5cbb-29d7-43f9-b55d-b0a0278672bc admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:05.442881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202ff94-ff1d-4703-ad5e-7bfe0cb58059 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:05.455744 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202ff94-ff1d-4703-ad5e-7bfe0cb58059 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:05.529684 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed5cbb-29d7-43f9-b55d-b0a0278672bc admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:05.536754 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232c300-5cb3-4149-9a37-e3d65d0ceed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:05.537384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232c300-5cb3-4149-9a37-e3d65d0ceed8 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:05.538470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232c300-5cb3-4149-9a37-e3d65d0ceed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:05.538470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232c300-5cb3-4149-9a37-e3d65d0ceed8 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:05.539052 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232c300-5cb3-4149-9a37-e3d65d0ceed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:05.541625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232c300-5cb3-4149-9a37-e3d65d0ceed8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:05.545694 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76ca35-7347-458c-8d5a-15de0a264805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:05.547088 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76ca35-7347-458c-8d5a-15de0a264805 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:05.547855 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76ca35-7347-458c-8d5a-15de0a264805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:05.548281 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76ca35-7347-458c-8d5a-15de0a264805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:05.549108 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76ca35-7347-458c-8d5a-15de0a264805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:05.551548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76ca35-7347-458c-8d5a-15de0a264805 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:05.572117 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1140/2271] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:11:05.572312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1132/2272] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:11:05 2022] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:11:05.582462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76ca35-7347-458c-8d5a-15de0a264805 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:05.584120 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232c300-5cb3-4149-9a37-e3d65d0ceed8 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:05.595873 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232c300-5cb3-4149-9a37-e3d65d0ceed8 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:05.603420 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49eb1d-0023-44c9-aff2-f35654355743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:05.604693 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49eb1d-0023-44c9-aff2-f35654355743 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:05.604979 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49eb1d-0023-44c9-aff2-f35654355743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:05.605263 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49eb1d-0023-44c9-aff2-f35654355743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:05.606087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49eb1d-0023-44c9-aff2-f35654355743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:05.606329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76ca35-7347-458c-8d5a-15de0a264805 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:05.607575 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49eb1d-0023-44c9-aff2-f35654355743 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:05.620619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b300a-3625-4f3a-9ee4-953629cf32b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:05.621881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b300a-3625-4f3a-9ee4-953629cf32b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:05.622365 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b300a-3625-4f3a-9ee4-953629cf32b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:05.622859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b300a-3625-4f3a-9ee4-953629cf32b8 admin admin] PATH_INFO: `/v3/projects/02d756683c004efa8a51fbb738376ad2/users/55f77ea5be9c45c7b32b608ad8c9d293/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:05.635611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1133/2273] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:11:05.641955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49eb1d-0023-44c9-aff2-f35654355743 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:05.657130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49eb1d-0023-44c9-aff2-f35654355743 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:05.662736 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b300a-3625-4f3a-9ee4-953629cf32b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d756683c004efa8a51fbb738376ad2, user_id=55f77ea5be9c45c7b32b608ad8c9d293, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:05.665887 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b300a-3625-4f3a-9ee4-953629cf32b8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:05.670865 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba132118-61b2-4b49-9310-8bd924c88550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:05.673432 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba132118-61b2-4b49-9310-8bd924c88550 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:05.674135 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba132118-61b2-4b49-9310-8bd924c88550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:05.674454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba132118-61b2-4b49-9310-8bd924c88550 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:05.675474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba132118-61b2-4b49-9310-8bd924c88550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:05.680403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba132118-61b2-4b49-9310-8bd924c88550 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:05.690220 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:05.697060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1141/2274] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:11:05 2022] PUT /identity/v3/projects/02d756683c004efa8a51fbb738376ad2/users/55f77ea5be9c45c7b32b608ad8c9d293/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:11:05.707141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51529180-497d-4be1-b246-6f07d70680c7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:05.707442 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51529180-497d-4be1-b246-6f07d70680c7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:05.708401 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51529180-497d-4be1-b246-6f07d70680c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:05.709002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1134/2275] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:11:05.714152 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba132118-61b2-4b49-9310-8bd924c88550 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:05.733529 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba132118-61b2-4b49-9310-8bd924c88550 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:05.768328 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-51529180-497d-4be1-b246-6f07d70680c7 None None] MFA Rules not processed for user `55f77ea5be9c45c7b32b608ad8c9d293`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:05.791973 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-51529180-497d-4be1-b246-6f07d70680c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:05.870843 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7a382-ccf7-4637-bb66-6c8615be4d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:05.872805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7a382-ccf7-4637-bb66-6c8615be4d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:05.873307 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7a382-ccf7-4637-bb66-6c8615be4d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:05.873787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7a382-ccf7-4637-bb66-6c8615be4d5e admin admin] PATH_INFO: `/v3/projects/efe1cb08dd7447caa0df0c1bb0db3df0/users/2c7904de685c471698350bfffe775e39/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:05.906411 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7a382-ccf7-4637-bb66-6c8615be4d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe1cb08dd7447caa0df0c1bb0db3df0, user_id=2c7904de685c471698350bfffe775e39, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:05.910358 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7a382-ccf7-4637-bb66-6c8615be4d5e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:05.960383 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1135/2276] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:11:05 2022] PUT /identity/v3/projects/efe1cb08dd7447caa0df0c1bb0db3df0/users/2c7904de685c471698350bfffe775e39/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:05.988000 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f6390-fc50-4416-804c-e330c0939cd3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:05.988578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f6390-fc50-4416-804c-e330c0939cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:05.988860 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f6390-fc50-4416-804c-e330c0939cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:06.005318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1142/2277] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:11:06.009369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51529180-497d-4be1-b246-6f07d70680c7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:06.032947 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51529180-497d-4be1-b246-6f07d70680c7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:06.060170 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-4a9f6390-fc50-4416-804c-e330c0939cd3 None None] MFA Rules not processed for user `2c7904de685c471698350bfffe775e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:06.061679 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4a9f6390-fc50-4416-804c-e330c0939cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:06.091387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:06.187200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453f6a1-d477-4cfb-8c81-f9b891eada9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:06.189043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453f6a1-d477-4cfb-8c81-f9b891eada9c admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:06.190315 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453f6a1-d477-4cfb-8c81-f9b891eada9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:06.190811 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453f6a1-d477-4cfb-8c81-f9b891eada9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:06.192574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453f6a1-d477-4cfb-8c81-f9b891eada9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:06.196886 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453f6a1-d477-4cfb-8c81-f9b891eada9c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:06.224521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1136/2278] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:11:06.229548 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f6390-fc50-4416-804c-e330c0939cd3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:06.231212 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4a9f6390-fc50-4416-804c-e330c0939cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:06.246785 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f6390-fc50-4416-804c-e330c0939cd3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:06.249090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1143/2279] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:11:06 2022] POST /identity/v3/projects => generated 383 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:11:06.253389 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453f6a1-d477-4cfb-8c81-f9b891eada9c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:06.255415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4453f6a1-d477-4cfb-8c81-f9b891eada9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:06.386439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c17080-a7a7-41f1-a3fa-a2407b1be2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:06.387439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c17080-a7a7-41f1-a3fa-a2407b1be2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:06.387954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c17080-a7a7-41f1-a3fa-a2407b1be2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:06.388360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c17080-a7a7-41f1-a3fa-a2407b1be2a6 admin admin] PATH_INFO: `/v3/users/5e90eba948bf4ba3bd9f44f2426da5ec` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:06.390994 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c17080-a7a7-41f1-a3fa-a2407b1be2a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e90eba948bf4ba3bd9f44f2426da5ec)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:06.394955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c17080-a7a7-41f1-a3fa-a2407b1be2a6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:06.429544 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453f6a1-d477-4cfb-8c81-f9b891eada9c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:06.453456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23dada-89fd-4cbe-b7ab-4d1fefbf0a92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:06.454696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:06.454827 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23dada-89fd-4cbe-b7ab-4d1fefbf0a92 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:06.455034 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23dada-89fd-4cbe-b7ab-4d1fefbf0a92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:06.456522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23dada-89fd-4cbe-b7ab-4d1fefbf0a92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:06.523845 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-54c17080-a7a7-41f1-a3fa-a2407b1be2a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e90eba948bf4ba3bd9f44f2426da5ec'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:06.543303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-54c17080-a7a7-41f1-a3fa-a2407b1be2a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e90eba948bf4ba3bd9f44f2426da5ec'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:06.574512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-54c17080-a7a7-41f1-a3fa-a2407b1be2a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e90eba948bf4ba3bd9f44f2426da5ec'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:06.575345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-54c17080-a7a7-41f1-a3fa-a2407b1be2a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e90eba948bf4ba3bd9f44f2426da5ec'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:06.576176 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-54c17080-a7a7-41f1-a3fa-a2407b1be2a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e90eba948bf4ba3bd9f44f2426da5ec'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:06.587782 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23dada-89fd-4cbe-b7ab-4d1fefbf0a92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:06.591951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23dada-89fd-4cbe-b7ab-4d1fefbf0a92 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:06.614145 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1144/2280] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:11:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:06.616071 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1137/2281] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:11:06 2022] DELETE /identity/v3/users/5e90eba948bf4ba3bd9f44f2426da5ec => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:06.616564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23dada-89fd-4cbe-b7ab-4d1fefbf0a92 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:06.622434 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109a092-fc05-4209-bbba-8dc987751930 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:06.623428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109a092-fc05-4209-bbba-8dc987751930 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:06.623428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109a092-fc05-4209-bbba-8dc987751930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:06.662353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23dada-89fd-4cbe-b7ab-4d1fefbf0a92 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:06.665801 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5109a092-fc05-4209-bbba-8dc987751930 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:06.667344 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5109a092-fc05-4209-bbba-8dc987751930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:06.797710 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8d1aa-39f1-4a80-a279-cd43abd386cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:06.799162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8d1aa-39f1-4a80-a279-cd43abd386cd admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:06.800706 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8d1aa-39f1-4a80-a279-cd43abd386cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:06.801041 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8d1aa-39f1-4a80-a279-cd43abd386cd admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:06.801784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8d1aa-39f1-4a80-a279-cd43abd386cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:06.809705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8d1aa-39f1-4a80-a279-cd43abd386cd admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:06.824672 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:06.842559 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1138/2282] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:06.850116 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109a092-fc05-4209-bbba-8dc987751930 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:06.852164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5109a092-fc05-4209-bbba-8dc987751930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:06.882355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1145/2283] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:11:06 2022] POST /identity/v3/users => generated 298 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:11:06.887732 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8d1aa-39f1-4a80-a279-cd43abd386cd admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:06.892395 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f2e8d1aa-39f1-4a80-a279-cd43abd386cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:06.929187 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8d1aa-39f1-4a80-a279-cd43abd386cd admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:06.962498 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342d153-d6c5-46f1-ad9e-c3a6587e0851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:06.963199 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342d153-d6c5-46f1-ad9e-c3a6587e0851 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:06.963490 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342d153-d6c5-46f1-ad9e-c3a6587e0851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:06.963775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342d153-d6c5-46f1-ad9e-c3a6587e0851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:06.964650 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342d153-d6c5-46f1-ad9e-c3a6587e0851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:06.966291 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342d153-d6c5-46f1-ad9e-c3a6587e0851 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:06.973631 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109a092-fc05-4209-bbba-8dc987751930 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:06.978911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22df5-bbab-4d40-ad8e-d67bcefbb2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:06.981611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22df5-bbab-4d40-ad8e-d67bcefbb2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:06.982120 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22df5-bbab-4d40-ad8e-d67bcefbb2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:06.982577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e22df5-bbab-4d40-ad8e-d67bcefbb2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:06.989384 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1146/2284] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:11:06.997385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342d153-d6c5-46f1-ad9e-c3a6587e0851 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:07.004500 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e22df5-bbab-4d40-ad8e-d67bcefbb2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:07.005985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e22df5-bbab-4d40-ad8e-d67bcefbb2b3 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:07.030413 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342d153-d6c5-46f1-ad9e-c3a6587e0851 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:07.038770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1139/2285] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:07.056817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57633ebb-130c-4a12-a61e-f3943e2f0ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:07.057838 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57633ebb-130c-4a12-a61e-f3943e2f0ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:07.058076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57633ebb-130c-4a12-a61e-f3943e2f0ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:07.058783 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57633ebb-130c-4a12-a61e-f3943e2f0ec8 admin admin] PATH_INFO: `/v3/projects/e58f30ac867d48cdac8dd4bb06b2ee01/users/6a4f0835ca1b40d4a4a6507f7fcc3faf/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:07.084575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57633ebb-130c-4a12-a61e-f3943e2f0ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58f30ac867d48cdac8dd4bb06b2ee01, user_id=6a4f0835ca1b40d4a4a6507f7fcc3faf, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:07.088269 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57633ebb-130c-4a12-a61e-f3943e2f0ec8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:07.120526 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1147/2286] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:11:06 2022] PUT /identity/v3/projects/e58f30ac867d48cdac8dd4bb06b2ee01/users/6a4f0835ca1b40d4a4a6507f7fcc3faf/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:07.125019 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22df5-bbab-4d40-ad8e-d67bcefbb2b3 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:07.137510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e22df5-bbab-4d40-ad8e-d67bcefbb2b3 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:07.222532 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:07.277107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5d597-6490-452d-9806-13559514f982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:07.278628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5d597-6490-452d-9806-13559514f982 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:07.279154 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5d597-6490-452d-9806-13559514f982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:07.279617 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5d597-6490-452d-9806-13559514f982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:07.281276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5d597-6490-452d-9806-13559514f982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:07.283603 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5d597-6490-452d-9806-13559514f982 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:07.301239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57633ebb-130c-4a12-a61e-f3943e2f0ec8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:07.309712 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1140/2287] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:11:07.315577 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57633ebb-130c-4a12-a61e-f3943e2f0ec8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:07.333762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf18d76-66ee-4692-a3b0-b0a85d0b238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:07.335547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf18d76-66ee-4692-a3b0-b0a85d0b238b admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:07.338572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf18d76-66ee-4692-a3b0-b0a85d0b238b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:07.339102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf18d76-66ee-4692-a3b0-b0a85d0b238b admin admin] PATH_INFO: `/v3/projects/e58f30ac867d48cdac8dd4bb06b2ee01/users/6a4f0835ca1b40d4a4a6507f7fcc3faf/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:07.346036 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf18d76-66ee-4692-a3b0-b0a85d0b238b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58f30ac867d48cdac8dd4bb06b2ee01, user_id=6a4f0835ca1b40d4a4a6507f7fcc3faf, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:07.351851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf18d76-66ee-4692-a3b0-b0a85d0b238b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:07.412718 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132aff1-957b-4083-b669-bb57cf86a5e1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:07.413302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132aff1-957b-4083-b669-bb57cf86a5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:07.413586 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132aff1-957b-4083-b669-bb57cf86a5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:07.415480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1148/2288] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:11:07 2022] PUT /identity/v3/projects/e58f30ac867d48cdac8dd4bb06b2ee01/users/6a4f0835ca1b40d4a4a6507f7fcc3faf/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:07.451317 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5132aff1-957b-4083-b669-bb57cf86a5e1 None None] MFA Rules not processed for user `6a4f0835ca1b40d4a4a6507f7fcc3faf`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:07.454126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5132aff1-957b-4083-b669-bb57cf86a5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:07.551568 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1141/2289] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:07.564494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf18d76-66ee-4692-a3b0-b0a85d0b238b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:07.566489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ccf18d76-66ee-4692-a3b0-b0a85d0b238b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:07.638016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf18d76-66ee-4692-a3b0-b0a85d0b238b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:07.642444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9ea3f-b4f6-4161-9a14-6fa27973d2eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:07.643373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9ea3f-b4f6-4161-9a14-6fa27973d2eb service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:07.643663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9ea3f-b4f6-4161-9a14-6fa27973d2eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:07.643967 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9ea3f-b4f6-4161-9a14-6fa27973d2eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:07.655247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9ea3f-b4f6-4161-9a14-6fa27973d2eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:07.657228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9ea3f-b4f6-4161-9a14-6fa27973d2eb service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:07.680216 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1149/2290] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:11:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:07.700486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132aff1-957b-4083-b669-bb57cf86a5e1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:07.702859 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5132aff1-957b-4083-b669-bb57cf86a5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:07.815164 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9ea3f-b4f6-4161-9a14-6fa27973d2eb service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:07.826454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9ea3f-b4f6-4161-9a14-6fa27973d2eb service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:07.845937 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235f372-e021-4122-a8aa-32d2a55ba7ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:07.847808 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235f372-e021-4122-a8aa-32d2a55ba7ca service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:07.848469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235f372-e021-4122-a8aa-32d2a55ba7ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:07.849851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235f372-e021-4122-a8aa-32d2a55ba7ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:07.854289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c235f372-e021-4122-a8aa-32d2a55ba7ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:07.891777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132aff1-957b-4083-b669-bb57cf86a5e1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:07.908481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac687c-d024-476e-aa2c-907d0153206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:07.909470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac687c-d024-476e-aa2c-907d0153206b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:07.909813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac687c-d024-476e-aa2c-907d0153206b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:07.910175 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac687c-d024-476e-aa2c-907d0153206b admin admin] PATH_INFO: `/v3/projects/78a4947b3c7542ae93d487017362669d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:07.911562 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac687c-d024-476e-aa2c-907d0153206b admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a4947b3c7542ae93d487017362669d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:07.913999 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac687c-d024-476e-aa2c-907d0153206b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:07.957792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235f372-e021-4122-a8aa-32d2a55ba7ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:07.959535 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235f372-e021-4122-a8aa-32d2a55ba7ca service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:07.972327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1150/2291] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:11:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:07.997508 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b6ac687c-d024-476e-aa2c-907d0153206b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a4947b3c7542ae93d487017362669d', 'request_id': 'req-b6ac687c-d024-476e-aa2c-907d0153206b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:08.006827 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:08.011204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b6ac687c-d024-476e-aa2c-907d0153206b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a4947b3c7542ae93d487017362669d', 'request_id': 'req-b6ac687c-d024-476e-aa2c-907d0153206b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:08.025946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b6ac687c-d024-476e-aa2c-907d0153206b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a4947b3c7542ae93d487017362669d', 'request_id': 'req-b6ac687c-d024-476e-aa2c-907d0153206b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:08.049816 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b6ac687c-d024-476e-aa2c-907d0153206b admin admin] The token cache is being invalidate because project 78a4947b3c7542ae93d487017362669d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:11:08.050220 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b6ac687c-d024-476e-aa2c-907d0153206b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:08.050939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b6ac687c-d024-476e-aa2c-907d0153206b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:08.064008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1142/2292] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:11:07 2022] DELETE /identity/v3/projects/78a4947b3c7542ae93d487017362669d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:08.978583 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235f372-e021-4122-a8aa-32d2a55ba7ca service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:08.997560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235f372-e021-4122-a8aa-32d2a55ba7ca service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:09.057496 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:09.081738 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ddd09-a0c8-4e11-8ca8-3a37fabbc4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:09.082644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ddd09-a0c8-4e11-8ca8-3a37fabbc4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:09.082965 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ddd09-a0c8-4e11-8ca8-3a37fabbc4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:09.083613 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ddd09-a0c8-4e11-8ca8-3a37fabbc4a0 admin admin] PATH_INFO: `/v3/users/55f77ea5be9c45c7b32b608ad8c9d293` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:09.085007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ddd09-a0c8-4e11-8ca8-3a37fabbc4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55f77ea5be9c45c7b32b608ad8c9d293)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:09.086939 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ddd09-a0c8-4e11-8ca8-3a37fabbc4a0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:09.156359 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-312ddd09-a0c8-4e11-8ca8-3a37fabbc4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55f77ea5be9c45c7b32b608ad8c9d293'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:09.157362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-312ddd09-a0c8-4e11-8ca8-3a37fabbc4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55f77ea5be9c45c7b32b608ad8c9d293'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:09.169266 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-312ddd09-a0c8-4e11-8ca8-3a37fabbc4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55f77ea5be9c45c7b32b608ad8c9d293'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:09.179491 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-312ddd09-a0c8-4e11-8ca8-3a37fabbc4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55f77ea5be9c45c7b32b608ad8c9d293'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:09.196446 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-312ddd09-a0c8-4e11-8ca8-3a37fabbc4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55f77ea5be9c45c7b32b608ad8c9d293'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:09.204417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1151/2293] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:11:08 2022] DELETE /identity/v3/users/55f77ea5be9c45c7b32b608ad8c9d293 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:09.209605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4bb6f-f965-41fc-9178-575875f8b53f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:09.211101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4bb6f-f965-41fc-9178-575875f8b53f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:09.211101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4bb6f-f965-41fc-9178-575875f8b53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:09.242351 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-62d4bb6f-f965-41fc-9178-575875f8b53f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:09.244242 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-62d4bb6f-f965-41fc-9178-575875f8b53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:09.328079 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1143/2294] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:09.335074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ddd09-a0c8-4e11-8ca8-3a37fabbc4a0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:09.337163 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-312ddd09-a0c8-4e11-8ca8-3a37fabbc4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:09.402826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ddd09-a0c8-4e11-8ca8-3a37fabbc4a0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:09.407466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311bd02-232a-463a-aa3d-7d17db9c62f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:09.408256 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311bd02-232a-463a-aa3d-7d17db9c62f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:09.408653 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311bd02-232a-463a-aa3d-7d17db9c62f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:09.409028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311bd02-232a-463a-aa3d-7d17db9c62f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:09.419045 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311bd02-232a-463a-aa3d-7d17db9c62f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:09.420693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311bd02-232a-463a-aa3d-7d17db9c62f4 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:09.433061 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1152/2295] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:10.100620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4bb6f-f965-41fc-9178-575875f8b53f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:10.102131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-62d4bb6f-f965-41fc-9178-575875f8b53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:10.116429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4bb6f-f965-41fc-9178-575875f8b53f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:10.121622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01617656-58ee-4e02-844c-d46b2fad1d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:10.122555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01617656-58ee-4e02-844c-d46b2fad1d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:10.123335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01617656-58ee-4e02-844c-d46b2fad1d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:10.123719 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01617656-58ee-4e02-844c-d46b2fad1d80 admin admin] PATH_INFO: `/v3/projects/02d756683c004efa8a51fbb738376ad2` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:10.126218 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01617656-58ee-4e02-844c-d46b2fad1d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d756683c004efa8a51fbb738376ad2)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:10.130512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01617656-58ee-4e02-844c-d46b2fad1d80 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:10.225127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-01617656-58ee-4e02-844c-d46b2fad1d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d756683c004efa8a51fbb738376ad2', 'request_id': 'req-01617656-58ee-4e02-844c-d46b2fad1d80'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:10.231513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-01617656-58ee-4e02-844c-d46b2fad1d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d756683c004efa8a51fbb738376ad2', 'request_id': 'req-01617656-58ee-4e02-844c-d46b2fad1d80'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:10.239995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-01617656-58ee-4e02-844c-d46b2fad1d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d756683c004efa8a51fbb738376ad2', 'request_id': 'req-01617656-58ee-4e02-844c-d46b2fad1d80'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:10.253303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-01617656-58ee-4e02-844c-d46b2fad1d80 admin admin] The token cache is being invalidate because project 02d756683c004efa8a51fbb738376ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:11:10.253596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-01617656-58ee-4e02-844c-d46b2fad1d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:10.254273 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-01617656-58ee-4e02-844c-d46b2fad1d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:10.257337 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1144/2296] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:11:10 2022] DELETE /identity/v3/projects/02d756683c004efa8a51fbb738376ad2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:10.261633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311bd02-232a-463a-aa3d-7d17db9c62f4 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:10.278596 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311bd02-232a-463a-aa3d-7d17db9c62f4 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:10.350120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8b34d-db98-45af-97b7-adf961f9f35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:10.351037 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8b34d-db98-45af-97b7-adf961f9f35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:10.351323 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8b34d-db98-45af-97b7-adf961f9f35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:10.351597 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8b34d-db98-45af-97b7-adf961f9f35b admin admin] PATH_INFO: `/v3/users/6a4f0835ca1b40d4a4a6507f7fcc3faf` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:10.352957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8b34d-db98-45af-97b7-adf961f9f35b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a4f0835ca1b40d4a4a6507f7fcc3faf)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:10.355094 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8b34d-db98-45af-97b7-adf961f9f35b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:10.370036 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:10.431687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-92b8b34d-db98-45af-97b7-adf961f9f35b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a4f0835ca1b40d4a4a6507f7fcc3faf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:10.432480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-92b8b34d-db98-45af-97b7-adf961f9f35b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a4f0835ca1b40d4a4a6507f7fcc3faf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:10.440099 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-92b8b34d-db98-45af-97b7-adf961f9f35b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a4f0835ca1b40d4a4a6507f7fcc3faf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:10.447309 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-92b8b34d-db98-45af-97b7-adf961f9f35b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a4f0835ca1b40d4a4a6507f7fcc3faf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:10.459557 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-92b8b34d-db98-45af-97b7-adf961f9f35b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a4f0835ca1b40d4a4a6507f7fcc3faf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:10.465587 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1153/2297] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:11:10 2022] DELETE /identity/v3/users/6a4f0835ca1b40d4a4a6507f7fcc3faf => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:10.748640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01617656-58ee-4e02-844c-d46b2fad1d80 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:10.750213 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-01617656-58ee-4e02-844c-d46b2fad1d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:10.764087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01617656-58ee-4e02-844c-d46b2fad1d80 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:10.845040 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7dadf-747e-4340-bcfd-d64526e8c7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:10.845908 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7dadf-747e-4340-bcfd-d64526e8c7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:10.846193 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7dadf-747e-4340-bcfd-d64526e8c7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:10.846469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7dadf-747e-4340-bcfd-d64526e8c7b4 admin admin] PATH_INFO: `/v3/projects/e58f30ac867d48cdac8dd4bb06b2ee01` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:10.847650 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7dadf-747e-4340-bcfd-d64526e8c7b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e58f30ac867d48cdac8dd4bb06b2ee01)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:10.849596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7dadf-747e-4340-bcfd-d64526e8c7b4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:10.861312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:10.899411 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-37b7dadf-747e-4340-bcfd-d64526e8c7b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e58f30ac867d48cdac8dd4bb06b2ee01', 'request_id': 'req-37b7dadf-747e-4340-bcfd-d64526e8c7b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:10.908487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-37b7dadf-747e-4340-bcfd-d64526e8c7b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e58f30ac867d48cdac8dd4bb06b2ee01', 'request_id': 'req-37b7dadf-747e-4340-bcfd-d64526e8c7b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:10.917225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-37b7dadf-747e-4340-bcfd-d64526e8c7b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e58f30ac867d48cdac8dd4bb06b2ee01', 'request_id': 'req-37b7dadf-747e-4340-bcfd-d64526e8c7b4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:10.931612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-37b7dadf-747e-4340-bcfd-d64526e8c7b4 admin admin] The token cache is being invalidate because project e58f30ac867d48cdac8dd4bb06b2ee01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:11:10.932003 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-37b7dadf-747e-4340-bcfd-d64526e8c7b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:10.932719 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-37b7dadf-747e-4340-bcfd-d64526e8c7b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:10.934627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1145/2298] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:11:10 2022] DELETE /identity/v3/projects/e58f30ac867d48cdac8dd4bb06b2ee01 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:10.939568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bb462-6e13-40fe-81b0-53a990d66bf1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:10.939864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bb462-6e13-40fe-81b0-53a990d66bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:10.940175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bb462-6e13-40fe-81b0-53a990d66bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:10.979090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-595bb462-6e13-40fe-81b0-53a990d66bf1 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:10.979090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-595bb462-6e13-40fe-81b0-53a990d66bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:11.066415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1154/2299] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:11.074318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e07ae-6ce0-46da-abba-81f12bd1120b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:11.074541 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e07ae-6ce0-46da-abba-81f12bd1120b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:11.074815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e07ae-6ce0-46da-abba-81f12bd1120b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:11.100991 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a08e07ae-6ce0-46da-abba-81f12bd1120b None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:11.102206 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a08e07ae-6ce0-46da-abba-81f12bd1120b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:11.110152 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1146/2300] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:11.114384 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bb462-6e13-40fe-81b0-53a990d66bf1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:11.124515 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bb462-6e13-40fe-81b0-53a990d66bf1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:11.130310 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5208ec3-92e5-416c-906c-01ec75b39398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:11.130961 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5208ec3-92e5-416c-906c-01ec75b39398 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:11.131246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5208ec3-92e5-416c-906c-01ec75b39398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:11.131526 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5208ec3-92e5-416c-906c-01ec75b39398 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:11.132285 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5208ec3-92e5-416c-906c-01ec75b39398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:11:11.132596 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5208ec3-92e5-416c-906c-01ec75b39398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:11.134457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5208ec3-92e5-416c-906c-01ec75b39398 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:11.150404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1155/2301] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:11:11.151454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e07ae-6ce0-46da-abba-81f12bd1120b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:11.161040 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e07ae-6ce0-46da-abba-81f12bd1120b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:11.165984 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cfba6-b445-41dd-9892-414692411205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:11.166631 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cfba6-b445-41dd-9892-414692411205 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:11.166916 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cfba6-b445-41dd-9892-414692411205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:11.167191 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cfba6-b445-41dd-9892-414692411205 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:11.167952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cfba6-b445-41dd-9892-414692411205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:11.169853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cfba6-b445-41dd-9892-414692411205 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:11.205371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1147/2302] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:11:11 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:11:11.206646 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5208ec3-92e5-416c-906c-01ec75b39398 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:11.218361 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5208ec3-92e5-416c-906c-01ec75b39398 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:11.294694 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca48e6b-9d34-4a41-84f8-4dfd52a2dfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:11.295721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca48e6b-9d34-4a41-84f8-4dfd52a2dfbb admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:11.296521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca48e6b-9d34-4a41-84f8-4dfd52a2dfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:11.296805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca48e6b-9d34-4a41-84f8-4dfd52a2dfbb admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:11.297933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca48e6b-9d34-4a41-84f8-4dfd52a2dfbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:11.299804 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca48e6b-9d34-4a41-84f8-4dfd52a2dfbb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:11.310232 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:11.331621 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1156/2303] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:11:11 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:11:11.333044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cfba6-b445-41dd-9892-414692411205 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:11.345211 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cfba6-b445-41dd-9892-414692411205 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:11.351254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afac96-6307-488a-b8c8-6da75a915697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:11.352037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afac96-6307-488a-b8c8-6da75a915697 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:11.352351 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afac96-6307-488a-b8c8-6da75a915697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:11.352793 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afac96-6307-488a-b8c8-6da75a915697 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:11.354187 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afac96-6307-488a-b8c8-6da75a915697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:11.356029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afac96-6307-488a-b8c8-6da75a915697 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:11.370751 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1148/2304] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:11:11.373599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca48e6b-9d34-4a41-84f8-4dfd52a2dfbb admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:11.385505 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca48e6b-9d34-4a41-84f8-4dfd52a2dfbb admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:11.391101 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4f9b7-6b03-43ed-bfe7-3d5ce60a14ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:11.391862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4f9b7-6b03-43ed-bfe7-3d5ce60a14ff admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:11.392279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4f9b7-6b03-43ed-bfe7-3d5ce60a14ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:11.392668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4f9b7-6b03-43ed-bfe7-3d5ce60a14ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:11.393479 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4f9b7-6b03-43ed-bfe7-3d5ce60a14ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:11.395188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4f9b7-6b03-43ed-bfe7-3d5ce60a14ff admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:11.406463 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1157/2305] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:11:11.410712 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afac96-6307-488a-b8c8-6da75a915697 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:11.421314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afac96-6307-488a-b8c8-6da75a915697 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:11.426685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74c3ed-7a9d-4554-b61c-f6ffe5684b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:11.428206 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74c3ed-7a9d-4554-b61c-f6ffe5684b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:11.428531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74c3ed-7a9d-4554-b61c-f6ffe5684b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:11.428772 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74c3ed-7a9d-4554-b61c-f6ffe5684b5c admin admin] PATH_INFO: `/v3/projects/a3ce3226e3d0438eb91a3debc324b714/users/2ae1ca4510b148c0b125863e73b4629c/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:11.446056 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74c3ed-7a9d-4554-b61c-f6ffe5684b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ce3226e3d0438eb91a3debc324b714, user_id=2ae1ca4510b148c0b125863e73b4629c, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:11.448829 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74c3ed-7a9d-4554-b61c-f6ffe5684b5c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:11.463181 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1149/2306] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:11:11 2022] PUT /identity/v3/projects/a3ce3226e3d0438eb91a3debc324b714/users/2ae1ca4510b148c0b125863e73b4629c/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:11.480355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cc897-6f31-4842-8135-716d2ef88219 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:11.480355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cc897-6f31-4842-8135-716d2ef88219 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:11.480355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cc897-6f31-4842-8135-716d2ef88219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:11.501061 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1d4cc897-6f31-4842-8135-716d2ef88219 None None] MFA Rules not processed for user `2ae1ca4510b148c0b125863e73b4629c`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:11.502273 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1d4cc897-6f31-4842-8135-716d2ef88219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:11.566358 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1158/2307] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:11.578131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74c3ed-7a9d-4554-b61c-f6ffe5684b5c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:11.579817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4b74c3ed-7a9d-4554-b61c-f6ffe5684b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:11.635404 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74c3ed-7a9d-4554-b61c-f6ffe5684b5c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:11.638995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee88498-9425-43fe-90b9-d161f780b80e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:11.639665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee88498-9425-43fe-90b9-d161f780b80e service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:11.640470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee88498-9425-43fe-90b9-d161f780b80e service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:11.640769 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee88498-9425-43fe-90b9-d161f780b80e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:11.648864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee88498-9425-43fe-90b9-d161f780b80e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:11.650276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee88498-9425-43fe-90b9-d161f780b80e service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:11.658884 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1150/2308] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:11:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:21.563459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=1,keystone:SELECT=39 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:21.654952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:43.101001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cc897-6f31-4842-8135-716d2ef88219 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:43.102478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1d4cc897-6f31-4842-8135-716d2ef88219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:43.170873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cc897-6f31-4842-8135-716d2ef88219 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:43.176066 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec1a80-b220-4a80-89c0-71fee3e62108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:43.176936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec1a80-b220-4a80-89c0-71fee3e62108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:43.177221 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec1a80-b220-4a80-89c0-71fee3e62108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:43.177497 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec1a80-b220-4a80-89c0-71fee3e62108 admin admin] PATH_INFO: `/v3/users/8b3f130e67ed42df9194469e64e3f192` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:43.178677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec1a80-b220-4a80-89c0-71fee3e62108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b3f130e67ed42df9194469e64e3f192)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:43.180633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec1a80-b220-4a80-89c0-71fee3e62108 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:43.226622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-14ec1a80-b220-4a80-89c0-71fee3e62108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3f130e67ed42df9194469e64e3f192'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:43.227267 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-14ec1a80-b220-4a80-89c0-71fee3e62108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3f130e67ed42df9194469e64e3f192'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:43.234648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-14ec1a80-b220-4a80-89c0-71fee3e62108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3f130e67ed42df9194469e64e3f192'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:43.241669 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-14ec1a80-b220-4a80-89c0-71fee3e62108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3f130e67ed42df9194469e64e3f192'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:43.253906 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-14ec1a80-b220-4a80-89c0-71fee3e62108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3f130e67ed42df9194469e64e3f192'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:43.260285 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1159/2309] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:11:43 2022] DELETE /identity/v3/users/8b3f130e67ed42df9194469e64e3f192 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:11:43.265078 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b966c-0142-4faa-b0f2-69c50ef9142b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:43.266189 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b966c-0142-4faa-b0f2-69c50ef9142b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:43.266189 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b966c-0142-4faa-b0f2-69c50ef9142b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:43.283077 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-7a4b966c-0142-4faa-b0f2-69c50ef9142b None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:43.284303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7a4b966c-0142-4faa-b0f2-69c50ef9142b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:43.346923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1151/2310] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:43.356461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec1a80-b220-4a80-89c0-71fee3e62108 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:43.357902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-14ec1a80-b220-4a80-89c0-71fee3e62108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:43.425771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec1a80-b220-4a80-89c0-71fee3e62108 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:43.430080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142fdf1-50be-4ceb-a58c-7af73b94ba0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:43.430922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142fdf1-50be-4ceb-a58c-7af73b94ba0a service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:43.431206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142fdf1-50be-4ceb-a58c-7af73b94ba0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:43.431540 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142fdf1-50be-4ceb-a58c-7af73b94ba0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:43.442214 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142fdf1-50be-4ceb-a58c-7af73b94ba0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:43.443730 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142fdf1-50be-4ceb-a58c-7af73b94ba0a service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:43.453741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1160/2311] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:11:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:43.763060 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b966c-0142-4faa-b0f2-69c50ef9142b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:43.765497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7a4b966c-0142-4faa-b0f2-69c50ef9142b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:43.811787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b966c-0142-4faa-b0f2-69c50ef9142b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:43.826678 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbcf63-066c-4811-b22a-1f4ce167ddc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:43.828747 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbcf63-066c-4811-b22a-1f4ce167ddc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:43.829041 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbcf63-066c-4811-b22a-1f4ce167ddc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:43.829325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbcf63-066c-4811-b22a-1f4ce167ddc1 admin admin] PATH_INFO: `/v3/projects/7ddcb47534db429c872fb835da308f53` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:43.830742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbcf63-066c-4811-b22a-1f4ce167ddc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ddcb47534db429c872fb835da308f53)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:43.832828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbcf63-066c-4811-b22a-1f4ce167ddc1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:43.885028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-51bbcf63-066c-4811-b22a-1f4ce167ddc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ddcb47534db429c872fb835da308f53', 'request_id': 'req-51bbcf63-066c-4811-b22a-1f4ce167ddc1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:43.890925 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-51bbcf63-066c-4811-b22a-1f4ce167ddc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ddcb47534db429c872fb835da308f53', 'request_id': 'req-51bbcf63-066c-4811-b22a-1f4ce167ddc1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:43.898579 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-51bbcf63-066c-4811-b22a-1f4ce167ddc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ddcb47534db429c872fb835da308f53', 'request_id': 'req-51bbcf63-066c-4811-b22a-1f4ce167ddc1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:43.910704 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-51bbcf63-066c-4811-b22a-1f4ce167ddc1 admin admin] The token cache is being invalidate because project 7ddcb47534db429c872fb835da308f53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:11:43.911090 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-51bbcf63-066c-4811-b22a-1f4ce167ddc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:43.911790 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-51bbcf63-066c-4811-b22a-1f4ce167ddc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:43.913421 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1152/2312] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:11:43 2022] DELETE /identity/v3/projects/7ddcb47534db429c872fb835da308f53 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:45.983902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142fdf1-50be-4ceb-a58c-7af73b94ba0a service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:45.985685 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5142fdf1-50be-4ceb-a58c-7af73b94ba0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:46.008874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142fdf1-50be-4ceb-a58c-7af73b94ba0a service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:46.031685 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:46.076374 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124b782-9b7f-473d-a4f5-6482a8a0023e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:46.077326 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124b782-9b7f-473d-a4f5-6482a8a0023e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:46.078270 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124b782-9b7f-473d-a4f5-6482a8a0023e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:46.078660 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124b782-9b7f-473d-a4f5-6482a8a0023e admin admin] PATH_INFO: `/v3/users/2c7904de685c471698350bfffe775e39` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:46.080068 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124b782-9b7f-473d-a4f5-6482a8a0023e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7904de685c471698350bfffe775e39)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:46.081916 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124b782-9b7f-473d-a4f5-6482a8a0023e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:46.127116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2124b782-9b7f-473d-a4f5-6482a8a0023e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7904de685c471698350bfffe775e39'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:46.127767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2124b782-9b7f-473d-a4f5-6482a8a0023e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7904de685c471698350bfffe775e39'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:46.134802 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2124b782-9b7f-473d-a4f5-6482a8a0023e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7904de685c471698350bfffe775e39'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:46.142621 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2124b782-9b7f-473d-a4f5-6482a8a0023e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7904de685c471698350bfffe775e39'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:46.155167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2124b782-9b7f-473d-a4f5-6482a8a0023e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7904de685c471698350bfffe775e39'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:46.161258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1161/2313] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:11:45 2022] DELETE /identity/v3/users/2c7904de685c471698350bfffe775e39 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:46.166327 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bedbf-2bc9-488c-beb0-0714145081e3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:46.166807 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bedbf-2bc9-488c-beb0-0714145081e3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:46.166988 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bedbf-2bc9-488c-beb0-0714145081e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:46.184749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ec2bedbf-2bc9-488c-beb0-0714145081e3 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:46.186307 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ec2bedbf-2bc9-488c-beb0-0714145081e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:46.248050 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1153/2314] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:11:46.257946 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124b782-9b7f-473d-a4f5-6482a8a0023e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:46.259423 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2124b782-9b7f-473d-a4f5-6482a8a0023e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:46.318811 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124b782-9b7f-473d-a4f5-6482a8a0023e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:46.322610 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de469c94-4993-4450-9e6d-d853fb982525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:46.323454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de469c94-4993-4450-9e6d-d853fb982525 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:46.323739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de469c94-4993-4450-9e6d-d853fb982525 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:46.324055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de469c94-4993-4450-9e6d-d853fb982525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:46.333983 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de469c94-4993-4450-9e6d-d853fb982525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:46.335402 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de469c94-4993-4450-9e6d-d853fb982525 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:46.345334 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1162/2315] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:46.659166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bedbf-2bc9-488c-beb0-0714145081e3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:46.660880 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ec2bedbf-2bc9-488c-beb0-0714145081e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:46.676746 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bedbf-2bc9-488c-beb0-0714145081e3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:46.682755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad539fc-84d7-4456-a297-3ca9b0c44f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:46.683750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad539fc-84d7-4456-a297-3ca9b0c44f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:46.684167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad539fc-84d7-4456-a297-3ca9b0c44f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:46.684825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad539fc-84d7-4456-a297-3ca9b0c44f79 admin admin] PATH_INFO: `/v3/projects/efe1cb08dd7447caa0df0c1bb0db3df0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:46.686171 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad539fc-84d7-4456-a297-3ca9b0c44f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe1cb08dd7447caa0df0c1bb0db3df0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:46.696306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad539fc-84d7-4456-a297-3ca9b0c44f79 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:46.717503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:46.745759 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-aad539fc-84d7-4456-a297-3ca9b0c44f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe1cb08dd7447caa0df0c1bb0db3df0', 'request_id': 'req-aad539fc-84d7-4456-a297-3ca9b0c44f79'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:46.751545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-aad539fc-84d7-4456-a297-3ca9b0c44f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe1cb08dd7447caa0df0c1bb0db3df0', 'request_id': 'req-aad539fc-84d7-4456-a297-3ca9b0c44f79'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:46.759613 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-aad539fc-84d7-4456-a297-3ca9b0c44f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe1cb08dd7447caa0df0c1bb0db3df0', 'request_id': 'req-aad539fc-84d7-4456-a297-3ca9b0c44f79'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:46.776850 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-aad539fc-84d7-4456-a297-3ca9b0c44f79 admin admin] The token cache is being invalidate because project efe1cb08dd7447caa0df0c1bb0db3df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:11:46.777091 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-aad539fc-84d7-4456-a297-3ca9b0c44f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:46.777842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-aad539fc-84d7-4456-a297-3ca9b0c44f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:46.779596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1154/2316] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:11:46 2022] DELETE /identity/v3/projects/efe1cb08dd7447caa0df0c1bb0db3df0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:46.784760 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663b7c5-45e5-41ab-b1e5-88f5de836f63 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:46.785129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663b7c5-45e5-41ab-b1e5-88f5de836f63 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:46.785557 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663b7c5-45e5-41ab-b1e5-88f5de836f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:46.806658 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2663b7c5-45e5-41ab-b1e5-88f5de836f63 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:46.808032 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2663b7c5-45e5-41ab-b1e5-88f5de836f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:46.887611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:46.911336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1163/2317] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:46.920449 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c43cf6-cf76-407b-a280-6ff0cb70239e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:46.920740 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c43cf6-cf76-407b-a280-6ff0cb70239e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:46.921129 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c43cf6-cf76-407b-a280-6ff0cb70239e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:46.949736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-74c43cf6-cf76-407b-a280-6ff0cb70239e None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:46.951077 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-74c43cf6-cf76-407b-a280-6ff0cb70239e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:46.967052 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1155/2318] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:46.969345 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663b7c5-45e5-41ab-b1e5-88f5de836f63 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:46.983276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663b7c5-45e5-41ab-b1e5-88f5de836f63 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:46.990368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5954b-b59b-44af-bdf9-2e0a43dcccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:46.991137 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5954b-b59b-44af-bdf9-2e0a43dcccb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:46.991340 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5954b-b59b-44af-bdf9-2e0a43dcccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:46.991695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5954b-b59b-44af-bdf9-2e0a43dcccb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:46.992443 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5954b-b59b-44af-bdf9-2e0a43dcccb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:11:46.992759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5954b-b59b-44af-bdf9-2e0a43dcccb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:46.994369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5954b-b59b-44af-bdf9-2e0a43dcccb6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:47.010897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1164/2319] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:11:47.015173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c43cf6-cf76-407b-a280-6ff0cb70239e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:47.024845 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c43cf6-cf76-407b-a280-6ff0cb70239e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:47.030003 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96030b-bd24-426b-a37c-7134130c83ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:47.030601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96030b-bd24-426b-a37c-7134130c83ac admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:47.031428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96030b-bd24-426b-a37c-7134130c83ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:47.031694 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96030b-bd24-426b-a37c-7134130c83ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:47.032437 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96030b-bd24-426b-a37c-7134130c83ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:47.034347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96030b-bd24-426b-a37c-7134130c83ac admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:47.075352 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1156/2320] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:11:47 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:11:47.076974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5954b-b59b-44af-bdf9-2e0a43dcccb6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:47.100226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5954b-b59b-44af-bdf9-2e0a43dcccb6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:47.160555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ffb25-930d-418b-8cf4-b18aee245e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:47.161272 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ffb25-930d-418b-8cf4-b18aee245e4f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:47.161566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ffb25-930d-418b-8cf4-b18aee245e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:47.161849 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ffb25-930d-418b-8cf4-b18aee245e4f admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:47.162545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ffb25-930d-418b-8cf4-b18aee245e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:47.164792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ffb25-930d-418b-8cf4-b18aee245e4f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:47.193248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1165/2321] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:11:47 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:11:47.198678 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96030b-bd24-426b-a37c-7134130c83ac admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:47.209596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96030b-bd24-426b-a37c-7134130c83ac admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:47.214192 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bc49e-de08-4dda-8ed8-1d738a914e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:47.214848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bc49e-de08-4dda-8ed8-1d738a914e6c admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:47.215131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bc49e-de08-4dda-8ed8-1d738a914e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:47.215406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bc49e-de08-4dda-8ed8-1d738a914e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:47.216159 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bc49e-de08-4dda-8ed8-1d738a914e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:47.217755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bc49e-de08-4dda-8ed8-1d738a914e6c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:47.229500 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1157/2322] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:11:47.233848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ffb25-930d-418b-8cf4-b18aee245e4f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:47.244015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ffb25-930d-418b-8cf4-b18aee245e4f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:47.248638 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b912acd-6604-47a6-b7b4-fe124bc4dd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:47.249303 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b912acd-6604-47a6-b7b4-fe124bc4dd63 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:47.249593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b912acd-6604-47a6-b7b4-fe124bc4dd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:47.249876 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b912acd-6604-47a6-b7b4-fe124bc4dd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:47.250636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b912acd-6604-47a6-b7b4-fe124bc4dd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:47.252263 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b912acd-6604-47a6-b7b4-fe124bc4dd63 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:47.262223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1166/2323] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:11:47.267037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bc49e-de08-4dda-8ed8-1d738a914e6c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:47.277047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bc49e-de08-4dda-8ed8-1d738a914e6c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:47.282569 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15224504-b2d8-4960-aec2-fc3465639a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:47.283398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15224504-b2d8-4960-aec2-fc3465639a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:47.283687 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15224504-b2d8-4960-aec2-fc3465639a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:47.283999 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15224504-b2d8-4960-aec2-fc3465639a43 admin admin] PATH_INFO: `/v3/projects/0c221a083c034f49b95500f351220a93/users/05f4b76e29444e2383a9d247f72449cf/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:47.299137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15224504-b2d8-4960-aec2-fc3465639a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c221a083c034f49b95500f351220a93, user_id=05f4b76e29444e2383a9d247f72449cf, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:47.301979 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15224504-b2d8-4960-aec2-fc3465639a43 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:47.315399 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1158/2324] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:11:47 2022] PUT /identity/v3/projects/0c221a083c034f49b95500f351220a93/users/05f4b76e29444e2383a9d247f72449cf/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:47.320696 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8f5a7-9072-4abb-9af2-7f2b948f23be None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:47.321110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8f5a7-9072-4abb-9af2-7f2b948f23be None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:47.321567 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8f5a7-9072-4abb-9af2-7f2b948f23be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:47.340319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5ba8f5a7-9072-4abb-9af2-7f2b948f23be None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:47.341529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5ba8f5a7-9072-4abb-9af2-7f2b948f23be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:47.403758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1167/2325] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:11:47.414002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15224504-b2d8-4960-aec2-fc3465639a43 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:47.415992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-15224504-b2d8-4960-aec2-fc3465639a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:47.482165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15224504-b2d8-4960-aec2-fc3465639a43 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:47.486414 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03abf5-6145-4ba4-a61c-15a43236253b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:47.487158 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03abf5-6145-4ba4-a61c-15a43236253b service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:47.487515 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03abf5-6145-4ba4-a61c-15a43236253b service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:47.487860 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03abf5-6145-4ba4-a61c-15a43236253b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:47.499096 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03abf5-6145-4ba4-a61c-15a43236253b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:47.501447 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03abf5-6145-4ba4-a61c-15a43236253b service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:47.512002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1159/2326] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:51.382036 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8f5a7-9072-4abb-9af2-7f2b948f23be None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:51.384157 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5ba8f5a7-9072-4abb-9af2-7f2b948f23be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:51.401241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8f5a7-9072-4abb-9af2-7f2b948f23be None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:51.409569 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe29bc-733e-438e-adcb-f40962f3e002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:51.411042 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe29bc-733e-438e-adcb-f40962f3e002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:51.411508 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe29bc-733e-438e-adcb-f40962f3e002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:51.411975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe29bc-733e-438e-adcb-f40962f3e002 admin admin] PATH_INFO: `/v3/users/c061cf52906f4d52b1cb42bffd25bece` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:51.413653 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe29bc-733e-438e-adcb-f40962f3e002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c061cf52906f4d52b1cb42bffd25bece)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:51.416880 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe29bc-733e-438e-adcb-f40962f3e002 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:51.510913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:51.513612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b6fe29bc-733e-438e-adcb-f40962f3e002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c061cf52906f4d52b1cb42bffd25bece'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:51.523179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b6fe29bc-733e-438e-adcb-f40962f3e002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c061cf52906f4d52b1cb42bffd25bece'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:51.530011 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b6fe29bc-733e-438e-adcb-f40962f3e002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c061cf52906f4d52b1cb42bffd25bece'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:51.541449 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b6fe29bc-733e-438e-adcb-f40962f3e002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c061cf52906f4d52b1cb42bffd25bece'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:51.559873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b6fe29bc-733e-438e-adcb-f40962f3e002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c061cf52906f4d52b1cb42bffd25bece'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:51.566981 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1168/2327] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:11:51 2022] DELETE /identity/v3/users/c061cf52906f4d52b1cb42bffd25bece => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:51.571440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf3b5c-f4bf-46f7-a178-611f8ee4cabf None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:51.572010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf3b5c-f4bf-46f7-a178-611f8ee4cabf None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:51.572304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf3b5c-f4bf-46f7-a178-611f8ee4cabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:51.591092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-aeaf3b5c-f4bf-46f7-a178-611f8ee4cabf None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:51.592380 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-aeaf3b5c-f4bf-46f7-a178-611f8ee4cabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:51.666811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:51.693829 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1160/2328] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:51.704938 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe29bc-733e-438e-adcb-f40962f3e002 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:51.706467 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b6fe29bc-733e-438e-adcb-f40962f3e002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:51.769025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe29bc-733e-438e-adcb-f40962f3e002 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:51.772800 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0c0ca-df55-4b02-a86d-a5611c7bb765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:51.773468 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0c0ca-df55-4b02-a86d-a5611c7bb765 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:51.773757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0c0ca-df55-4b02-a86d-a5611c7bb765 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:51.774037 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0c0ca-df55-4b02-a86d-a5611c7bb765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:51.786181 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0c0ca-df55-4b02-a86d-a5611c7bb765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:51.788333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0c0ca-df55-4b02-a86d-a5611c7bb765 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:51.802021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1169/2329] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:52.343629 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf3b5c-f4bf-46f7-a178-611f8ee4cabf None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:52.345403 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-aeaf3b5c-f4bf-46f7-a178-611f8ee4cabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:52.396673 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf3b5c-f4bf-46f7-a178-611f8ee4cabf None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:52.404165 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a320150-98de-49b5-b44b-9bd94a0854bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:52.405110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320150-98de-49b5-b44b-9bd94a0854bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:52.405386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320150-98de-49b5-b44b-9bd94a0854bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:52.405696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320150-98de-49b5-b44b-9bd94a0854bf admin admin] PATH_INFO: `/v3/projects/71b52e5f2a8c47aeaa510dd998687060` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:52.407017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a320150-98de-49b5-b44b-9bd94a0854bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=71b52e5f2a8c47aeaa510dd998687060)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:52.410739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a320150-98de-49b5-b44b-9bd94a0854bf admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:52.487085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2a320150-98de-49b5-b44b-9bd94a0854bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71b52e5f2a8c47aeaa510dd998687060', 'request_id': 'req-2a320150-98de-49b5-b44b-9bd94a0854bf'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:52.493343 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2a320150-98de-49b5-b44b-9bd94a0854bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71b52e5f2a8c47aeaa510dd998687060', 'request_id': 'req-2a320150-98de-49b5-b44b-9bd94a0854bf'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:52.508418 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2a320150-98de-49b5-b44b-9bd94a0854bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71b52e5f2a8c47aeaa510dd998687060', 'request_id': 'req-2a320150-98de-49b5-b44b-9bd94a0854bf'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:52.523599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2a320150-98de-49b5-b44b-9bd94a0854bf admin admin] The token cache is being invalidate because project 71b52e5f2a8c47aeaa510dd998687060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:11:52.523936 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2a320150-98de-49b5-b44b-9bd94a0854bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:52.526737 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2a320150-98de-49b5-b44b-9bd94a0854bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:52.528844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1161/2330] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:11:52 2022] DELETE /identity/v3/projects/71b52e5f2a8c47aeaa510dd998687060 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:52.534326 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12279d-4fbe-40bb-836f-6fdef170883f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:52.534841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12279d-4fbe-40bb-836f-6fdef170883f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:52.534938 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12279d-4fbe-40bb-836f-6fdef170883f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:52.575278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9c12279d-4fbe-40bb-836f-6fdef170883f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:52.576761 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9c12279d-4fbe-40bb-836f-6fdef170883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:52.676126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1170/2331] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:52.676978 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e6087-4c26-42d3-962e-8fa97cf477fb None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:52.677463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e6087-4c26-42d3-962e-8fa97cf477fb None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:52.677547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e6087-4c26-42d3-962e-8fa97cf477fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:52.731813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-824e6087-4c26-42d3-962e-8fa97cf477fb None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:52.733085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-824e6087-4c26-42d3-962e-8fa97cf477fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:52.743100 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1162/2332] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:11:52.748150 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12279d-4fbe-40bb-836f-6fdef170883f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:52.764562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12279d-4fbe-40bb-836f-6fdef170883f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:52.769904 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea8992-07de-4496-97e7-470422af8a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:52.770656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea8992-07de-4496-97e7-470422af8a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:52.771014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea8992-07de-4496-97e7-470422af8a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:52.771368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea8992-07de-4496-97e7-470422af8a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:52.772778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea8992-07de-4496-97e7-470422af8a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:11:52.772778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea8992-07de-4496-97e7-470422af8a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:52.774585 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea8992-07de-4496-97e7-470422af8a84 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:52.787960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1171/2333] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:11:52.793104 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e6087-4c26-42d3-962e-8fa97cf477fb None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:52.813083 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e6087-4c26-42d3-962e-8fa97cf477fb None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:52.818883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cce12f-cb85-4a7a-a488-695138f70cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:52.819558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cce12f-cb85-4a7a-a488-695138f70cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:52.819848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cce12f-cb85-4a7a-a488-695138f70cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:52.820744 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cce12f-cb85-4a7a-a488-695138f70cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:52.820890 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cce12f-cb85-4a7a-a488-695138f70cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:52.822755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cce12f-cb85-4a7a-a488-695138f70cb1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:52.856967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1163/2334] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:11:52 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:11:52.861803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea8992-07de-4496-97e7-470422af8a84 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:52.871974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea8992-07de-4496-97e7-470422af8a84 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:52.939675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:52.951537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e7513-2cf5-45d3-bf4e-1ec2f9703bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:52.952753 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e7513-2cf5-45d3-bf4e-1ec2f9703bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:52.953280 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e7513-2cf5-45d3-bf4e-1ec2f9703bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:52.953480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e7513-2cf5-45d3-bf4e-1ec2f9703bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:52.954190 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e7513-2cf5-45d3-bf4e-1ec2f9703bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:52.956200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e7513-2cf5-45d3-bf4e-1ec2f9703bc2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:52.978902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1172/2335] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:11:52 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:11:52.983106 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cce12f-cb85-4a7a-a488-695138f70cb1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:52.994706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cce12f-cb85-4a7a-a488-695138f70cb1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:52.999731 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb19d8a-5eb1-4fc9-975d-3dfb299edfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:53.000511 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb19d8a-5eb1-4fc9-975d-3dfb299edfec admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:53.001028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb19d8a-5eb1-4fc9-975d-3dfb299edfec admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:53.001372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb19d8a-5eb1-4fc9-975d-3dfb299edfec admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:53.002176 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb19d8a-5eb1-4fc9-975d-3dfb299edfec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:53.003854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb19d8a-5eb1-4fc9-975d-3dfb299edfec admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:53.016627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1164/2336] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:11:53.020750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e7513-2cf5-45d3-bf4e-1ec2f9703bc2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:53.032319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e7513-2cf5-45d3-bf4e-1ec2f9703bc2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:53.037322 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcf05a-ae0d-4ff3-b3ef-e24774a9eac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:53.038002 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcf05a-ae0d-4ff3-b3ef-e24774a9eac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:53.038294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcf05a-ae0d-4ff3-b3ef-e24774a9eac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:53.038572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcf05a-ae0d-4ff3-b3ef-e24774a9eac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:53.039709 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcf05a-ae0d-4ff3-b3ef-e24774a9eac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:53.041456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcf05a-ae0d-4ff3-b3ef-e24774a9eac0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:53.057215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1173/2337] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:11:53.064627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb19d8a-5eb1-4fc9-975d-3dfb299edfec admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:53.076338 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e3a1e-da33-4304-98e5-3437c507be09 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:53.076698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e3a1e-da33-4304-98e5-3437c507be09 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:53.077044 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e3a1e-da33-4304-98e5-3437c507be09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:53.077467 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb19d8a-5eb1-4fc9-975d-3dfb299edfec admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:53.082333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4eb64-d224-4524-8750-2e77e837241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:53.083631 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4eb64-d224-4524-8750-2e77e837241a admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:53.084325 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4eb64-d224-4524-8750-2e77e837241a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:53.084680 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4eb64-d224-4524-8750-2e77e837241a admin admin] PATH_INFO: `/v3/projects/26c5cae26ba54286a7f6ca55e380d2f7/users/d7e5e021873b49efafbeb1cbc12ff4d9/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:53.105666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4eb64-d224-4524-8750-2e77e837241a admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c5cae26ba54286a7f6ca55e380d2f7, user_id=d7e5e021873b49efafbeb1cbc12ff4d9, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:53.109456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0f2e3a1e-da33-4304-98e5-3437c507be09 None None] MFA Rules not processed for user `05f4b76e29444e2383a9d247f72449cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:53.109867 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4eb64-d224-4524-8750-2e77e837241a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:53.110633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0f2e3a1e-da33-4304-98e5-3437c507be09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:53.133521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1165/2338] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:11:53 2022] PUT /identity/v3/projects/26c5cae26ba54286a7f6ca55e380d2f7/users/d7e5e021873b49efafbeb1cbc12ff4d9/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:53.142773 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16826332-8e54-440a-b9d6-c0f90d310884 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:53.143062 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16826332-8e54-440a-b9d6-c0f90d310884 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:53.143420 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16826332-8e54-440a-b9d6-c0f90d310884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:53.184719 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-16826332-8e54-440a-b9d6-c0f90d310884 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:53.187174 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-16826332-8e54-440a-b9d6-c0f90d310884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:53.226101 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1174/2339] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:11:53.230272 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e3a1e-da33-4304-98e5-3437c507be09 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:53.232811 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0f2e3a1e-da33-4304-98e5-3437c507be09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:53.251480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e3a1e-da33-4304-98e5-3437c507be09 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:53.268038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1166/2340] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:53.274864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16826332-8e54-440a-b9d6-c0f90d310884 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:53.281643 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-16826332-8e54-440a-b9d6-c0f90d310884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:53.296541 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:53.322369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3681c1e-072d-4383-8e3e-734cfcb34d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:53.323121 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3681c1e-072d-4383-8e3e-734cfcb34d30 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:53.323650 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3681c1e-072d-4383-8e3e-734cfcb34d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:53.324042 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3681c1e-072d-4383-8e3e-734cfcb34d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:53.325477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3681c1e-072d-4383-8e3e-734cfcb34d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:53.332647 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3681c1e-072d-4383-8e3e-734cfcb34d30 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:53.366196 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16826332-8e54-440a-b9d6-c0f90d310884 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:53.370044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7c0e4-59c6-49e0-8a2b-2c60f2a59e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:53.370699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7c0e4-59c6-49e0-8a2b-2c60f2a59e4d service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:53.370983 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7c0e4-59c6-49e0-8a2b-2c60f2a59e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:53.371261 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7c0e4-59c6-49e0-8a2b-2c60f2a59e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:53.383153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7c0e4-59c6-49e0-8a2b-2c60f2a59e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:53.384999 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7c0e4-59c6-49e0-8a2b-2c60f2a59e4d service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:53.385325 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1175/2341] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:11:53 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:11:53.390523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3681c1e-072d-4383-8e3e-734cfcb34d30 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:53.403761 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1167/2342] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:11:53.473593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:53.498531 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3681c1e-072d-4383-8e3e-734cfcb34d30 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:53.508444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7352a1f-15d0-46f2-9a54-12e3d49dc611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:53.509379 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7352a1f-15d0-46f2-9a54-12e3d49dc611 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:53.510297 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7352a1f-15d0-46f2-9a54-12e3d49dc611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:53.510735 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7352a1f-15d0-46f2-9a54-12e3d49dc611 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:53.511621 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7352a1f-15d0-46f2-9a54-12e3d49dc611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:53.514483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7352a1f-15d0-46f2-9a54-12e3d49dc611 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:53.554615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1176/2343] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:11:53 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:11:53.558850 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7c0e4-59c6-49e0-8a2b-2c60f2a59e4d service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:53.580936 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7c0e4-59c6-49e0-8a2b-2c60f2a59e4d service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:53.585814 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054e122-10fc-414d-98bd-912014c551fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:53.586500 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054e122-10fc-414d-98bd-912014c551fe admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:53.586783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054e122-10fc-414d-98bd-912014c551fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:53.587069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054e122-10fc-414d-98bd-912014c551fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:53.587804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054e122-10fc-414d-98bd-912014c551fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:53.589549 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054e122-10fc-414d-98bd-912014c551fe admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:53.600866 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1168/2344] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:11:53.604689 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7352a1f-15d0-46f2-9a54-12e3d49dc611 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:53.619300 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7352a1f-15d0-46f2-9a54-12e3d49dc611 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:53.626739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18cf0c-9fef-402f-a341-3b5dce409437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:53.628844 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18cf0c-9fef-402f-a341-3b5dce409437 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:53.629185 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18cf0c-9fef-402f-a341-3b5dce409437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:53.629610 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18cf0c-9fef-402f-a341-3b5dce409437 admin admin] PATH_INFO: `/v3/projects/cd3e5b86d4bc4f179217d58a9db6be42/users/3562116abe4e4deaa84570ff5a011578/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:53.650772 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18cf0c-9fef-402f-a341-3b5dce409437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3e5b86d4bc4f179217d58a9db6be42, user_id=3562116abe4e4deaa84570ff5a011578, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:53.654129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18cf0c-9fef-402f-a341-3b5dce409437 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:53.673634 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1177/2345] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:11:53 2022] PUT /identity/v3/projects/cd3e5b86d4bc4f179217d58a9db6be42/users/3562116abe4e4deaa84570ff5a011578/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:11:53.677976 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054e122-10fc-414d-98bd-912014c551fe admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:53.689548 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054e122-10fc-414d-98bd-912014c551fe admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:53.764932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b55812-5432-407b-a4b1-117e4ca6363d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:53.766260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b55812-5432-407b-a4b1-117e4ca6363d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:53.766555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b55812-5432-407b-a4b1-117e4ca6363d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:53.766983 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b55812-5432-407b-a4b1-117e4ca6363d admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:53.767731 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b55812-5432-407b-a4b1-117e4ca6363d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:53.769453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b55812-5432-407b-a4b1-117e4ca6363d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:53.780274 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1169/2346] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:11:53.788239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18cf0c-9fef-402f-a341-3b5dce409437 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:53.802129 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18cf0c-9fef-402f-a341-3b5dce409437 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:53.808844 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03684c-06ae-4afc-a43f-e1563ed4080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:53.810248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03684c-06ae-4afc-a43f-e1563ed4080c admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:53.810518 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03684c-06ae-4afc-a43f-e1563ed4080c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:53.810795 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03684c-06ae-4afc-a43f-e1563ed4080c admin admin] PATH_INFO: `/v3/projects/cd3e5b86d4bc4f179217d58a9db6be42/users/3562116abe4e4deaa84570ff5a011578/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:53.824099 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03684c-06ae-4afc-a43f-e1563ed4080c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3e5b86d4bc4f179217d58a9db6be42, user_id=3562116abe4e4deaa84570ff5a011578, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:53.828708 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03684c-06ae-4afc-a43f-e1563ed4080c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:53.844056 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1178/2347] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:11:53 2022] PUT /identity/v3/projects/cd3e5b86d4bc4f179217d58a9db6be42/users/3562116abe4e4deaa84570ff5a011578/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:54.356813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542770d-73df-4953-ae2d-dd1ae47a6496 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:54.357571 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542770d-73df-4953-ae2d-dd1ae47a6496 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:54.358284 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542770d-73df-4953-ae2d-dd1ae47a6496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:54.407286 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d542770d-73df-4953-ae2d-dd1ae47a6496 None None] MFA Rules not processed for user `d7e5e021873b49efafbeb1cbc12ff4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:54.409628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d542770d-73df-4953-ae2d-dd1ae47a6496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:54.486799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1170/2348] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:54.498725 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03684c-06ae-4afc-a43f-e1563ed4080c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:54.501046 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ce03684c-06ae-4afc-a43f-e1563ed4080c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:54.605294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03684c-06ae-4afc-a43f-e1563ed4080c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:54.612477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f63ed-71b0-43ca-be2f-37bb7044b474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:54.614774 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f63ed-71b0-43ca-be2f-37bb7044b474 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:54.615244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f63ed-71b0-43ca-be2f-37bb7044b474 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:54.615840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f63ed-71b0-43ca-be2f-37bb7044b474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:54.628495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f63ed-71b0-43ca-be2f-37bb7044b474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:54.630222 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f63ed-71b0-43ca-be2f-37bb7044b474 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:54.642046 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1179/2349] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:11:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:55.391948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542770d-73df-4953-ae2d-dd1ae47a6496 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:55.393488 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d542770d-73df-4953-ae2d-dd1ae47a6496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:55.439879 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:55.492187 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542770d-73df-4953-ae2d-dd1ae47a6496 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:55.503943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb642a-5574-4318-a02c-265882e5c2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:55.504890 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb642a-5574-4318-a02c-265882e5c2dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:55.505176 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb642a-5574-4318-a02c-265882e5c2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:55.505454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb642a-5574-4318-a02c-265882e5c2dd admin admin] PATH_INFO: `/v3/users/2ae1ca4510b148c0b125863e73b4629c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:55.506847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb642a-5574-4318-a02c-265882e5c2dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae1ca4510b148c0b125863e73b4629c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:55.508857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb642a-5574-4318-a02c-265882e5c2dd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:55.582384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3fdb642a-5574-4318-a02c-265882e5c2dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae1ca4510b148c0b125863e73b4629c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:55.591999 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3fdb642a-5574-4318-a02c-265882e5c2dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae1ca4510b148c0b125863e73b4629c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:55.603744 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3fdb642a-5574-4318-a02c-265882e5c2dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae1ca4510b148c0b125863e73b4629c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:55.604454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3fdb642a-5574-4318-a02c-265882e5c2dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae1ca4510b148c0b125863e73b4629c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:55.605509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3fdb642a-5574-4318-a02c-265882e5c2dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae1ca4510b148c0b125863e73b4629c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:55.641335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1171/2350] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:11:55 2022] DELETE /identity/v3/users/2ae1ca4510b148c0b125863e73b4629c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:11:55.645785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c8fa1-0bc1-464a-9943-c5dd83a0972e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:55.646667 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c8fa1-0bc1-464a-9943-c5dd83a0972e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:55.646943 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c8fa1-0bc1-464a-9943-c5dd83a0972e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:55.665831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fe7c8fa1-0bc1-464a-9943-c5dd83a0972e None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:55.667256 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fe7c8fa1-0bc1-464a-9943-c5dd83a0972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:55.753051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1180/2351] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:11:55.760858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb642a-5574-4318-a02c-265882e5c2dd admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:55.762334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3fdb642a-5574-4318-a02c-265882e5c2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:55.838885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb642a-5574-4318-a02c-265882e5c2dd admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:55.848511 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d2f8c-4edd-43ba-8327-326a20029759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:55.849293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2f8c-4edd-43ba-8327-326a20029759 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:55.849637 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2f8c-4edd-43ba-8327-326a20029759 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:55.849995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2f8c-4edd-43ba-8327-326a20029759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:55.862149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d2f8c-4edd-43ba-8327-326a20029759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:55.864071 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d2f8c-4edd-43ba-8327-326a20029759 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:55.878223 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1172/2352] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:11:56.144494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef09b63-2d41-4b93-bdc9-55fce209a3bc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:56.144960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef09b63-2d41-4b93-bdc9-55fce209a3bc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:56.145401 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef09b63-2d41-4b93-bdc9-55fce209a3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:56.173362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-bef09b63-2d41-4b93-bdc9-55fce209a3bc None None] MFA Rules not processed for user `d7e5e021873b49efafbeb1cbc12ff4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:56.175119 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bef09b63-2d41-4b93-bdc9-55fce209a3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:56.210500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:56.280428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d2f8c-4edd-43ba-8327-326a20029759 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:56.284532 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-989d2f8c-4edd-43ba-8327-326a20029759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:56.303492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d2f8c-4edd-43ba-8327-326a20029759 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:56.306212 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1181/2353] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:56.310002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfd0aa-6dc8-441c-bd4d-2d446a5d87a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:56.312257 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfd0aa-6dc8-441c-bd4d-2d446a5d87a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:56.312556 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfd0aa-6dc8-441c-bd4d-2d446a5d87a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:56.312883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfd0aa-6dc8-441c-bd4d-2d446a5d87a4 admin admin] PATH_INFO: `/v3/projects/a3ce3226e3d0438eb91a3debc324b714` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:56.314642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfd0aa-6dc8-441c-bd4d-2d446a5d87a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ce3226e3d0438eb91a3debc324b714)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:56.317137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfd0aa-6dc8-441c-bd4d-2d446a5d87a4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:56.372333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:56.386667 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-79dfd0aa-6dc8-441c-bd4d-2d446a5d87a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ce3226e3d0438eb91a3debc324b714', 'request_id': 'req-79dfd0aa-6dc8-441c-bd4d-2d446a5d87a4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:56.402983 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-79dfd0aa-6dc8-441c-bd4d-2d446a5d87a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ce3226e3d0438eb91a3debc324b714', 'request_id': 'req-79dfd0aa-6dc8-441c-bd4d-2d446a5d87a4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:56.416547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-79dfd0aa-6dc8-441c-bd4d-2d446a5d87a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ce3226e3d0438eb91a3debc324b714', 'request_id': 'req-79dfd0aa-6dc8-441c-bd4d-2d446a5d87a4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:56.438806 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-79dfd0aa-6dc8-441c-bd4d-2d446a5d87a4 admin admin] The token cache is being invalidate because project a3ce3226e3d0438eb91a3debc324b714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:11:56.439380 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-79dfd0aa-6dc8-441c-bd4d-2d446a5d87a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:56.440612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-79dfd0aa-6dc8-441c-bd4d-2d446a5d87a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:11:56.442750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1173/2354] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:11:56 2022] DELETE /identity/v3/projects/a3ce3226e3d0438eb91a3debc324b714 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:11:56.447534 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60a4a9-3448-4a66-a610-828911c1b004 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:56.448055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60a4a9-3448-4a66-a610-828911c1b004 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:56.448491 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60a4a9-3448-4a66-a610-828911c1b004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:56.477977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2a60a4a9-3448-4a66-a610-828911c1b004 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:56.482113 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2a60a4a9-3448-4a66-a610-828911c1b004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:56.566226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1182/2355] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:11:56.573840 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300ddc7-901c-47ec-91da-b23c5f9d4838 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:56.575432 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300ddc7-901c-47ec-91da-b23c5f9d4838 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:56.576314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300ddc7-901c-47ec-91da-b23c5f9d4838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:56.614738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3300ddc7-901c-47ec-91da-b23c5f9d4838 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:56.617540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3300ddc7-901c-47ec-91da-b23c5f9d4838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:56.648446 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1174/2356] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:56.653174 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60a4a9-3448-4a66-a610-828911c1b004 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:56.672857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60a4a9-3448-4a66-a610-828911c1b004 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:56.684008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7c70f-89d8-45dd-98e7-5aa6b96227d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:56.687472 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7c70f-89d8-45dd-98e7-5aa6b96227d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:56.688013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7c70f-89d8-45dd-98e7-5aa6b96227d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:56.688782 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7c70f-89d8-45dd-98e7-5aa6b96227d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:56.690082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7c70f-89d8-45dd-98e7-5aa6b96227d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:11:56.690839 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7c70f-89d8-45dd-98e7-5aa6b96227d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:56.693163 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7c70f-89d8-45dd-98e7-5aa6b96227d4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:56.724391 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1183/2357] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 12:11:56.729626 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300ddc7-901c-47ec-91da-b23c5f9d4838 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:56.748343 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300ddc7-901c-47ec-91da-b23c5f9d4838 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:56.754757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6a0e7-cc80-4244-891e-7ee78e2d8522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:56.755898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6a0e7-cc80-4244-891e-7ee78e2d8522 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:56.756279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6a0e7-cc80-4244-891e-7ee78e2d8522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:56.756624 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6a0e7-cc80-4244-891e-7ee78e2d8522 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:56.761178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6a0e7-cc80-4244-891e-7ee78e2d8522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:56.764615 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6a0e7-cc80-4244-891e-7ee78e2d8522 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:56.823692 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1175/2358] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:11:56 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:11:56.827985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7c70f-89d8-45dd-98e7-5aa6b96227d4 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:56.842250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7c70f-89d8-45dd-98e7-5aa6b96227d4 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:57.010743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252d6f3-7bb5-4853-9416-3766aec138ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:57.011693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252d6f3-7bb5-4853-9416-3766aec138ea admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:57.013524 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252d6f3-7bb5-4853-9416-3766aec138ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:57.013993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252d6f3-7bb5-4853-9416-3766aec138ea admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:57.018477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252d6f3-7bb5-4853-9416-3766aec138ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:57.020972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252d6f3-7bb5-4853-9416-3766aec138ea admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:57.077134 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1184/2359] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:11:56 2022] POST /identity/v3/users => generated 283 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:11:57.079434 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6a0e7-cc80-4244-891e-7ee78e2d8522 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:57.101691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6a0e7-cc80-4244-891e-7ee78e2d8522 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:57.116964 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c69f7-dd43-4d79-94f5-31bb8f231267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:57.117826 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c69f7-dd43-4d79-94f5-31bb8f231267 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:57.119012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c69f7-dd43-4d79-94f5-31bb8f231267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:57.119012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c69f7-dd43-4d79-94f5-31bb8f231267 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:57.119771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c69f7-dd43-4d79-94f5-31bb8f231267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:57.121859 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c69f7-dd43-4d79-94f5-31bb8f231267 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:57.147813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1176/2360] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:11:57.151533 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252d6f3-7bb5-4853-9416-3766aec138ea admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:57.167245 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252d6f3-7bb5-4853-9416-3766aec138ea admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:57.200999 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47fff8-a935-48a8-88c3-7f1fbb31eae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:57.203689 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47fff8-a935-48a8-88c3-7f1fbb31eae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:57.210364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47fff8-a935-48a8-88c3-7f1fbb31eae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:57.212208 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47fff8-a935-48a8-88c3-7f1fbb31eae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:57.213436 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47fff8-a935-48a8-88c3-7f1fbb31eae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:57.218513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47fff8-a935-48a8-88c3-7f1fbb31eae4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:57.267308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1185/2361] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:11:57.271899 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c69f7-dd43-4d79-94f5-31bb8f231267 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:57.282552 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c69f7-dd43-4d79-94f5-31bb8f231267 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:57.296669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90775731-b84b-49a5-a4c2-f825f3b63a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:57.297845 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90775731-b84b-49a5-a4c2-f825f3b63a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:57.299351 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90775731-b84b-49a5-a4c2-f825f3b63a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:57.299637 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90775731-b84b-49a5-a4c2-f825f3b63a7d admin admin] PATH_INFO: `/v3/projects/69728953f30e40cea288ea1a174d5814/users/1401b7e3b716465d94fae5d0bb458aa4/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:57.333414 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90775731-b84b-49a5-a4c2-f825f3b63a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=69728953f30e40cea288ea1a174d5814, user_id=1401b7e3b716465d94fae5d0bb458aa4, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:57.337315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90775731-b84b-49a5-a4c2-f825f3b63a7d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:57.355964 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1177/2362] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:11:57 2022] PUT /identity/v3/projects/69728953f30e40cea288ea1a174d5814/users/1401b7e3b716465d94fae5d0bb458aa4/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:11:57.366215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7923823-e889-40c8-808d-62897200ec6a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:57.366569 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7923823-e889-40c8-808d-62897200ec6a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:57.366829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7923823-e889-40c8-808d-62897200ec6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:57.441103 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b7923823-e889-40c8-808d-62897200ec6a None None] MFA Rules not processed for user `1401b7e3b716465d94fae5d0bb458aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:11:57.442324 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b7923823-e889-40c8-808d-62897200ec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:57.479472 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:11:57.562337 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1186/2363] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:11:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:11:57.575170 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90775731-b84b-49a5-a4c2-f825f3b63a7d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:11:57.577844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-90775731-b84b-49a5-a4c2-f825f3b63a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:11:57.691072 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90775731-b84b-49a5-a4c2-f825f3b63a7d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:11:57.701810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6db83-7b2a-4531-8ec8-8029ba82d4ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:11:57.702828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6db83-7b2a-4531-8ec8-8029ba82d4ff service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:11:57.703312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6db83-7b2a-4531-8ec8-8029ba82d4ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:11:57.703879 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6db83-7b2a-4531-8ec8-8029ba82d4ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:11:57.719319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6db83-7b2a-4531-8ec8-8029ba82d4ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:11:57.721510 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6db83-7b2a-4531-8ec8-8029ba82d4ff service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:11:57.740189 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1178/2364] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:11:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:12:01.384977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcec84-d16b-40d5-b591-d77a7dde865a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:01.385382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcec84-d16b-40d5-b591-d77a7dde865a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:01.385689 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcec84-d16b-40d5-b591-d77a7dde865a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:01.417918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-12bcec84-d16b-40d5-b591-d77a7dde865a None None] MFA Rules not processed for user `3562116abe4e4deaa84570ff5a011578`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:01.420351 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-12bcec84-d16b-40d5-b591-d77a7dde865a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:01.542521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1187/2365] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:12:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:12:01.560401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1f49d-472e-4c74-bc18-bd0a8afefdd9 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:01.560927 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1f49d-472e-4c74-bc18-bd0a8afefdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:01.561025 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1f49d-472e-4c74-bc18-bd0a8afefdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:01.568285 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcec84-d16b-40d5-b591-d77a7dde865a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:01.574464 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-12bcec84-d16b-40d5-b591-d77a7dde865a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:01.594520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-19c1f49d-472e-4c74-bc18-bd0a8afefdd9 None None] MFA Rules not processed for user `78de8b3155bf4181a27f9395030c1f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:01.600372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-19c1f49d-472e-4c74-bc18-bd0a8afefdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:01.688044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1179/2366] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:12:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:12:01.769527 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcec84-d16b-40d5-b591-d77a7dde865a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:01.787421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e639262-1a6c-4352-a3e6-58eb8fd1b235 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182c7bb48c184e9983c02ae86709e803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:01.788340 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e639262-1a6c-4352-a3e6-58eb8fd1b235 service glance] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:01.788781 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e639262-1a6c-4352-a3e6-58eb8fd1b235 service glance] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:01.789593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e639262-1a6c-4352-a3e6-58eb8fd1b235 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:01.793384 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9e639262-1a6c-4352-a3e6-58eb8fd1b235 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:01.860622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:12:01.881149 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e639262-1a6c-4352-a3e6-58eb8fd1b235 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:01.882959 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e639262-1a6c-4352-a3e6-58eb8fd1b235 service glance] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:01.897771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1188/2367] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:12:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:12:02.042658 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf085e9-1c98-47a4-a225-687cd36c884d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:02.043065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf085e9-1c98-47a4-a225-687cd36c884d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:02.043386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf085e9-1c98-47a4-a225-687cd36c884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:02.078101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:12:02.134374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2bf085e9-1c98-47a4-a225-687cd36c884d None None] MFA Rules not processed for user `b6c5da324ab2405a84036db91a1366a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:02.135505 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2bf085e9-1c98-47a4-a225-687cd36c884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:02.228069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1180/2368] 10.222.0.73 () {58 vars in 1009 bytes} [Thu May 19 12:12:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:12:02.330106 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e639262-1a6c-4352-a3e6-58eb8fd1b235 service glance] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:02.331771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9e639262-1a6c-4352-a3e6-58eb8fd1b235 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:02.447831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e639262-1a6c-4352-a3e6-58eb8fd1b235 service glance] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:02.453535 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db314d-e68b-43bd-81f1-43c94dae0134 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371dae58e95d403b97e311c6616adab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:02.454192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db314d-e68b-43bd-81f1-43c94dae0134 service swift] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:02.454475 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db314d-e68b-43bd-81f1-43c94dae0134 service swift] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:02.454752 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db314d-e68b-43bd-81f1-43c94dae0134 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:02.465168 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db314d-e68b-43bd-81f1-43c94dae0134 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:02.466946 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db314d-e68b-43bd-81f1-43c94dae0134 service swift] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:02.476772 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1189/2369] 10.222.0.73 () {60 vars in 1384 bytes} [Thu May 19 12:12:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:12:12.223507 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=41 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:12:12.472815 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=49 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:12:13.140948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873c41b-0639-482d-840a-c535ccb7f12d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:13.141264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873c41b-0639-482d-840a-c535ccb7f12d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:13.141517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873c41b-0639-482d-840a-c535ccb7f12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:13.161154 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e873c41b-0639-482d-840a-c535ccb7f12d None None] MFA Rules not processed for user `05f4b76e29444e2383a9d247f72449cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:13.162537 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e873c41b-0639-482d-840a-c535ccb7f12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:13.172480 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1181/2370] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:12:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:12:16.955472 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db314d-e68b-43bd-81f1-43c94dae0134 service swift] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:16.956997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-96db314d-e68b-43bd-81f1-43c94dae0134 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:17.060212 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db314d-e68b-43bd-81f1-43c94dae0134 service swift] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:17.065760 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd95ba-a1fc-401a-a61e-333d54f22aa9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cccb366fc6429e9a30d4f9de64e8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:17.066416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd95ba-a1fc-401a-a61e-333d54f22aa9 service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:17.066701 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd95ba-a1fc-401a-a61e-333d54f22aa9 service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:17.066978 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd95ba-a1fc-401a-a61e-333d54f22aa9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:17.068750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-22fd95ba-a1fc-401a-a61e-333d54f22aa9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:17.080646 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd95ba-a1fc-401a-a61e-333d54f22aa9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:17.082227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd95ba-a1fc-401a-a61e-333d54f22aa9 service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:17.092975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1190/2371] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:12:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:12:23.156121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:12:27.088884 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=41 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:12:33.082029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b2ee2-9bfe-4773-b138-48e6c1c26f70 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:33.082474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b2ee2-9bfe-4773-b138-48e6c1c26f70 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:33.082622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b2ee2-9bfe-4773-b138-48e6c1c26f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:33.099765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-230b2ee2-9bfe-4773-b138-48e6c1c26f70 None None] MFA Rules not processed for user `b6c5da324ab2405a84036db91a1366a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:12:33.100971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-230b2ee2-9bfe-4773-b138-48e6c1c26f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:12:33.108548 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1182/2372] 10.222.0.73 () {58 vars in 1009 bytes} [Thu May 19 12:12:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:12:33.120456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd95ba-a1fc-401a-a61e-333d54f22aa9 service placement] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:12:33.134310 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd95ba-a1fc-401a-a61e-333d54f22aa9 service placement] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:12:33.139284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ab3af-c94a-419d-8c49-d7b0f8ac78b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371dae58e95d403b97e311c6616adab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:12:33.139936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ab3af-c94a-419d-8c49-d7b0f8ac78b4 service swift] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:12:33.140238 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ab3af-c94a-419d-8c49-d7b0f8ac78b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:12:33.140512 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ab3af-c94a-419d-8c49-d7b0f8ac78b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:12:33.154155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ab3af-c94a-419d-8c49-d7b0f8ac78b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:12:33.156113 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ab3af-c94a-419d-8c49-d7b0f8ac78b4 service swift] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:12:33.171521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1191/2373] 10.222.0.73 () {60 vars in 1384 bytes} [Thu May 19 12:12:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 12:12:43.094702 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:12:43.166817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:13:09.095454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b2ee2-9bfe-4773-b138-48e6c1c26f70 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:13:09.164246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b2ee2-9bfe-4773-b138-48e6c1c26f70 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:13:09.173722 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb1f1f-ed16-4865-aae6-112eb667967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:13:09.174618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb1f1f-ed16-4865-aae6-112eb667967c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:09.174904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb1f1f-ed16-4865-aae6-112eb667967c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:09.175183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb1f1f-ed16-4865-aae6-112eb667967c admin admin] PATH_INFO: `/v3/users/1401b7e3b716465d94fae5d0bb458aa4` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:09.176452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb1f1f-ed16-4865-aae6-112eb667967c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1401b7e3b716465d94fae5d0bb458aa4)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:13:09.179983 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb1f1f-ed16-4865-aae6-112eb667967c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:13:09.225845 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dceb1f1f-ed16-4865-aae6-112eb667967c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1401b7e3b716465d94fae5d0bb458aa4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:13:09.233112 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dceb1f1f-ed16-4865-aae6-112eb667967c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1401b7e3b716465d94fae5d0bb458aa4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:13:09.239972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dceb1f1f-ed16-4865-aae6-112eb667967c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1401b7e3b716465d94fae5d0bb458aa4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:13:09.240643 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dceb1f1f-ed16-4865-aae6-112eb667967c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1401b7e3b716465d94fae5d0bb458aa4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:13:09.241256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dceb1f1f-ed16-4865-aae6-112eb667967c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1401b7e3b716465d94fae5d0bb458aa4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:13:09.260688 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1183/2374] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:13:09 2022] DELETE /identity/v3/users/1401b7e3b716465d94fae5d0bb458aa4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:13:09.265206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8a69-8575-4dbe-9c74-56a0971e4f3d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:09.265715 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8a69-8575-4dbe-9c74-56a0971e4f3d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:09.265834 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8a69-8575-4dbe-9c74-56a0971e4f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:09.286758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-068e8a69-8575-4dbe-9c74-56a0971e4f3d None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:13:09.287997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-068e8a69-8575-4dbe-9c74-56a0971e4f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:13:09.378872 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1192/2375] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:13:09.391540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb1f1f-ed16-4865-aae6-112eb667967c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:13:09.393238 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dceb1f1f-ed16-4865-aae6-112eb667967c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:13:09.458620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb1f1f-ed16-4865-aae6-112eb667967c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:13:09.462498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6142d-4f32-443f-a43c-a604ca57e643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:13:09.463216 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6142d-4f32-443f-a43c-a604ca57e643 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:09.463498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6142d-4f32-443f-a43c-a604ca57e643 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:09.463772 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6142d-4f32-443f-a43c-a604ca57e643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:09.473022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6142d-4f32-443f-a43c-a604ca57e643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:13:09.475692 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6142d-4f32-443f-a43c-a604ca57e643 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:13:09.486344 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1184/2376] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:13:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:13:09.861185 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8a69-8575-4dbe-9c74-56a0971e4f3d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:13:09.862693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-068e8a69-8575-4dbe-9c74-56a0971e4f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:13:09.875370 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8a69-8575-4dbe-9c74-56a0971e4f3d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:13:09.880616 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a19a4-a47b-4e42-bec4-d4d4a8d7abe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:13:09.881496 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a19a4-a47b-4e42-bec4-d4d4a8d7abe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:09.881783 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a19a4-a47b-4e42-bec4-d4d4a8d7abe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:09.882066 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a19a4-a47b-4e42-bec4-d4d4a8d7abe8 admin admin] PATH_INFO: `/v3/projects/69728953f30e40cea288ea1a174d5814` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:09.883282 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a19a4-a47b-4e42-bec4-d4d4a8d7abe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69728953f30e40cea288ea1a174d5814)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:13:09.886560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a19a4-a47b-4e42-bec4-d4d4a8d7abe8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:13:09.944566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-047a19a4-a47b-4e42-bec4-d4d4a8d7abe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69728953f30e40cea288ea1a174d5814', 'request_id': 'req-047a19a4-a47b-4e42-bec4-d4d4a8d7abe8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:13:09.953183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-047a19a4-a47b-4e42-bec4-d4d4a8d7abe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69728953f30e40cea288ea1a174d5814', 'request_id': 'req-047a19a4-a47b-4e42-bec4-d4d4a8d7abe8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:13:09.962007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-047a19a4-a47b-4e42-bec4-d4d4a8d7abe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69728953f30e40cea288ea1a174d5814', 'request_id': 'req-047a19a4-a47b-4e42-bec4-d4d4a8d7abe8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:13:09.973949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-047a19a4-a47b-4e42-bec4-d4d4a8d7abe8 admin admin] The token cache is being invalidate because project 69728953f30e40cea288ea1a174d5814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:13:09.974229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-047a19a4-a47b-4e42-bec4-d4d4a8d7abe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:13:09.975061 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-047a19a4-a47b-4e42-bec4-d4d4a8d7abe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:13:09.976888 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1193/2377] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:13:09 2022] DELETE /identity/v3/projects/69728953f30e40cea288ea1a174d5814 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:13:19.481123 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:13:19.970590 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:13:35.102092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6142d-4f32-443f-a43c-a604ca57e643 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:13:35.103504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d7b6142d-4f32-443f-a43c-a604ca57e643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:13:35.115170 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6142d-4f32-443f-a43c-a604ca57e643 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:13:35.167383 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bda77-df01-4329-8ed2-8ae38e819614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:13:35.169686 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bda77-df01-4329-8ed2-8ae38e819614 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:35.169686 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bda77-df01-4329-8ed2-8ae38e819614 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:35.169686 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bda77-df01-4329-8ed2-8ae38e819614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:35.171119 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-419bda77-df01-4329-8ed2-8ae38e819614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:13:35.240049 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bda77-df01-4329-8ed2-8ae38e819614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:13:35.241602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bda77-df01-4329-8ed2-8ae38e819614 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:13:35.251679 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1185/2378] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:13:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:13:43.573872 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdea25c-4b52-497d-9afc-c640cc712685 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:43.574417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdea25c-4b52-497d-9afc-c640cc712685 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:43.574558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdea25c-4b52-497d-9afc-c640cc712685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:43.594800 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2cdea25c-4b52-497d-9afc-c640cc712685 None None] MFA Rules not processed for user `b6c5da324ab2405a84036db91a1366a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:13:43.596151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2cdea25c-4b52-497d-9afc-c640cc712685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:13:43.653017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1194/2379] 10.222.0.73 () {58 vars in 1009 bytes} [Thu May 19 12:13:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:13:43.694851 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bda77-df01-4329-8ed2-8ae38e819614 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:13:43.696460 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-419bda77-df01-4329-8ed2-8ae38e819614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:13:43.778213 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bda77-df01-4329-8ed2-8ae38e819614 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:13:43.783543 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37944c36-dc6c-4898-b863-313596f7e2ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371dae58e95d403b97e311c6616adab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:13:43.784175 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37944c36-dc6c-4898-b863-313596f7e2ca service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:43.784467 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37944c36-dc6c-4898-b863-313596f7e2ca service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:43.784749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37944c36-dc6c-4898-b863-313596f7e2ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:43.794557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37944c36-dc6c-4898-b863-313596f7e2ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:13:43.796691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37944c36-dc6c-4898-b863-313596f7e2ca service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:13:43.808190 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1186/2380] 10.222.0.73 () {60 vars in 1384 bytes} [Thu May 19 12:13:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:13:53.646103 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=25 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:13:53.801970 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=82 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:13:56.928544 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d44554-cf85-4348-ba87-ad99f92e7db5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:13:56.929030 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d44554-cf85-4348-ba87-ad99f92e7db5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:13:56.929132 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d44554-cf85-4348-ba87-ad99f92e7db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:13:56.946966 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a9d44554-cf85-4348-ba87-ad99f92e7db5 None None] MFA Rules not processed for user `d7e5e021873b49efafbeb1cbc12ff4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:13:56.948215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a9d44554-cf85-4348-ba87-ad99f92e7db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:13:57.002015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1195/2381] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:13:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:14:01.668643 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4f565-1444-4c0e-b921-76f37bf63383 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:01.669239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4f565-1444-4c0e-b921-76f37bf63383 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:01.669239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4f565-1444-4c0e-b921-76f37bf63383 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:01.670830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1187/2382] 10.222.0.73 () {54 vars in 921 bytes} [Thu May 19 12:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:14:01.677153 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e8ef0-05a9-4cef-81b9-2cc7bbe3637e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:01.677662 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e8ef0-05a9-4cef-81b9-2cc7bbe3637e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:01.678085 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e8ef0-05a9-4cef-81b9-2cc7bbe3637e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:01.731226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-367e8ef0-05a9-4cef-81b9-2cc7bbe3637e None None] MFA Rules not processed for user `bd0c1f0710f3447d94e67048a508781e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:14:01.732474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-367e8ef0-05a9-4cef-81b9-2cc7bbe3637e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:01.814531 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1196/2383] 10.222.0.73 () {58 vars in 1018 bytes} [Thu May 19 12:14:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:14:01.826125 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4f565-1444-4c0e-b921-76f37bf63383 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:14:01.828310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-34c4f565-1444-4c0e-b921-76f37bf63383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:01.890770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4f565-1444-4c0e-b921-76f37bf63383 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:14:01.894456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2217768-d253-428c-8a1e-39cc7d0fa805 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182c7bb48c184e9983c02ae86709e803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:14:01.895110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2217768-d253-428c-8a1e-39cc7d0fa805 service glance] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:01.895396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2217768-d253-428c-8a1e-39cc7d0fa805 service glance] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:01.895676 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2217768-d253-428c-8a1e-39cc7d0fa805 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:01.906204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2217768-d253-428c-8a1e-39cc7d0fa805 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:14:01.907806 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2217768-d253-428c-8a1e-39cc7d0fa805 service glance] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:14:01.924729 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1188/2384] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:14:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:14:02.003132 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab3d02-0127-4559-bfa4-dfddabed9614 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:02.003369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab3d02-0127-4559-bfa4-dfddabed9614 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:02.003608 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab3d02-0127-4559-bfa4-dfddabed9614 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:02.005317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1197/2385] 10.222.0.73 () {54 vars in 921 bytes} [Thu May 19 12:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:14:02.010233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f9a3f-d4a0-471a-b659-e650a16bdf83 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:02.010524 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f9a3f-d4a0-471a-b659-e650a16bdf83 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:02.010804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f9a3f-d4a0-471a-b659-e650a16bdf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:02.036124 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-323f9a3f-d4a0-471a-b659-e650a16bdf83 None None] MFA Rules not processed for user `4897919923a64881ac5540cc5d58df1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:14:02.037319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-323f9a3f-d4a0-471a-b659-e650a16bdf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:02.051180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1189/2386] 10.222.0.73 () {58 vars in 1018 bytes} [Thu May 19 12:14:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:14:02.070844 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab3d02-0127-4559-bfa4-dfddabed9614 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:14:02.073076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-87ab3d02-0127-4559-bfa4-dfddabed9614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:02.086621 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab3d02-0127-4559-bfa4-dfddabed9614 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:14:02.094163 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5b799-485c-47b2-a79a-0fa14296f392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:14:02.094918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5b799-485c-47b2-a79a-0fa14296f392 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:02.095520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5b799-485c-47b2-a79a-0fa14296f392 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:02.096431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5b799-485c-47b2-a79a-0fa14296f392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:02.104855 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5b799-485c-47b2-a79a-0fa14296f392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:14:02.106867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5b799-485c-47b2-a79a-0fa14296f392 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:14:02.114976 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1198/2387] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:14:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:14:02.231962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae1360-374a-40cd-9b5b-02b261f9f9ad None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:02.232426 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae1360-374a-40cd-9b5b-02b261f9f9ad None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:02.233094 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae1360-374a-40cd-9b5b-02b261f9f9ad None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:02.234882 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1190/2388] 10.222.0.73 () {54 vars in 921 bytes} [Thu May 19 12:14:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 12:14:02.239745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab6cb1-2e9d-427c-83f9-822e4dc71c72 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:02.240076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab6cb1-2e9d-427c-83f9-822e4dc71c72 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:02.240364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab6cb1-2e9d-427c-83f9-822e4dc71c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:02.288753 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-66ab6cb1-2e9d-427c-83f9-822e4dc71c72 None None] MFA Rules not processed for user `bd0c1f0710f3447d94e67048a508781e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:14:02.290007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-66ab6cb1-2e9d-427c-83f9-822e4dc71c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:02.302770 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1199/2389] 10.222.0.73 () {58 vars in 1018 bytes} [Thu May 19 12:14:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:14:02.313143 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae1360-374a-40cd-9b5b-02b261f9f9ad None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:14:02.324127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae1360-374a-40cd-9b5b-02b261f9f9ad None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:14:02.327745 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a36ede-057f-4a28-bc87-6eb2f7abd0f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:14:02.328422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a36ede-057f-4a28-bc87-6eb2f7abd0f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:02.328712 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a36ede-057f-4a28-bc87-6eb2f7abd0f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:02.328990 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a36ede-057f-4a28-bc87-6eb2f7abd0f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:02.339644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a36ede-057f-4a28-bc87-6eb2f7abd0f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:14:02.341690 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a36ede-057f-4a28-bc87-6eb2f7abd0f4 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:14:02.352797 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1191/2390] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:14:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:14:06.716962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab6cb1-2e9d-427c-83f9-822e4dc71c72 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:14:06.726250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab6cb1-2e9d-427c-83f9-822e4dc71c72 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:14:06.730349 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d73ce1-f9c3-43f1-9a67-9046f920f094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:14:06.730988 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d73ce1-f9c3-43f1-9a67-9046f920f094 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:06.731277 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d73ce1-f9c3-43f1-9a67-9046f920f094 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:06.731558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d73ce1-f9c3-43f1-9a67-9046f920f094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:06.733372 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c0d73ce1-f9c3-43f1-9a67-9046f920f094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:06.746984 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d73ce1-f9c3-43f1-9a67-9046f920f094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:14:06.748461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d73ce1-f9c3-43f1-9a67-9046f920f094 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:14:06.759290 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1200/2391] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:14:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:14:07.624091 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a36ede-057f-4a28-bc87-6eb2f7abd0f4 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:14:07.625527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-28a36ede-057f-4a28-bc87-6eb2f7abd0f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:07.636846 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a36ede-057f-4a28-bc87-6eb2f7abd0f4 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:14:07.641280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4440f1-69e0-4ac0-81b9-6b77ef5d17c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:14:07.642046 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4440f1-69e0-4ac0-81b9-6b77ef5d17c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:07.642360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4440f1-69e0-4ac0-81b9-6b77ef5d17c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:07.642606 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4440f1-69e0-4ac0-81b9-6b77ef5d17c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:07.644452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0f4440f1-69e0-4ac0-81b9-6b77ef5d17c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:07.658387 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4440f1-69e0-4ac0-81b9-6b77ef5d17c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:14:07.659816 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4440f1-69e0-4ac0-81b9-6b77ef5d17c6 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:14:07.671230 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1192/2392] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:14:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:14:08.771511 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ed82b-1f14-4453-83dc-3b3d5a728d28 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:08.771979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ed82b-1f14-4453-83dc-3b3d5a728d28 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:08.772116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ed82b-1f14-4453-83dc-3b3d5a728d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:08.791156 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-679ed82b-1f14-4453-83dc-3b3d5a728d28 None None] MFA Rules not processed for user `b6c5da324ab2405a84036db91a1366a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:14:08.792395 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-679ed82b-1f14-4453-83dc-3b3d5a728d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:08.799766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1201/2393] 10.222.0.73 () {58 vars in 1009 bytes} [Thu May 19 12:14:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:14:08.811867 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4440f1-69e0-4ac0-81b9-6b77ef5d17c6 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:14:08.822737 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4440f1-69e0-4ac0-81b9-6b77ef5d17c6 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:14:08.828699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f47f9b-c3ae-42c6-8daf-e1920b9febe9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371dae58e95d403b97e311c6616adab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:14:08.829335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f47f9b-c3ae-42c6-8daf-e1920b9febe9 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:08.829621 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f47f9b-c3ae-42c6-8daf-e1920b9febe9 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:08.829897 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f47f9b-c3ae-42c6-8daf-e1920b9febe9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:08.838284 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f47f9b-c3ae-42c6-8daf-e1920b9febe9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:14:08.840004 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f47f9b-c3ae-42c6-8daf-e1920b9febe9 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:14:08.848506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1193/2394] 10.222.0.73 () {60 vars in 1384 bytes} [Thu May 19 12:14:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:14:18.254251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ed82b-1f14-4453-83dc-3b3d5a728d28 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:14:18.255637 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-679ed82b-1f14-4453-83dc-3b3d5a728d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:18.272066 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ed82b-1f14-4453-83dc-3b3d5a728d28 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:14:18.278331 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d924c-b37e-43ee-af5a-73a4c5a55a00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:14:18.279001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d924c-b37e-43ee-af5a-73a4c5a55a00 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:18.279292 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d924c-b37e-43ee-af5a-73a4c5a55a00 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:18.279572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d924c-b37e-43ee-af5a-73a4c5a55a00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:18.281501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-296d924c-b37e-43ee-af5a-73a4c5a55a00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:18.304499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:14:18.348078 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d924c-b37e-43ee-af5a-73a4c5a55a00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:14:18.349713 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d924c-b37e-43ee-af5a-73a4c5a55a00 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:14:18.360454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1202/2395] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:14:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:14:18.845507 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=47 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:14:28.355206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=17 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:14:40.880428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f47f9b-c3ae-42c6-8daf-e1920b9febe9 service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:14:40.891267 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f47f9b-c3ae-42c6-8daf-e1920b9febe9 service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:14:40.894970 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a4fec-e3e0-45f3-a54d-9a38c8a7224e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:14:40.895619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a4fec-e3e0-45f3-a54d-9a38c8a7224e service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:40.896066 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a4fec-e3e0-45f3-a54d-9a38c8a7224e service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:40.896353 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a4fec-e3e0-45f3-a54d-9a38c8a7224e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:40.898517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b53a4fec-e3e0-45f3-a54d-9a38c8a7224e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:40.909102 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a4fec-e3e0-45f3-a54d-9a38c8a7224e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:14:40.910576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a4fec-e3e0-45f3-a54d-9a38c8a7224e service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:14:40.919111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1194/2396] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:14:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:14:41.184426 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464df9f-f04f-45cd-b4e0-52980571aaae None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:41.185039 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464df9f-f04f-45cd-b4e0-52980571aaae None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:41.185039 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464df9f-f04f-45cd-b4e0-52980571aaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:41.201905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7464df9f-f04f-45cd-b4e0-52980571aaae None None] MFA Rules not processed for user `28ab60df0ab542279092f80971a74204`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:14:41.203116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7464df9f-f04f-45cd-b4e0-52980571aaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:41.257850 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1203/2397] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:14:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:14:41.552755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a4fec-e3e0-45f3-a54d-9a38c8a7224e service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:14:41.561226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a4fec-e3e0-45f3-a54d-9a38c8a7224e service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:14:41.564829 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e90e3-9c0e-4f43-8b1b-6030795fb2c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:14:41.565552 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e90e3-9c0e-4f43-8b1b-6030795fb2c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:41.565844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e90e3-9c0e-4f43-8b1b-6030795fb2c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:41.566121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e90e3-9c0e-4f43-8b1b-6030795fb2c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:41.567954 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-820e90e3-9c0e-4f43-8b1b-6030795fb2c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:41.577233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e90e3-9c0e-4f43-8b1b-6030795fb2c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:14:41.578650 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e90e3-9c0e-4f43-8b1b-6030795fb2c8 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:14:41.586587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1195/2398] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:14:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:14:41.905614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464df9f-f04f-45cd-b4e0-52980571aaae None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:14:41.906981 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7464df9f-f04f-45cd-b4e0-52980571aaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:41.986785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464df9f-f04f-45cd-b4e0-52980571aaae None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:14:41.992048 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306dc60-85b4-47ba-ac57-f3652d062e31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cccb366fc6429e9a30d4f9de64e8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:14:41.992698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306dc60-85b4-47ba-ac57-f3652d062e31 service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:41.992983 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306dc60-85b4-47ba-ac57-f3652d062e31 service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:41.993270 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306dc60-85b4-47ba-ac57-f3652d062e31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:41.995058 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3306dc60-85b4-47ba-ac57-f3652d062e31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:42.010517 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306dc60-85b4-47ba-ac57-f3652d062e31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:14:42.012527 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306dc60-85b4-47ba-ac57-f3652d062e31 service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:14:42.022718 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1204/2399] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:14:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:14:43.145327 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73928a-cb4e-475d-bffb-0d8de007bc93 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:43.145837 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73928a-cb4e-475d-bffb-0d8de007bc93 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:43.145923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73928a-cb4e-475d-bffb-0d8de007bc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:43.168823 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0a73928a-cb4e-475d-bffb-0d8de007bc93 None None] MFA Rules not processed for user `b6c5da324ab2405a84036db91a1366a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:14:43.170062 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0a73928a-cb4e-475d-bffb-0d8de007bc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:43.177927 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1196/2400] 10.222.0.73 () {58 vars in 967 bytes} [Thu May 19 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:14:43.201474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306dc60-85b4-47ba-ac57-f3652d062e31 service placement] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:14:43.213070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306dc60-85b4-47ba-ac57-f3652d062e31 service placement] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:14:43.218235 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98152774-257d-4ee3-b313-ebacfee9fc05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371dae58e95d403b97e311c6616adab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:14:43.218887 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98152774-257d-4ee3-b313-ebacfee9fc05 service swift] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:43.219175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98152774-257d-4ee3-b313-ebacfee9fc05 service swift] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:43.219457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98152774-257d-4ee3-b313-ebacfee9fc05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:43.227828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98152774-257d-4ee3-b313-ebacfee9fc05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:14:43.229449 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98152774-257d-4ee3-b313-ebacfee9fc05 service swift] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:14:43.237586 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1205/2401] 10.222.0.73 () {60 vars in 1384 bytes} [Thu May 19 12:14:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:14:45.516834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73928a-cb4e-475d-bffb-0d8de007bc93 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:14:45.530897 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73928a-cb4e-475d-bffb-0d8de007bc93 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:14:45.536866 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5b975-155f-45c0-95dd-70b8bf1e7ef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:14:45.537622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5b975-155f-45c0-95dd-70b8bf1e7ef5 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:45.537982 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5b975-155f-45c0-95dd-70b8bf1e7ef5 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:45.538785 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5b975-155f-45c0-95dd-70b8bf1e7ef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:45.540967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0ba5b975-155f-45c0-95dd-70b8bf1e7ef5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:45.554804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5b975-155f-45c0-95dd-70b8bf1e7ef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:14:45.556732 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5b975-155f-45c0-95dd-70b8bf1e7ef5 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:14:45.568696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1197/2402] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:14:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:14:53.234285 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=63 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:14:54.526049 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98152774-257d-4ee3-b313-ebacfee9fc05 service swift] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:14:54.538491 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98152774-257d-4ee3-b313-ebacfee9fc05 service swift] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:14:54.544489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102d593-8652-4775-b10f-9305ef09fb3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:14:54.545123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102d593-8652-4775-b10f-9305ef09fb3d service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:14:54.545408 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102d593-8652-4775-b10f-9305ef09fb3d service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:14:54.545682 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102d593-8652-4775-b10f-9305ef09fb3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:14:54.547415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9102d593-8652-4775-b10f-9305ef09fb3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:14:54.604399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102d593-8652-4775-b10f-9305ef09fb3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:14:54.606004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102d593-8652-4775-b10f-9305ef09fb3d service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:14:54.615034 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1206/2403] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:14:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:14:55.564548 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=21 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:04.405997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5b975-155f-45c0-95dd-70b8bf1e7ef5 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:15:04.422341 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5b975-155f-45c0-95dd-70b8bf1e7ef5 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:15:04.429010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558bea2-25a1-4d10-b319-cefe58652395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:15:04.429669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558bea2-25a1-4d10-b319-cefe58652395 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:04.429959 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558bea2-25a1-4d10-b319-cefe58652395 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:04.430244 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558bea2-25a1-4d10-b319-cefe58652395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:04.432111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0558bea2-25a1-4d10-b319-cefe58652395 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:15:04.445305 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558bea2-25a1-4d10-b319-cefe58652395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:15:04.446937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558bea2-25a1-4d10-b319-cefe58652395 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:15:04.458201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1198/2404] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:15:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:15:04.610886 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=28 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:08.831158 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102d593-8652-4775-b10f-9305ef09fb3d service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:15:08.832823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9102d593-8652-4775-b10f-9305ef09fb3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:15:08.854567 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102d593-8652-4775-b10f-9305ef09fb3d service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:15:08.860151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373679bc-d7d7-4ec6-b45d-9e9f7e99b33f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:15:08.860802 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373679bc-d7d7-4ec6-b45d-9e9f7e99b33f service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:08.861093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373679bc-d7d7-4ec6-b45d-9e9f7e99b33f service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:08.861372 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373679bc-d7d7-4ec6-b45d-9e9f7e99b33f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:08.863223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-373679bc-d7d7-4ec6-b45d-9e9f7e99b33f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:15:08.875507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373679bc-d7d7-4ec6-b45d-9e9f7e99b33f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:15:08.877127 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373679bc-d7d7-4ec6-b45d-9e9f7e99b33f service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:15:08.888241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1207/2405] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:15:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:15:14.453859 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:18.883221 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:36.441235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d6e3b-e23a-4bd4-93fb-f81d8eabbbb4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:36.441757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d6e3b-e23a-4bd4-93fb-f81d8eabbbb4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:36.441861 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d6e3b-e23a-4bd4-93fb-f81d8eabbbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:36.459524 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-db2d6e3b-e23a-4bd4-93fb-f81d8eabbbb4 None None] MFA Rules not processed for user `78de8b3155bf4181a27f9395030c1f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:15:36.460765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-db2d6e3b-e23a-4bd4-93fb-f81d8eabbbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:15:36.467605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1199/2406] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:15:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:15:41.677151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373679bc-d7d7-4ec6-b45d-9e9f7e99b33f service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:15:41.680429 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-373679bc-d7d7-4ec6-b45d-9e9f7e99b33f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:15:41.774768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373679bc-d7d7-4ec6-b45d-9e9f7e99b33f service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:15:41.780424 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2338d9e-2090-4081-935b-585cdb124d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:15:41.781470 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2338d9e-2090-4081-935b-585cdb124d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:41.781787 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2338d9e-2090-4081-935b-585cdb124d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:41.782427 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2338d9e-2090-4081-935b-585cdb124d98 admin admin] PATH_INFO: `/v3/users/d7e5e021873b49efafbeb1cbc12ff4d9` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:41.784244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2338d9e-2090-4081-935b-585cdb124d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e5e021873b49efafbeb1cbc12ff4d9)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:15:41.785637 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2338d9e-2090-4081-935b-585cdb124d98 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:15:41.851537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f2338d9e-2090-4081-935b-585cdb124d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e5e021873b49efafbeb1cbc12ff4d9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:41.851537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f2338d9e-2090-4081-935b-585cdb124d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e5e021873b49efafbeb1cbc12ff4d9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:41.851537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f2338d9e-2090-4081-935b-585cdb124d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e5e021873b49efafbeb1cbc12ff4d9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:41.860206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f2338d9e-2090-4081-935b-585cdb124d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e5e021873b49efafbeb1cbc12ff4d9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:41.873980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f2338d9e-2090-4081-935b-585cdb124d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e5e021873b49efafbeb1cbc12ff4d9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:41.879576 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1208/2407] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:15:41 2022] DELETE /identity/v3/users/d7e5e021873b49efafbeb1cbc12ff4d9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:15:42.280517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d6e3b-e23a-4bd4-93fb-f81d8eabbbb4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:15:42.291486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d6e3b-e23a-4bd4-93fb-f81d8eabbbb4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:15:42.355251 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f19df-2342-4552-a4c0-7f741b83ee3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:15:42.356133 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f19df-2342-4552-a4c0-7f741b83ee3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:15:42.356628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f19df-2342-4552-a4c0-7f741b83ee3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:15:42.356808 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f19df-2342-4552-a4c0-7f741b83ee3b admin admin] PATH_INFO: `/v3/projects/26c5cae26ba54286a7f6ca55e380d2f7` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:15:42.358573 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f19df-2342-4552-a4c0-7f741b83ee3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c5cae26ba54286a7f6ca55e380d2f7)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:15:42.360570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f19df-2342-4552-a4c0-7f741b83ee3b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:15:42.410948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-469f19df-2342-4552-a4c0-7f741b83ee3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c5cae26ba54286a7f6ca55e380d2f7', 'request_id': 'req-469f19df-2342-4552-a4c0-7f741b83ee3b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:42.416550 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-469f19df-2342-4552-a4c0-7f741b83ee3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c5cae26ba54286a7f6ca55e380d2f7', 'request_id': 'req-469f19df-2342-4552-a4c0-7f741b83ee3b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:42.424880 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-469f19df-2342-4552-a4c0-7f741b83ee3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c5cae26ba54286a7f6ca55e380d2f7', 'request_id': 'req-469f19df-2342-4552-a4c0-7f741b83ee3b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:42.436691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-469f19df-2342-4552-a4c0-7f741b83ee3b admin admin] The token cache is being invalidate because project 26c5cae26ba54286a7f6ca55e380d2f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:15:42.436983 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-469f19df-2342-4552-a4c0-7f741b83ee3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:42.437640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-469f19df-2342-4552-a4c0-7f741b83ee3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:15:42.439201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1200/2408] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:15:42 2022] DELETE /identity/v3/projects/26c5cae26ba54286a7f6ca55e380d2f7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:15:51.875757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:52.433022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:16:15.855190 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bbd40-c9d3-43a2-90ba-0ad23fbb427e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:16:15.855699 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bbd40-c9d3-43a2-90ba-0ad23fbb427e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:16:15.855802 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bbd40-c9d3-43a2-90ba-0ad23fbb427e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:16:15.872658 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-910bbd40-c9d3-43a2-90ba-0ad23fbb427e None None] MFA Rules not processed for user `dd29391d48434f67894eb8efcec99012`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:16:15.873864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-910bbd40-c9d3-43a2-90ba-0ad23fbb427e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:16:15.929423 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1209/2409] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:16:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:16:25.922804 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=25 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:16:38.597831 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f19df-2342-4552-a4c0-7f741b83ee3b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:16:38.599543 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-469f19df-2342-4552-a4c0-7f741b83ee3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:16:38.671944 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f19df-2342-4552-a4c0-7f741b83ee3b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:16:38.677376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d5824-1d4b-43ac-bb27-857588778cde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:16:38.678020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d5824-1d4b-43ac-bb27-857588778cde service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:16:38.678331 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d5824-1d4b-43ac-bb27-857588778cde service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:16:38.678591 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d5824-1d4b-43ac-bb27-857588778cde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:16:38.680420 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-165d5824-1d4b-43ac-bb27-857588778cde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:16:38.737578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d5824-1d4b-43ac-bb27-857588778cde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:16:38.739210 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d5824-1d4b-43ac-bb27-857588778cde service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:16:38.749254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1201/2410] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:16:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:16:48.744525 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=56 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:16:50.497568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d38255-d3ac-4151-9937-eab1ec5c1a37 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:16:50.498052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d38255-d3ac-4151-9937-eab1ec5c1a37 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:16:50.498194 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d38255-d3ac-4151-9937-eab1ec5c1a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:16:50.516183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-98d38255-d3ac-4151-9937-eab1ec5c1a37 None None] MFA Rules not processed for user `28ab60df0ab542279092f80971a74204`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:16:50.517389 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-98d38255-d3ac-4151-9937-eab1ec5c1a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:16:50.524342 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1210/2411] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:16:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:00.510237 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:04.403986 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d5824-1d4b-43ac-bb27-857588778cde service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:04.415311 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d5824-1d4b-43ac-bb27-857588778cde service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:04.420975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfe5f7-2135-4490-a675-b4ea17880060 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:04.421712 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfe5f7-2135-4490-a675-b4ea17880060 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:04.422007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfe5f7-2135-4490-a675-b4ea17880060 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:04.422293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfe5f7-2135-4490-a675-b4ea17880060 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:04.424141 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-96bfe5f7-2135-4490-a675-b4ea17880060 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:04.481875 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfe5f7-2135-4490-a675-b4ea17880060 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:04.483493 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfe5f7-2135-4490-a675-b4ea17880060 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:04.492680 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1202/2412] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:17:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:04.835591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d38255-d3ac-4151-9937-eab1ec5c1a37 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:04.837126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-98d38255-d3ac-4151-9937-eab1ec5c1a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:04.897094 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d38255-d3ac-4151-9937-eab1ec5c1a37 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:04.900945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76dd3fe-74c9-47ef-a41e-f1a3ad4fecad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:04.901617 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dd3fe-74c9-47ef-a41e-f1a3ad4fecad service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:04.901911 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dd3fe-74c9-47ef-a41e-f1a3ad4fecad service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:04.902187 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dd3fe-74c9-47ef-a41e-f1a3ad4fecad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:04.904653 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d76dd3fe-74c9-47ef-a41e-f1a3ad4fecad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:04.972489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76dd3fe-74c9-47ef-a41e-f1a3ad4fecad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:04.973935 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76dd3fe-74c9-47ef-a41e-f1a3ad4fecad service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:04.985210 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1211/2413] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:09.569797 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfe5f7-2135-4490-a675-b4ea17880060 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:09.571291 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-96bfe5f7-2135-4490-a675-b4ea17880060 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:09.612669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfe5f7-2135-4490-a675-b4ea17880060 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:09.617590 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa4bd5-3498-4170-8b5c-c218abd346c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:09.618841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa4bd5-3498-4170-8b5c-c218abd346c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:09.619130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa4bd5-3498-4170-8b5c-c218abd346c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:09.619412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa4bd5-3498-4170-8b5c-c218abd346c9 admin admin] PATH_INFO: `/v3/users/78de8b3155bf4181a27f9395030c1f6a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:09.620669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa4bd5-3498-4170-8b5c-c218abd346c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78de8b3155bf4181a27f9395030c1f6a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:09.622659 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa4bd5-3498-4170-8b5c-c218abd346c9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:09.679495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6eaa4bd5-3498-4170-8b5c-c218abd346c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78de8b3155bf4181a27f9395030c1f6a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:09.688139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6eaa4bd5-3498-4170-8b5c-c218abd346c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78de8b3155bf4181a27f9395030c1f6a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:09.704891 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6eaa4bd5-3498-4170-8b5c-c218abd346c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78de8b3155bf4181a27f9395030c1f6a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:09.705759 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6eaa4bd5-3498-4170-8b5c-c218abd346c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78de8b3155bf4181a27f9395030c1f6a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:09.706481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6eaa4bd5-3498-4170-8b5c-c218abd346c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78de8b3155bf4181a27f9395030c1f6a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:09.727205 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1203/2414] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:17:09 2022] DELETE /identity/v3/users/78de8b3155bf4181a27f9395030c1f6a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:09.943907 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76dd3fe-74c9-47ef-a41e-f1a3ad4fecad service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:09.956096 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76dd3fe-74c9-47ef-a41e-f1a3ad4fecad service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:10.035161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30113415-8563-47c4-be03-26106ecad8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:10.036131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30113415-8563-47c4-be03-26106ecad8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:10.036419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30113415-8563-47c4-be03-26106ecad8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:10.036702 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30113415-8563-47c4-be03-26106ecad8fa admin admin] PATH_INFO: `/v3/projects/cc116fcb3c3a4aecb4a00f28430d58c7` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:10.038312 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30113415-8563-47c4-be03-26106ecad8fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc116fcb3c3a4aecb4a00f28430d58c7)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:10.040396 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30113415-8563-47c4-be03-26106ecad8fa admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:10.101673 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-30113415-8563-47c4-be03-26106ecad8fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc116fcb3c3a4aecb4a00f28430d58c7', 'request_id': 'req-30113415-8563-47c4-be03-26106ecad8fa'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:10.107133 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:10.113217 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-30113415-8563-47c4-be03-26106ecad8fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc116fcb3c3a4aecb4a00f28430d58c7', 'request_id': 'req-30113415-8563-47c4-be03-26106ecad8fa'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:10.123374 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-30113415-8563-47c4-be03-26106ecad8fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc116fcb3c3a4aecb4a00f28430d58c7', 'request_id': 'req-30113415-8563-47c4-be03-26106ecad8fa'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:10.136314 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-30113415-8563-47c4-be03-26106ecad8fa admin admin] The token cache is being invalidate because project cc116fcb3c3a4aecb4a00f28430d58c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:17:10.136614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-30113415-8563-47c4-be03-26106ecad8fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:10.138031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-30113415-8563-47c4-be03-26106ecad8fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:10.139627 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1212/2415] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:17:09 2022] DELETE /identity/v3/projects/cc116fcb3c3a4aecb4a00f28430d58c7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:10.144759 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee2e79-ce23-45ec-8f4c-d776a1ba5f45 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:10.145297 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee2e79-ce23-45ec-8f4c-d776a1ba5f45 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:10.145803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee2e79-ce23-45ec-8f4c-d776a1ba5f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:10.166131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a6ee2e79-ce23-45ec-8f4c-d776a1ba5f45 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:10.167444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a6ee2e79-ce23-45ec-8f4c-d776a1ba5f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:10.241430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1204/2416] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:17:10.253548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8d888-9ae7-4385-8a1e-f602a4f7e8f3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:10.253922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8d888-9ae7-4385-8a1e-f602a4f7e8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:10.254260 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8d888-9ae7-4385-8a1e-f602a4f7e8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:10.280074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c1d8d888-9ae7-4385-8a1e-f602a4f7e8f3 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:10.281317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c1d8d888-9ae7-4385-8a1e-f602a4f7e8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:10.289896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1213/2417] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:10.294558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee2e79-ce23-45ec-8f4c-d776a1ba5f45 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:10.304530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee2e79-ce23-45ec-8f4c-d776a1ba5f45 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:10.310305 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72da999-4776-4cdc-b111-34ed494b50ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:10.311177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72da999-4776-4cdc-b111-34ed494b50ab admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:10.311464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72da999-4776-4cdc-b111-34ed494b50ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:10.311995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72da999-4776-4cdc-b111-34ed494b50ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:10.312677 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72da999-4776-4cdc-b111-34ed494b50ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:17:10.312987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72da999-4776-4cdc-b111-34ed494b50ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:10.314592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72da999-4776-4cdc-b111-34ed494b50ab admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:10.326090 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:10.336778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1205/2418] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:17:10.338175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8d888-9ae7-4385-8a1e-f602a4f7e8f3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:10.349093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8d888-9ae7-4385-8a1e-f602a4f7e8f3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:10.354059 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92801942-3964-44f9-a7c2-d649dab30337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:10.354724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92801942-3964-44f9-a7c2-d649dab30337 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:10.355015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92801942-3964-44f9-a7c2-d649dab30337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:10.355296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92801942-3964-44f9-a7c2-d649dab30337 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:10.356087 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92801942-3964-44f9-a7c2-d649dab30337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:10.358092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92801942-3964-44f9-a7c2-d649dab30337 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:10.399756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1214/2419] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:17:10 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:17:10.403899 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72da999-4776-4cdc-b111-34ed494b50ab admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:10.414189 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72da999-4776-4cdc-b111-34ed494b50ab admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:10.470084 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8938c-fe8b-4477-89a8-baa58d2528cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:10.470755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8938c-fe8b-4477-89a8-baa58d2528cf admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:10.471044 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8938c-fe8b-4477-89a8-baa58d2528cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:10.471326 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8938c-fe8b-4477-89a8-baa58d2528cf admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:10.472065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8938c-fe8b-4477-89a8-baa58d2528cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:10.473984 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8938c-fe8b-4477-89a8-baa58d2528cf admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:10.493957 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1206/2420] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:17:10 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:17:10.498509 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92801942-3964-44f9-a7c2-d649dab30337 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:10.508953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92801942-3964-44f9-a7c2-d649dab30337 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:10.514172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa1470-9f30-4fd9-8ec6-b8c3223b1962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:10.514826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa1470-9f30-4fd9-8ec6-b8c3223b1962 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:10.515111 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa1470-9f30-4fd9-8ec6-b8c3223b1962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:10.515385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa1470-9f30-4fd9-8ec6-b8c3223b1962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:10.516137 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa1470-9f30-4fd9-8ec6-b8c3223b1962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:10.517711 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa1470-9f30-4fd9-8ec6-b8c3223b1962 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:10.527490 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1215/2421] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:17:10.531193 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8938c-fe8b-4477-89a8-baa58d2528cf admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:10.541527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8938c-fe8b-4477-89a8-baa58d2528cf admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:10.546178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1005bf-310a-4757-81d5-780f696dc168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:10.546824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1005bf-310a-4757-81d5-780f696dc168 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:10.547113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1005bf-310a-4757-81d5-780f696dc168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:10.547393 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1005bf-310a-4757-81d5-780f696dc168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:10.548187 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1005bf-310a-4757-81d5-780f696dc168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:10.549781 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1005bf-310a-4757-81d5-780f696dc168 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:10.560070 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1207/2422] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:17:10.563945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa1470-9f30-4fd9-8ec6-b8c3223b1962 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:10.573747 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa1470-9f30-4fd9-8ec6-b8c3223b1962 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:10.579012 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b0409-4f72-439b-b7e5-439de9584b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:10.579881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b0409-4f72-439b-b7e5-439de9584b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:10.580203 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b0409-4f72-439b-b7e5-439de9584b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:10.580482 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b0409-4f72-439b-b7e5-439de9584b04 admin admin] PATH_INFO: `/v3/projects/be88303fcd944b1f8d7b73e7e0f75a89/users/685f74a6504449338d7ca3e43dce6a3d/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:10.594956 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b0409-4f72-439b-b7e5-439de9584b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be88303fcd944b1f8d7b73e7e0f75a89, user_id=685f74a6504449338d7ca3e43dce6a3d, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:10.597667 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b0409-4f72-439b-b7e5-439de9584b04 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:10.611288 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1216/2423] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:17:10 2022] PUT /identity/v3/projects/be88303fcd944b1f8d7b73e7e0f75a89/users/685f74a6504449338d7ca3e43dce6a3d/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:10.621748 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922354b-f981-456f-a45c-7513643e0be0 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:10.622251 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922354b-f981-456f-a45c-7513643e0be0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:10.622352 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922354b-f981-456f-a45c-7513643e0be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:10.648702 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6922354b-f981-456f-a45c-7513643e0be0 None None] MFA Rules not processed for user `685f74a6504449338d7ca3e43dce6a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:10.649908 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6922354b-f981-456f-a45c-7513643e0be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:10.712274 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1208/2424] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:10.717296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b0409-4f72-439b-b7e5-439de9584b04 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:10.777130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b0409-4f72-439b-b7e5-439de9584b04 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:10.782203 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f607d7-32ea-4d1b-b9bb-799ffa791ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:10.782847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f607d7-32ea-4d1b-b9bb-799ffa791ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:10.783130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f607d7-32ea-4d1b-b9bb-799ffa791ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:10.783406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f607d7-32ea-4d1b-b9bb-799ffa791ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:10.784111 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f607d7-32ea-4d1b-b9bb-799ffa791ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:10.785989 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f607d7-32ea-4d1b-b9bb-799ffa791ae6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:10.810779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1217/2425] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:17:10 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:17:10.814548 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922354b-f981-456f-a45c-7513643e0be0 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:10.825677 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922354b-f981-456f-a45c-7513643e0be0 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:10.881332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead02358-0d60-4084-baef-f20fddff25c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:10.881996 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead02358-0d60-4084-baef-f20fddff25c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:10.882280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead02358-0d60-4084-baef-f20fddff25c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:10.882555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead02358-0d60-4084-baef-f20fddff25c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:10.883244 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead02358-0d60-4084-baef-f20fddff25c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:10.885189 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead02358-0d60-4084-baef-f20fddff25c8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:10.895320 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:10.906819 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1209/2426] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:17:10 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:17:10.910774 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f607d7-32ea-4d1b-b9bb-799ffa791ae6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:10.921493 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f607d7-32ea-4d1b-b9bb-799ffa791ae6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:10.926377 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef1b67-519e-49f6-a8d2-89b56759ca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:10.927057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef1b67-519e-49f6-a8d2-89b56759ca76 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:10.927343 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef1b67-519e-49f6-a8d2-89b56759ca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:10.927641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef1b67-519e-49f6-a8d2-89b56759ca76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:10.928390 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef1b67-519e-49f6-a8d2-89b56759ca76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:10.929971 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef1b67-519e-49f6-a8d2-89b56759ca76 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:10.940954 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1218/2427] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:17:10.945166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead02358-0d60-4084-baef-f20fddff25c8 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:10.955609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead02358-0d60-4084-baef-f20fddff25c8 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:10.960333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c452c73-2557-483c-97a9-513e142bbe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:10.961207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c452c73-2557-483c-97a9-513e142bbe1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:10.961496 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c452c73-2557-483c-97a9-513e142bbe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:10.961778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c452c73-2557-483c-97a9-513e142bbe1c admin admin] PATH_INFO: `/v3/projects/3b8e02180c4a49ca85371799de98c3d0/users/95cf87d64e734c74b984a26eae58563b/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:10.976166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c452c73-2557-483c-97a9-513e142bbe1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8e02180c4a49ca85371799de98c3d0, user_id=95cf87d64e734c74b984a26eae58563b, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:10.978812 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c452c73-2557-483c-97a9-513e142bbe1c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:10.992231 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1210/2428] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:17:10 2022] PUT /identity/v3/projects/3b8e02180c4a49ca85371799de98c3d0/users/95cf87d64e734c74b984a26eae58563b/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:10.996997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef1b67-519e-49f6-a8d2-89b56759ca76 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:11.007420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef1b67-519e-49f6-a8d2-89b56759ca76 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:11.047406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:11.066178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380f103-e353-4ebc-b647-2a60c86b8fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:11.066877 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380f103-e353-4ebc-b647-2a60c86b8fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:11.067188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380f103-e353-4ebc-b647-2a60c86b8fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:11.067475 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380f103-e353-4ebc-b647-2a60c86b8fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:11.068244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380f103-e353-4ebc-b647-2a60c86b8fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:11.069840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380f103-e353-4ebc-b647-2a60c86b8fc3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:11.080172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1219/2429] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:17:11.084348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c452c73-2557-483c-97a9-513e142bbe1c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:11.094619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c452c73-2557-483c-97a9-513e142bbe1c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:11.099139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213395c1-2e30-4494-90ce-0d175e57404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:11.100057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213395c1-2e30-4494-90ce-0d175e57404a admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:11.100344 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213395c1-2e30-4494-90ce-0d175e57404a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:11.100619 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213395c1-2e30-4494-90ce-0d175e57404a admin admin] PATH_INFO: `/v3/projects/3b8e02180c4a49ca85371799de98c3d0/users/95cf87d64e734c74b984a26eae58563b/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:11.102591 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213395c1-2e30-4494-90ce-0d175e57404a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8e02180c4a49ca85371799de98c3d0, user_id=95cf87d64e734c74b984a26eae58563b, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:11.105276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213395c1-2e30-4494-90ce-0d175e57404a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:11.115395 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1211/2430] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:17:11 2022] PUT /identity/v3/projects/3b8e02180c4a49ca85371799de98c3d0/users/95cf87d64e734c74b984a26eae58563b/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:11.126693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36872a7a-2d61-4aae-b85a-3cd7fea168c1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:11.126988 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36872a7a-2d61-4aae-b85a-3cd7fea168c1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:11.127270 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36872a7a-2d61-4aae-b85a-3cd7fea168c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:11.154012 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-36872a7a-2d61-4aae-b85a-3cd7fea168c1 None None] MFA Rules not processed for user `95cf87d64e734c74b984a26eae58563b`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:11.155251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-36872a7a-2d61-4aae-b85a-3cd7fea168c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:11.222579 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1220/2431] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:11.233804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213395c1-2e30-4494-90ce-0d175e57404a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:11.235501 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-213395c1-2e30-4494-90ce-0d175e57404a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:11.293416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213395c1-2e30-4494-90ce-0d175e57404a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:11.297066 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538a8f8-cfd3-4678-95a2-6ee29e6e0d57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:11.297833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538a8f8-cfd3-4678-95a2-6ee29e6e0d57 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:11.298037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538a8f8-cfd3-4678-95a2-6ee29e6e0d57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:11.298318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538a8f8-cfd3-4678-95a2-6ee29e6e0d57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:11.307672 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538a8f8-cfd3-4678-95a2-6ee29e6e0d57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:11.309879 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538a8f8-cfd3-4678-95a2-6ee29e6e0d57 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:11.319541 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1212/2432] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:17:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:11.694131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36872a7a-2d61-4aae-b85a-3cd7fea168c1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:11.757874 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36872a7a-2d61-4aae-b85a-3cd7fea168c1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:11.762512 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52418a69-3d6d-4ce1-a423-751e7a333728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:11.763383 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52418a69-3d6d-4ce1-a423-751e7a333728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:11.763692 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52418a69-3d6d-4ce1-a423-751e7a333728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:11.764001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52418a69-3d6d-4ce1-a423-751e7a333728 admin admin] PATH_INFO: `/v3/users/685f74a6504449338d7ca3e43dce6a3d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:11.765271 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52418a69-3d6d-4ce1-a423-751e7a333728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=685f74a6504449338d7ca3e43dce6a3d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:11.767236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52418a69-3d6d-4ce1-a423-751e7a333728 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:11.813894 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-52418a69-3d6d-4ce1-a423-751e7a333728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '685f74a6504449338d7ca3e43dce6a3d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:11.814537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-52418a69-3d6d-4ce1-a423-751e7a333728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '685f74a6504449338d7ca3e43dce6a3d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:11.821354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-52418a69-3d6d-4ce1-a423-751e7a333728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '685f74a6504449338d7ca3e43dce6a3d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:11.828105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-52418a69-3d6d-4ce1-a423-751e7a333728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '685f74a6504449338d7ca3e43dce6a3d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:11.830025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:11.843327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-52418a69-3d6d-4ce1-a423-751e7a333728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '685f74a6504449338d7ca3e43dce6a3d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:11.849240 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1221/2433] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:17:11 2022] DELETE /identity/v3/users/685f74a6504449338d7ca3e43dce6a3d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:11.853775 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dbbb7-9390-44cf-8604-d8375a648428 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:11.854229 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dbbb7-9390-44cf-8604-d8375a648428 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:11.854345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dbbb7-9390-44cf-8604-d8375a648428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:11.873055 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-186dbbb7-9390-44cf-8604-d8375a648428 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:11.874252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-186dbbb7-9390-44cf-8604-d8375a648428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:11.931936 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1213/2434] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:11.941978 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52418a69-3d6d-4ce1-a423-751e7a333728 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:11.944312 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-52418a69-3d6d-4ce1-a423-751e7a333728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:12.004345 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52418a69-3d6d-4ce1-a423-751e7a333728 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:12.008098 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bac903-9c09-4965-8bcd-4ea9817e517b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:12.008745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bac903-9c09-4965-8bcd-4ea9817e517b service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:12.009032 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bac903-9c09-4965-8bcd-4ea9817e517b service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:12.009311 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bac903-9c09-4965-8bcd-4ea9817e517b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:12.018996 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bac903-9c09-4965-8bcd-4ea9817e517b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:12.020456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bac903-9c09-4965-8bcd-4ea9817e517b service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:12.031030 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1222/2435] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:17:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:12.303570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dbbb7-9390-44cf-8604-d8375a648428 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:12.305018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-186dbbb7-9390-44cf-8604-d8375a648428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:12.317360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dbbb7-9390-44cf-8604-d8375a648428 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:12.322324 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:12.323235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:12.323500 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:12.323780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46 admin admin] PATH_INFO: `/v3/projects/be88303fcd944b1f8d7b73e7e0f75a89` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:12.325639 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be88303fcd944b1f8d7b73e7e0f75a89)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:12.327599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:12.375172 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be88303fcd944b1f8d7b73e7e0f75a89', 'request_id': 'req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:12.380892 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be88303fcd944b1f8d7b73e7e0f75a89', 'request_id': 'req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:12.382828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:12.391191 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be88303fcd944b1f8d7b73e7e0f75a89', 'request_id': 'req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:12.404830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46 admin admin] The token cache is being invalidate because project be88303fcd944b1f8d7b73e7e0f75a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:17:12.405382 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:12.406164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:12.407965 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1214/2436] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:17:12 2022] DELETE /identity/v3/projects/be88303fcd944b1f8d7b73e7e0f75a89 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:12.411943 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bac903-9c09-4965-8bcd-4ea9817e517b service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:12.422093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bac903-9c09-4965-8bcd-4ea9817e517b service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:12.493155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02d426-15a1-4596-b65d-5d0d0cda1be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:12.494045 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02d426-15a1-4596-b65d-5d0d0cda1be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:12.494337 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02d426-15a1-4596-b65d-5d0d0cda1be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:12.494619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02d426-15a1-4596-b65d-5d0d0cda1be1 admin admin] PATH_INFO: `/v3/users/95cf87d64e734c74b984a26eae58563b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:12.495834 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02d426-15a1-4596-b65d-5d0d0cda1be1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95cf87d64e734c74b984a26eae58563b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:12.498630 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02d426-15a1-4596-b65d-5d0d0cda1be1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:12.560434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-dd02d426-15a1-4596-b65d-5d0d0cda1be1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95cf87d64e734c74b984a26eae58563b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:12.561250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-dd02d426-15a1-4596-b65d-5d0d0cda1be1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95cf87d64e734c74b984a26eae58563b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:12.584193 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-dd02d426-15a1-4596-b65d-5d0d0cda1be1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95cf87d64e734c74b984a26eae58563b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:12.594788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-dd02d426-15a1-4596-b65d-5d0d0cda1be1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95cf87d64e734c74b984a26eae58563b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:12.610020 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-dd02d426-15a1-4596-b65d-5d0d0cda1be1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95cf87d64e734c74b984a26eae58563b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:12.618771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1223/2437] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:17:12 2022] DELETE /identity/v3/users/95cf87d64e734c74b984a26eae58563b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:12.921225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:12.922794 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:12.937854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2b9f1-d7c5-4454-ae24-b24bf94d9b46 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:12.999492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d480c-7ede-4d04-a6dc-4123fe38a0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:13.000462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d480c-7ede-4d04-a6dc-4123fe38a0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:13.000742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d480c-7ede-4d04-a6dc-4123fe38a0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:13.001016 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d480c-7ede-4d04-a6dc-4123fe38a0a4 admin admin] PATH_INFO: `/v3/projects/3b8e02180c4a49ca85371799de98c3d0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:13.002302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d480c-7ede-4d04-a6dc-4123fe38a0a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b8e02180c4a49ca85371799de98c3d0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:13.004253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d480c-7ede-4d04-a6dc-4123fe38a0a4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:13.052354 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-127d480c-7ede-4d04-a6dc-4123fe38a0a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b8e02180c4a49ca85371799de98c3d0', 'request_id': 'req-127d480c-7ede-4d04-a6dc-4123fe38a0a4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:13.057643 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-127d480c-7ede-4d04-a6dc-4123fe38a0a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b8e02180c4a49ca85371799de98c3d0', 'request_id': 'req-127d480c-7ede-4d04-a6dc-4123fe38a0a4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:13.064112 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-127d480c-7ede-4d04-a6dc-4123fe38a0a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b8e02180c4a49ca85371799de98c3d0', 'request_id': 'req-127d480c-7ede-4d04-a6dc-4123fe38a0a4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:13.075321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-127d480c-7ede-4d04-a6dc-4123fe38a0a4 admin admin] The token cache is being invalidate because project 3b8e02180c4a49ca85371799de98c3d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:17:13.075611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-127d480c-7ede-4d04-a6dc-4123fe38a0a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:13.076621 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-127d480c-7ede-4d04-a6dc-4123fe38a0a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:13.078290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1215/2438] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:17:12 2022] DELETE /identity/v3/projects/3b8e02180c4a49ca85371799de98c3d0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:13.084462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90239-d5f4-482d-836a-81b723c4b306 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:13.084980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90239-d5f4-482d-836a-81b723c4b306 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:13.085097 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90239-d5f4-482d-836a-81b723c4b306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:13.093313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:13.107841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8ea90239-d5f4-482d-836a-81b723c4b306 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:13.109080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8ea90239-d5f4-482d-836a-81b723c4b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:13.170456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1224/2439] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:17:13.178335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d1b13-17cf-4f1b-ba7d-801b57968e9d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:13.178628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d1b13-17cf-4f1b-ba7d-801b57968e9d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:13.178916 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d1b13-17cf-4f1b-ba7d-801b57968e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:13.198214 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-742d1b13-17cf-4f1b-ba7d-801b57968e9d None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:13.199524 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-742d1b13-17cf-4f1b-ba7d-801b57968e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:13.208187 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1216/2440] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:13.212442 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea90239-d5f4-482d-836a-81b723c4b306 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:13.222731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea90239-d5f4-482d-836a-81b723c4b306 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:13.228228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74882e08-b362-4d19-8eec-a373a5158580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:13.228878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74882e08-b362-4d19-8eec-a373a5158580 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:13.229166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74882e08-b362-4d19-8eec-a373a5158580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:13.229445 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74882e08-b362-4d19-8eec-a373a5158580 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:13.230179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74882e08-b362-4d19-8eec-a373a5158580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:17:13.230518 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74882e08-b362-4d19-8eec-a373a5158580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:13.232157 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74882e08-b362-4d19-8eec-a373a5158580 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:13.244578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1225/2441] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:17:13.249545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d1b13-17cf-4f1b-ba7d-801b57968e9d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:13.259206 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d1b13-17cf-4f1b-ba7d-801b57968e9d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:13.264598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aa16c-9157-41b9-896b-144e1ce06bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:13.265261 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aa16c-9157-41b9-896b-144e1ce06bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:13.265549 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aa16c-9157-41b9-896b-144e1ce06bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:13.265848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aa16c-9157-41b9-896b-144e1ce06bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:13.266824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1aa16c-9157-41b9-896b-144e1ce06bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:13.268786 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1aa16c-9157-41b9-896b-144e1ce06bd1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:13.294972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1217/2442] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:17:13 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:17:13.299637 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74882e08-b362-4d19-8eec-a373a5158580 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:13.310221 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74882e08-b362-4d19-8eec-a373a5158580 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:13.381143 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab28f04-09ea-412a-9641-ccd10313bc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:13.381924 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab28f04-09ea-412a-9641-ccd10313bc59 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:13.382317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab28f04-09ea-412a-9641-ccd10313bc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:13.382656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab28f04-09ea-412a-9641-ccd10313bc59 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:13.383458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab28f04-09ea-412a-9641-ccd10313bc59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:13.385575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab28f04-09ea-412a-9641-ccd10313bc59 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:13.406473 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1226/2443] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:17:13 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:17:13.410525 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aa16c-9157-41b9-896b-144e1ce06bd1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:13.421323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aa16c-9157-41b9-896b-144e1ce06bd1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:13.425993 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b525d0-1255-4639-b1b7-eca9c25fe5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:13.426649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b525d0-1255-4639-b1b7-eca9c25fe5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:13.426940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b525d0-1255-4639-b1b7-eca9c25fe5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:13.427223 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b525d0-1255-4639-b1b7-eca9c25fe5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:13.428852 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b525d0-1255-4639-b1b7-eca9c25fe5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:13.430475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b525d0-1255-4639-b1b7-eca9c25fe5e5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:13.442331 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1218/2444] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:17:13.446260 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab28f04-09ea-412a-9641-ccd10313bc59 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:13.457762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab28f04-09ea-412a-9641-ccd10313bc59 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:13.463899 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330ceb2-f83d-4493-afd9-948196742c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:13.464596 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330ceb2-f83d-4493-afd9-948196742c2f admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:13.464911 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330ceb2-f83d-4493-afd9-948196742c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:13.465192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330ceb2-f83d-4493-afd9-948196742c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:13.465927 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330ceb2-f83d-4493-afd9-948196742c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:13.467535 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330ceb2-f83d-4493-afd9-948196742c2f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:13.478188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1227/2445] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:17:13.482415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b525d0-1255-4639-b1b7-eca9c25fe5e5 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:13.492905 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b525d0-1255-4639-b1b7-eca9c25fe5e5 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:13.498236 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff359608-430a-4f98-90a6-3c37b4016dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:13.499171 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359608-430a-4f98-90a6-3c37b4016dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:13.499457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359608-430a-4f98-90a6-3c37b4016dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:13.499737 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359608-430a-4f98-90a6-3c37b4016dd2 admin admin] PATH_INFO: `/v3/projects/d6d8d7674f0b4ef1aa6d133cc116e74c/users/bbfd886e334746a0a5be936ef81746e5/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:13.514714 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff359608-430a-4f98-90a6-3c37b4016dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d8d7674f0b4ef1aa6d133cc116e74c, user_id=bbfd886e334746a0a5be936ef81746e5, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:13.517433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff359608-430a-4f98-90a6-3c37b4016dd2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:13.531943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1219/2446] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:17:13 2022] PUT /identity/v3/projects/d6d8d7674f0b4ef1aa6d133cc116e74c/users/bbfd886e334746a0a5be936ef81746e5/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:13.543631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76d3a4-f36e-4b83-878d-3a46c10f35cd None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:13.543943 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76d3a4-f36e-4b83-878d-3a46c10f35cd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:13.544237 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76d3a4-f36e-4b83-878d-3a46c10f35cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:13.570691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ef76d3a4-f36e-4b83-878d-3a46c10f35cd None None] MFA Rules not processed for user `bbfd886e334746a0a5be936ef81746e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:13.571883 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ef76d3a4-f36e-4b83-878d-3a46c10f35cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:13.631573 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:13.635566 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1228/2447] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:13.640895 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff359608-430a-4f98-90a6-3c37b4016dd2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:13.653684 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:13.715198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff359608-430a-4f98-90a6-3c37b4016dd2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:13.719953 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17858e5-8e61-4557-b09c-3cf52028352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:13.720654 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17858e5-8e61-4557-b09c-3cf52028352c admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:13.720918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17858e5-8e61-4557-b09c-3cf52028352c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:13.721197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17858e5-8e61-4557-b09c-3cf52028352c admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:13.721927 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17858e5-8e61-4557-b09c-3cf52028352c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:13.723811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17858e5-8e61-4557-b09c-3cf52028352c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:13.727731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d4875-6264-4202-a28b-d5a550bf9270 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:13.728047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d4875-6264-4202-a28b-d5a550bf9270 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:13.728329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d4875-6264-4202-a28b-d5a550bf9270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:13.747985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-286d4875-6264-4202-a28b-d5a550bf9270 None None] MFA Rules not processed for user `b6c5da324ab2405a84036db91a1366a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:13.749178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-286d4875-6264-4202-a28b-d5a550bf9270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:13.753136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1220/2448] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:17:13 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:17:13.753984 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17858e5-8e61-4557-b09c-3cf52028352c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:13.809042 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1229/2449] 10.222.0.73 () {58 vars in 967 bytes} [Thu May 19 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:17:13.816900 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17858e5-8e61-4557-b09c-3cf52028352c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:13.821839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a679859-e3a9-46d5-bdf1-6ef905c36bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:13.822520 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a679859-e3a9-46d5-bdf1-6ef905c36bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:13.822806 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a679859-e3a9-46d5-bdf1-6ef905c36bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:13.823206 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a679859-e3a9-46d5-bdf1-6ef905c36bdb admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:13.825138 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a679859-e3a9-46d5-bdf1-6ef905c36bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:13.826453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a679859-e3a9-46d5-bdf1-6ef905c36bdb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:13.848531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1221/2450] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:17:13 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:17:13.852651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d4875-6264-4202-a28b-d5a550bf9270 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:13.860039 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a679859-e3a9-46d5-bdf1-6ef905c36bdb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:13.861791 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7a679859-e3a9-46d5-bdf1-6ef905c36bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:13.864779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d4875-6264-4202-a28b-d5a550bf9270 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:13.869841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b62ac8-c702-477e-aa0e-b06fec064667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:13.870507 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b62ac8-c702-477e-aa0e-b06fec064667 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:13.870811 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b62ac8-c702-477e-aa0e-b06fec064667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:13.871159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b62ac8-c702-477e-aa0e-b06fec064667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:13.871886 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b62ac8-c702-477e-aa0e-b06fec064667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:13.873503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b62ac8-c702-477e-aa0e-b06fec064667 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:13.883663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1230/2451] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:17:13.888444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b62ac8-c702-477e-aa0e-b06fec064667 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:13.898451 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b62ac8-c702-477e-aa0e-b06fec064667 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:13.903683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a5feb-228b-4493-9f4e-1278b1b59d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:13.904581 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a5feb-228b-4493-9f4e-1278b1b59d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:13.904870 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a5feb-228b-4493-9f4e-1278b1b59d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:13.905160 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a5feb-228b-4493-9f4e-1278b1b59d66 admin admin] PATH_INFO: `/v3/projects/5c45c87ea8e441ea997f26864514c3df/users/d7fc2881dbb74c56841686339353c6e8/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:13.919788 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a5feb-228b-4493-9f4e-1278b1b59d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c45c87ea8e441ea997f26864514c3df, user_id=d7fc2881dbb74c56841686339353c6e8, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:13.922570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a5feb-228b-4493-9f4e-1278b1b59d66 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:13.936266 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1231/2452] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:17:13 2022] PUT /identity/v3/projects/5c45c87ea8e441ea997f26864514c3df/users/d7fc2881dbb74c56841686339353c6e8/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:17:13.936653 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a679859-e3a9-46d5-bdf1-6ef905c36bdb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:13.940333 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a5feb-228b-4493-9f4e-1278b1b59d66 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:13.963119 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:13.998931 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf50686-95cc-4c7a-8203-988212fb9e87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371dae58e95d403b97e311c6616adab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:13.999590 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf50686-95cc-4c7a-8203-988212fb9e87 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:13.999880 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf50686-95cc-4c7a-8203-988212fb9e87 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:14.000199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf50686-95cc-4c7a-8203-988212fb9e87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:14.003688 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a5feb-228b-4493-9f4e-1278b1b59d66 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:14.008468 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc48069-3719-44fb-9d8d-36f34b7b15bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:14.009252 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc48069-3719-44fb-9d8d-36f34b7b15bb admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:14.009548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc48069-3719-44fb-9d8d-36f34b7b15bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:14.009830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc48069-3719-44fb-9d8d-36f34b7b15bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:14.010561 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc48069-3719-44fb-9d8d-36f34b7b15bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:14.012806 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc48069-3719-44fb-9d8d-36f34b7b15bb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:14.022952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1232/2453] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:17:14.027050 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc48069-3719-44fb-9d8d-36f34b7b15bb admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:14.036401 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc48069-3719-44fb-9d8d-36f34b7b15bb admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:14.041388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227ab84-6ca7-46b4-8999-4e8702ecaf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:14.042276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227ab84-6ca7-46b4-8999-4e8702ecaf67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:14.042535 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227ab84-6ca7-46b4-8999-4e8702ecaf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:14.042871 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227ab84-6ca7-46b4-8999-4e8702ecaf67 admin admin] PATH_INFO: `/v3/projects/5c45c87ea8e441ea997f26864514c3df/users/d7fc2881dbb74c56841686339353c6e8/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:14.046004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227ab84-6ca7-46b4-8999-4e8702ecaf67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c45c87ea8e441ea997f26864514c3df, user_id=d7fc2881dbb74c56841686339353c6e8, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:14.049188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227ab84-6ca7-46b4-8999-4e8702ecaf67 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:14.061447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1233/2454] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:17:14 2022] PUT /identity/v3/projects/5c45c87ea8e441ea997f26864514c3df/users/d7fc2881dbb74c56841686339353c6e8/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:17:14.065418 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf50686-95cc-4c7a-8203-988212fb9e87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:14.067203 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf50686-95cc-4c7a-8203-988212fb9e87 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:14.071466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837ba1b-913d-430a-bf06-ba40e29fd138 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:14.071763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837ba1b-913d-430a-bf06-ba40e29fd138 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:14.072080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837ba1b-913d-430a-bf06-ba40e29fd138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:14.076482 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1222/2455] 10.222.0.73 () {60 vars in 1384 bytes} [Thu May 19 12:17:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:17:14.099483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0837ba1b-913d-430a-bf06-ba40e29fd138 None None] MFA Rules not processed for user `d7fc2881dbb74c56841686339353c6e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:14.100730 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0837ba1b-913d-430a-bf06-ba40e29fd138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:14.147734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:14.177958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1234/2456] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:17:14.189773 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf50686-95cc-4c7a-8203-988212fb9e87 service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:14.191467 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5cf50686-95cc-4c7a-8203-988212fb9e87 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:14.252526 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf50686-95cc-4c7a-8203-988212fb9e87 service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:14.305514 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cb175-729b-44cc-849a-28d6ec952e2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:14.306179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cb175-729b-44cc-849a-28d6ec952e2d service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:14.306471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cb175-729b-44cc-849a-28d6ec952e2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:14.306770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cb175-729b-44cc-849a-28d6ec952e2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:14.317247 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cb175-729b-44cc-849a-28d6ec952e2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:14.318679 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cb175-729b-44cc-849a-28d6ec952e2d service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:14.329151 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1223/2457] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:17:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:14.430644 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837ba1b-913d-430a-bf06-ba40e29fd138 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:14.440620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837ba1b-913d-430a-bf06-ba40e29fd138 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:14.444437 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e78ec-9e85-422e-9cdb-b16bb040673e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:14.444604 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cb175-729b-44cc-849a-28d6ec952e2d service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:14.445093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e78ec-9e85-422e-9cdb-b16bb040673e service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:14.445375 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e78ec-9e85-422e-9cdb-b16bb040673e service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:14.445649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e78ec-9e85-422e-9cdb-b16bb040673e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:14.446104 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7d5cb175-729b-44cc-849a-28d6ec952e2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:14.477245 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:14.504504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cb175-729b-44cc-849a-28d6ec952e2d service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:14.505516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e78ec-9e85-422e-9cdb-b16bb040673e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:14.507063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e78ec-9e85-422e-9cdb-b16bb040673e service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:14.508318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06921a2d-e818-4bb0-a381-e809159b0943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:14.508973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06921a2d-e818-4bb0-a381-e809159b0943 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:14.509261 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06921a2d-e818-4bb0-a381-e809159b0943 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:14.509542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06921a2d-e818-4bb0-a381-e809159b0943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:14.511392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-06921a2d-e818-4bb0-a381-e809159b0943 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:14.516434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1235/2458] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:17:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:14.588109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06921a2d-e818-4bb0-a381-e809159b0943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:14.589559 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06921a2d-e818-4bb0-a381-e809159b0943 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:14.599413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1224/2459] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:17:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:17:17.095456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e78ec-9e85-422e-9cdb-b16bb040673e service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:17.107322 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e78ec-9e85-422e-9cdb-b16bb040673e service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:17.112005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdec06-87ad-4e8c-9460-522116c7aa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:17.112885 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdec06-87ad-4e8c-9460-522116c7aa8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:17.113167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdec06-87ad-4e8c-9460-522116c7aa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:17.113440 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdec06-87ad-4e8c-9460-522116c7aa8a admin admin] PATH_INFO: `/v3/users/bbfd886e334746a0a5be936ef81746e5` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:17.114624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdec06-87ad-4e8c-9460-522116c7aa8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbfd886e334746a0a5be936ef81746e5)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:17.116678 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdec06-87ad-4e8c-9460-522116c7aa8a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:17.173259 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-97bdec06-87ad-4e8c-9460-522116c7aa8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbfd886e334746a0a5be936ef81746e5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:17.173917 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-97bdec06-87ad-4e8c-9460-522116c7aa8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbfd886e334746a0a5be936ef81746e5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:17.185120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-97bdec06-87ad-4e8c-9460-522116c7aa8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbfd886e334746a0a5be936ef81746e5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:17.193039 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-97bdec06-87ad-4e8c-9460-522116c7aa8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbfd886e334746a0a5be936ef81746e5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:17.205809 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-97bdec06-87ad-4e8c-9460-522116c7aa8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbfd886e334746a0a5be936ef81746e5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:17.211715 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1236/2460] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:17:17 2022] DELETE /identity/v3/users/bbfd886e334746a0a5be936ef81746e5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:17.216212 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af6f4f-e205-4297-b65d-eab6c0c860f4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:17.216720 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af6f4f-e205-4297-b65d-eab6c0c860f4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:17.216818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af6f4f-e205-4297-b65d-eab6c0c860f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:17.234097 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-99af6f4f-e205-4297-b65d-eab6c0c860f4 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:17.235329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-99af6f4f-e205-4297-b65d-eab6c0c860f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:17.298904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1225/2461] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:17.309125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdec06-87ad-4e8c-9460-522116c7aa8a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:17.310829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-97bdec06-87ad-4e8c-9460-522116c7aa8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:17.381410 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:17.387289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdec06-87ad-4e8c-9460-522116c7aa8a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:17.406192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc14d54-0ee7-43e4-a7c2-76fe8ca4e086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:17.407179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc14d54-0ee7-43e4-a7c2-76fe8ca4e086 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:17.407508 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc14d54-0ee7-43e4-a7c2-76fe8ca4e086 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:17.408435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc14d54-0ee7-43e4-a7c2-76fe8ca4e086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:17.421147 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc14d54-0ee7-43e4-a7c2-76fe8ca4e086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:17.424196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc14d54-0ee7-43e4-a7c2-76fe8ca4e086 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:17.440509 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1237/2462] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:17.925589 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af6f4f-e205-4297-b65d-eab6c0c860f4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:17.927583 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-99af6f4f-e205-4297-b65d-eab6c0c860f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:17.941101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af6f4f-e205-4297-b65d-eab6c0c860f4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:17.946478 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:17.947432 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:17.947818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:17.948179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c admin admin] PATH_INFO: `/v3/projects/d6d8d7674f0b4ef1aa6d133cc116e74c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:17.950006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6d8d7674f0b4ef1aa6d133cc116e74c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:17.951992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:18.002523 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6d8d7674f0b4ef1aa6d133cc116e74c', 'request_id': 'req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:18.009027 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6d8d7674f0b4ef1aa6d133cc116e74c', 'request_id': 'req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:18.018244 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6d8d7674f0b4ef1aa6d133cc116e74c', 'request_id': 'req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:18.029883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c admin admin] The token cache is being invalidate because project d6d8d7674f0b4ef1aa6d133cc116e74c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:17:18.030177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:18.030810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:18.032464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1226/2463] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:17:17 2022] DELETE /identity/v3/projects/d6d8d7674f0b4ef1aa6d133cc116e74c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:18.036446 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc14d54-0ee7-43e4-a7c2-76fe8ca4e086 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:18.047086 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc14d54-0ee7-43e4-a7c2-76fe8ca4e086 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:18.113138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c83b8-ae53-4a90-8c78-7e33cab9884c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:18.113964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c83b8-ae53-4a90-8c78-7e33cab9884c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:18.114246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c83b8-ae53-4a90-8c78-7e33cab9884c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:18.114522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c83b8-ae53-4a90-8c78-7e33cab9884c admin admin] PATH_INFO: `/v3/users/d7fc2881dbb74c56841686339353c6e8` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:18.115721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c83b8-ae53-4a90-8c78-7e33cab9884c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7fc2881dbb74c56841686339353c6e8)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:18.117686 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c83b8-ae53-4a90-8c78-7e33cab9884c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:18.170165 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-600c83b8-ae53-4a90-8c78-7e33cab9884c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7fc2881dbb74c56841686339353c6e8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:18.170816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-600c83b8-ae53-4a90-8c78-7e33cab9884c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7fc2881dbb74c56841686339353c6e8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:18.180581 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-600c83b8-ae53-4a90-8c78-7e33cab9884c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7fc2881dbb74c56841686339353c6e8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:18.196594 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-600c83b8-ae53-4a90-8c78-7e33cab9884c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7fc2881dbb74c56841686339353c6e8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:18.210762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-600c83b8-ae53-4a90-8c78-7e33cab9884c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7fc2881dbb74c56841686339353c6e8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:18.217680 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1238/2464] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:17:18 2022] DELETE /identity/v3/users/d7fc2881dbb74c56841686339353c6e8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:18.491185 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:18.492802 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:18.501137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:18.507637 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74c87f-8d83-47bc-b87d-df3a7f2b382c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:18.567731 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431226a7-861f-4dfc-9916-db000722299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:18.568621 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431226a7-861f-4dfc-9916-db000722299c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:18.568901 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431226a7-861f-4dfc-9916-db000722299c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:18.569170 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431226a7-861f-4dfc-9916-db000722299c admin admin] PATH_INFO: `/v3/projects/5c45c87ea8e441ea997f26864514c3df` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:18.570343 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431226a7-861f-4dfc-9916-db000722299c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c45c87ea8e441ea997f26864514c3df)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:18.572291 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431226a7-861f-4dfc-9916-db000722299c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:18.619474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-431226a7-861f-4dfc-9916-db000722299c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c45c87ea8e441ea997f26864514c3df', 'request_id': 'req-431226a7-861f-4dfc-9916-db000722299c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:18.625639 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-431226a7-861f-4dfc-9916-db000722299c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c45c87ea8e441ea997f26864514c3df', 'request_id': 'req-431226a7-861f-4dfc-9916-db000722299c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:18.633327 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-431226a7-861f-4dfc-9916-db000722299c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c45c87ea8e441ea997f26864514c3df', 'request_id': 'req-431226a7-861f-4dfc-9916-db000722299c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:18.645500 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-431226a7-861f-4dfc-9916-db000722299c admin admin] The token cache is being invalidate because project 5c45c87ea8e441ea997f26864514c3df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:17:18.645799 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-431226a7-861f-4dfc-9916-db000722299c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:18.646439 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-431226a7-861f-4dfc-9916-db000722299c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:18.648057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1227/2465] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:17:18 2022] DELETE /identity/v3/projects/5c45c87ea8e441ea997f26864514c3df => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:18.653023 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee03b1d-4cc1-446f-8239-17655e3b4b55 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:18.653318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee03b1d-4cc1-446f-8239-17655e3b4b55 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:18.653616 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee03b1d-4cc1-446f-8239-17655e3b4b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:18.671670 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4ee03b1d-4cc1-446f-8239-17655e3b4b55 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:18.672932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4ee03b1d-4cc1-446f-8239-17655e3b4b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:18.732917 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1239/2466] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:18.740634 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef90ac5-c08e-4627-9047-306c470e1ae1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:18.740932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef90ac5-c08e-4627-9047-306c470e1ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:18.741216 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef90ac5-c08e-4627-9047-306c470e1ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:18.761515 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bef90ac5-c08e-4627-9047-306c470e1ae1 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:18.763257 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bef90ac5-c08e-4627-9047-306c470e1ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:18.771366 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1228/2467] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:18.775835 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee03b1d-4cc1-446f-8239-17655e3b4b55 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:18.787487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee03b1d-4cc1-446f-8239-17655e3b4b55 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:18.792178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56537737-3edd-42cf-8765-5abd465588f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:18.792870 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56537737-3edd-42cf-8765-5abd465588f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:18.793166 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56537737-3edd-42cf-8765-5abd465588f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:18.793444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56537737-3edd-42cf-8765-5abd465588f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:18.794296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56537737-3edd-42cf-8765-5abd465588f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:17:18.794616 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56537737-3edd-42cf-8765-5abd465588f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:18.796241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56537737-3edd-42cf-8765-5abd465588f5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:18.803015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:18.814338 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef90ac5-c08e-4627-9047-306c470e1ae1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:18.818650 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1240/2468] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:17:18.823930 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef90ac5-c08e-4627-9047-306c470e1ae1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:18.829106 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dbbf9-013a-425f-a04e-94a6ecf59318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:18.829762 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dbbf9-013a-425f-a04e-94a6ecf59318 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:18.830048 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dbbf9-013a-425f-a04e-94a6ecf59318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:18.830326 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dbbf9-013a-425f-a04e-94a6ecf59318 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:18.831031 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619dbbf9-013a-425f-a04e-94a6ecf59318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:18.833005 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619dbbf9-013a-425f-a04e-94a6ecf59318 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:18.859179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1229/2469] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:17:18 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:17:18.863427 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56537737-3edd-42cf-8765-5abd465588f5 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:18.874103 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56537737-3edd-42cf-8765-5abd465588f5 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:18.932068 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b07060-624e-4c36-a370-ce7f43af7d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:18.932720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b07060-624e-4c36-a370-ce7f43af7d5a admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:18.933004 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b07060-624e-4c36-a370-ce7f43af7d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:18.933987 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b07060-624e-4c36-a370-ce7f43af7d5a admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:18.934626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b07060-624e-4c36-a370-ce7f43af7d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:18.936616 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b07060-624e-4c36-a370-ce7f43af7d5a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:18.959114 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1241/2470] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:17:18 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:17:18.960474 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dbbf9-013a-425f-a04e-94a6ecf59318 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:18.973173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dbbf9-013a-425f-a04e-94a6ecf59318 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:18.978226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8238441-d394-450c-90cb-e9782a39d663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:18.979182 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8238441-d394-450c-90cb-e9782a39d663 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:18.979537 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8238441-d394-450c-90cb-e9782a39d663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:18.979884 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8238441-d394-450c-90cb-e9782a39d663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:18.982807 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8238441-d394-450c-90cb-e9782a39d663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:18.984175 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8238441-d394-450c-90cb-e9782a39d663 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:18.999007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1230/2471] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:17:19.000191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b07060-624e-4c36-a370-ce7f43af7d5a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:19.012000 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b07060-624e-4c36-a370-ce7f43af7d5a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:19.018700 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cc51d-a9b9-40f7-8b60-e4666398690c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:19.019665 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cc51d-a9b9-40f7-8b60-e4666398690c admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:19.020189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cc51d-a9b9-40f7-8b60-e4666398690c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:19.020569 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cc51d-a9b9-40f7-8b60-e4666398690c admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:19.021398 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cc51d-a9b9-40f7-8b60-e4666398690c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:19.023036 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cc51d-a9b9-40f7-8b60-e4666398690c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:19.035440 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1242/2472] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:17:19.039649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8238441-d394-450c-90cb-e9782a39d663 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:19.052047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8238441-d394-450c-90cb-e9782a39d663 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:19.057849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d1d7e-0179-426d-be21-1ff8a46b44c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:19.059486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d1d7e-0179-426d-be21-1ff8a46b44c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:19.059820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d1d7e-0179-426d-be21-1ff8a46b44c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:19.060132 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d1d7e-0179-426d-be21-1ff8a46b44c1 admin admin] PATH_INFO: `/v3/projects/7120ec98ab074efa99bf691779b06f7d/users/1d163ea940a94a31b72403201ae394ac/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:19.076776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d1d7e-0179-426d-be21-1ff8a46b44c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7120ec98ab074efa99bf691779b06f7d, user_id=1d163ea940a94a31b72403201ae394ac, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:19.079802 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d1d7e-0179-426d-be21-1ff8a46b44c1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:19.093951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1231/2473] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:17:19 2022] PUT /identity/v3/projects/7120ec98ab074efa99bf691779b06f7d/users/1d163ea940a94a31b72403201ae394ac/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:19.105059 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d357232-f2c1-4fc3-844e-c52146d68dd4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:19.105893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d357232-f2c1-4fc3-844e-c52146d68dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:19.106183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d357232-f2c1-4fc3-844e-c52146d68dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:19.136862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6d357232-f2c1-4fc3-844e-c52146d68dd4 None None] MFA Rules not processed for user `1d163ea940a94a31b72403201ae394ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:19.139560 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6d357232-f2c1-4fc3-844e-c52146d68dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:19.210841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1243/2474] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:19.215962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d1d7e-0179-426d-be21-1ff8a46b44c1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:19.247820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:19.280514 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d1d7e-0179-426d-be21-1ff8a46b44c1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:19.285270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600714ad-4421-42af-9fd2-623cb9022f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:19.285934 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600714ad-4421-42af-9fd2-623cb9022f33 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:19.286353 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600714ad-4421-42af-9fd2-623cb9022f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:19.286637 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600714ad-4421-42af-9fd2-623cb9022f33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:19.287600 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600714ad-4421-42af-9fd2-623cb9022f33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:19.289633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600714ad-4421-42af-9fd2-623cb9022f33 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:19.315351 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1232/2475] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:17:19 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:17:19.319755 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d357232-f2c1-4fc3-844e-c52146d68dd4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:19.331670 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d357232-f2c1-4fc3-844e-c52146d68dd4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:19.394265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9639a-e6f6-40cf-9347-687a11601fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:19.394946 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9639a-e6f6-40cf-9347-687a11601fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:19.395234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9639a-e6f6-40cf-9347-687a11601fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:19.395513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9639a-e6f6-40cf-9347-687a11601fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:19.396249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9639a-e6f6-40cf-9347-687a11601fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:19.398158 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9639a-e6f6-40cf-9347-687a11601fa8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:19.407881 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:19.419291 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1244/2476] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:17:19 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:17:19.423361 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600714ad-4421-42af-9fd2-623cb9022f33 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:19.434297 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600714ad-4421-42af-9fd2-623cb9022f33 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:19.439006 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ea0db-063e-4236-8a12-62ba75545846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:19.439669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ea0db-063e-4236-8a12-62ba75545846 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:19.439981 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ea0db-063e-4236-8a12-62ba75545846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:19.440264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ea0db-063e-4236-8a12-62ba75545846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:19.440990 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ea0db-063e-4236-8a12-62ba75545846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:19.442587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ea0db-063e-4236-8a12-62ba75545846 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:19.454621 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1233/2477] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:17:19.459242 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9639a-e6f6-40cf-9347-687a11601fa8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:19.470071 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9639a-e6f6-40cf-9347-687a11601fa8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:19.474877 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab45d67-473c-4b65-8f60-185241e781c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:19.475938 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab45d67-473c-4b65-8f60-185241e781c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:19.476241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab45d67-473c-4b65-8f60-185241e781c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:19.476523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab45d67-473c-4b65-8f60-185241e781c0 admin admin] PATH_INFO: `/v3/projects/0cc9a499ecb249808ab9546285c258e2/users/c4b8eace4820407cbc17c87a18ad199f/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:19.492457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab45d67-473c-4b65-8f60-185241e781c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc9a499ecb249808ab9546285c258e2, user_id=c4b8eace4820407cbc17c87a18ad199f, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:19.496611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab45d67-473c-4b65-8f60-185241e781c0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:19.519992 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1245/2478] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:17:19 2022] PUT /identity/v3/projects/0cc9a499ecb249808ab9546285c258e2/users/c4b8eace4820407cbc17c87a18ad199f/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:19.521424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ea0db-063e-4236-8a12-62ba75545846 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:19.535097 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ea0db-063e-4236-8a12-62ba75545846 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:19.610082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c07339-0103-4e14-966b-e21a6c70bfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:19.611234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c07339-0103-4e14-966b-e21a6c70bfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:19.611546 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c07339-0103-4e14-966b-e21a6c70bfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:19.611940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c07339-0103-4e14-966b-e21a6c70bfa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:19.612696 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c07339-0103-4e14-966b-e21a6c70bfa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:19.614344 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c07339-0103-4e14-966b-e21a6c70bfa8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:19.627990 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1234/2479] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:17:19.632397 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab45d67-473c-4b65-8f60-185241e781c0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:19.644686 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab45d67-473c-4b65-8f60-185241e781c0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:19.650329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e77193-0000-4ae7-8aa4-73ddcd7f2d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:19.651856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e77193-0000-4ae7-8aa4-73ddcd7f2d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:19.652807 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e77193-0000-4ae7-8aa4-73ddcd7f2d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:19.653795 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e77193-0000-4ae7-8aa4-73ddcd7f2d36 admin admin] PATH_INFO: `/v3/projects/0cc9a499ecb249808ab9546285c258e2/users/c4b8eace4820407cbc17c87a18ad199f/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:19.656160 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e77193-0000-4ae7-8aa4-73ddcd7f2d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc9a499ecb249808ab9546285c258e2, user_id=c4b8eace4820407cbc17c87a18ad199f, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:19.658868 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e77193-0000-4ae7-8aa4-73ddcd7f2d36 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:19.672740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1246/2480] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:17:19 2022] PUT /identity/v3/projects/0cc9a499ecb249808ab9546285c258e2/users/c4b8eace4820407cbc17c87a18ad199f/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:19.683624 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8c19d-3a0b-4ff8-a5b6-d96eb0d9114b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:19.684328 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8c19d-3a0b-4ff8-a5b6-d96eb0d9114b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:19.684660 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8c19d-3a0b-4ff8-a5b6-d96eb0d9114b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:19.713079 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1bf8c19d-3a0b-4ff8-a5b6-d96eb0d9114b None None] MFA Rules not processed for user `c4b8eace4820407cbc17c87a18ad199f`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:19.714317 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1bf8c19d-3a0b-4ff8-a5b6-d96eb0d9114b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:19.796599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1235/2481] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:19 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:17:19.810784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e77193-0000-4ae7-8aa4-73ddcd7f2d36 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:19.812027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-37e77193-0000-4ae7-8aa4-73ddcd7f2d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:19.890454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e77193-0000-4ae7-8aa4-73ddcd7f2d36 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:19.894592 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bae7c2-8c14-443c-bb10-243e05e01dd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:19.895624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bae7c2-8c14-443c-bb10-243e05e01dd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:19.895944 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bae7c2-8c14-443c-bb10-243e05e01dd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:19.896220 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bae7c2-8c14-443c-bb10-243e05e01dd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:19.905905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bae7c2-8c14-443c-bb10-243e05e01dd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:19.907345 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bae7c2-8c14-443c-bb10-243e05e01dd4 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:19.917338 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1247/2482] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:17:19 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:20.013061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8c19d-3a0b-4ff8-a5b6-d96eb0d9114b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:20.025907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8c19d-3a0b-4ff8-a5b6-d96eb0d9114b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:20.030064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad3a77-a0a2-4ea7-a065-9536fbbe523a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:20.030707 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad3a77-a0a2-4ea7-a065-9536fbbe523a service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:20.030986 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad3a77-a0a2-4ea7-a065-9536fbbe523a service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:20.031256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad3a77-a0a2-4ea7-a065-9536fbbe523a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:20.054641 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:20.092670 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad3a77-a0a2-4ea7-a065-9536fbbe523a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:20.094118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad3a77-a0a2-4ea7-a065-9536fbbe523a service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:20.103278 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1236/2483] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:17:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:21.299247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bae7c2-8c14-443c-bb10-243e05e01dd4 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:21.300716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-43bae7c2-8c14-443c-bb10-243e05e01dd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:21.366745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bae7c2-8c14-443c-bb10-243e05e01dd4 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:21.371362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966f1dc-6e1f-429d-932e-e1f6a6d8201d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:21.372700 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966f1dc-6e1f-429d-932e-e1f6a6d8201d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:21.372700 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966f1dc-6e1f-429d-932e-e1f6a6d8201d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:21.372938 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966f1dc-6e1f-429d-932e-e1f6a6d8201d admin admin] PATH_INFO: `/v3/users/05f4b76e29444e2383a9d247f72449cf` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:21.374172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966f1dc-6e1f-429d-932e-e1f6a6d8201d admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f4b76e29444e2383a9d247f72449cf)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:21.376301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966f1dc-6e1f-429d-932e-e1f6a6d8201d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:21.425258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e966f1dc-6e1f-429d-932e-e1f6a6d8201d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f4b76e29444e2383a9d247f72449cf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:21.425907 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e966f1dc-6e1f-429d-932e-e1f6a6d8201d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f4b76e29444e2383a9d247f72449cf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:21.432964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e966f1dc-6e1f-429d-932e-e1f6a6d8201d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f4b76e29444e2383a9d247f72449cf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:21.440626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e966f1dc-6e1f-429d-932e-e1f6a6d8201d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f4b76e29444e2383a9d247f72449cf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:21.441745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:21.456778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e966f1dc-6e1f-429d-932e-e1f6a6d8201d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f4b76e29444e2383a9d247f72449cf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:21.463107 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1248/2484] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:17:21 2022] DELETE /identity/v3/users/05f4b76e29444e2383a9d247f72449cf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:21.635730 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad3a77-a0a2-4ea7-a065-9536fbbe523a service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:21.649251 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad3a77-a0a2-4ea7-a065-9536fbbe523a service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:21.729498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:21.730413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:21.730701 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:21.730979 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e admin admin] PATH_INFO: `/v3/projects/0c221a083c034f49b95500f351220a93` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:21.732224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c221a083c034f49b95500f351220a93)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:21.734176 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:21.783053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c221a083c034f49b95500f351220a93', 'request_id': 'req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:21.789259 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c221a083c034f49b95500f351220a93', 'request_id': 'req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:21.796238 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c221a083c034f49b95500f351220a93', 'request_id': 'req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:21.807080 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e admin admin] The token cache is being invalidate because project 0c221a083c034f49b95500f351220a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:17:21.807499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:21.808017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:21.810098 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1237/2485] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:17:21 2022] DELETE /identity/v3/projects/0c221a083c034f49b95500f351220a93 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:21.814053 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966f1dc-6e1f-429d-932e-e1f6a6d8201d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:21.815498 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e966f1dc-6e1f-429d-932e-e1f6a6d8201d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:21.829647 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966f1dc-6e1f-429d-932e-e1f6a6d8201d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:21.892401 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1ca50-7b74-4e4e-b60e-ead85fecb810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:21.893292 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1ca50-7b74-4e4e-b60e-ead85fecb810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:21.893581 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1ca50-7b74-4e4e-b60e-ead85fecb810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:21.893862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1ca50-7b74-4e4e-b60e-ead85fecb810 admin admin] PATH_INFO: `/v3/users/3562116abe4e4deaa84570ff5a011578` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:21.895044 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1ca50-7b74-4e4e-b60e-ead85fecb810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3562116abe4e4deaa84570ff5a011578)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:21.897017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1ca50-7b74-4e4e-b60e-ead85fecb810 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:21.942380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bca1ca50-7b74-4e4e-b60e-ead85fecb810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3562116abe4e4deaa84570ff5a011578'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:21.943020 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bca1ca50-7b74-4e4e-b60e-ead85fecb810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3562116abe4e4deaa84570ff5a011578'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:21.951000 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bca1ca50-7b74-4e4e-b60e-ead85fecb810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3562116abe4e4deaa84570ff5a011578'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:21.957929 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bca1ca50-7b74-4e4e-b60e-ead85fecb810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3562116abe4e4deaa84570ff5a011578'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:21.970046 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bca1ca50-7b74-4e4e-b60e-ead85fecb810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3562116abe4e4deaa84570ff5a011578'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:21.976227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1249/2486] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:17:21 2022] DELETE /identity/v3/users/3562116abe4e4deaa84570ff5a011578 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:17:22.146876 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:22.148349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:22.168914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a549bf-eb63-4a61-bf3c-53c61bdb5f0e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:22.222237 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:22.234063 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471c07b-b12c-4c32-a1e7-be21390cc9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:22.235349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471c07b-b12c-4c32-a1e7-be21390cc9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:22.235452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471c07b-b12c-4c32-a1e7-be21390cc9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:22.235923 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471c07b-b12c-4c32-a1e7-be21390cc9b0 admin admin] PATH_INFO: `/v3/projects/cd3e5b86d4bc4f179217d58a9db6be42` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:22.237299 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471c07b-b12c-4c32-a1e7-be21390cc9b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd3e5b86d4bc4f179217d58a9db6be42)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:22.239388 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471c07b-b12c-4c32-a1e7-be21390cc9b0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:22.286686 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e471c07b-b12c-4c32-a1e7-be21390cc9b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd3e5b86d4bc4f179217d58a9db6be42', 'request_id': 'req-e471c07b-b12c-4c32-a1e7-be21390cc9b0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:22.292491 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e471c07b-b12c-4c32-a1e7-be21390cc9b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd3e5b86d4bc4f179217d58a9db6be42', 'request_id': 'req-e471c07b-b12c-4c32-a1e7-be21390cc9b0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:22.300260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e471c07b-b12c-4c32-a1e7-be21390cc9b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd3e5b86d4bc4f179217d58a9db6be42', 'request_id': 'req-e471c07b-b12c-4c32-a1e7-be21390cc9b0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:22.311368 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e471c07b-b12c-4c32-a1e7-be21390cc9b0 admin admin] The token cache is being invalidate because project cd3e5b86d4bc4f179217d58a9db6be42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:17:22.311664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e471c07b-b12c-4c32-a1e7-be21390cc9b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:22.312290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e471c07b-b12c-4c32-a1e7-be21390cc9b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:22.313838 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1238/2487] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:17:22 2022] DELETE /identity/v3/projects/cd3e5b86d4bc4f179217d58a9db6be42 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:24.805162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1ca50-7b74-4e4e-b60e-ead85fecb810 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:24.806595 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bca1ca50-7b74-4e4e-b60e-ead85fecb810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:24.821036 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1ca50-7b74-4e4e-b60e-ead85fecb810 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:24.879830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b1aba-341a-42f5-aaea-4ec13b03e76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:24.880759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b1aba-341a-42f5-aaea-4ec13b03e76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:24.881046 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b1aba-341a-42f5-aaea-4ec13b03e76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:24.881326 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b1aba-341a-42f5-aaea-4ec13b03e76e admin admin] PATH_INFO: `/v3/users/1d163ea940a94a31b72403201ae394ac` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:24.882534 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b1aba-341a-42f5-aaea-4ec13b03e76e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d163ea940a94a31b72403201ae394ac)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:24.884497 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b1aba-341a-42f5-aaea-4ec13b03e76e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:24.886108 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:24.933092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3b5b1aba-341a-42f5-aaea-4ec13b03e76e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d163ea940a94a31b72403201ae394ac'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:24.934258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3b5b1aba-341a-42f5-aaea-4ec13b03e76e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d163ea940a94a31b72403201ae394ac'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:24.943219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3b5b1aba-341a-42f5-aaea-4ec13b03e76e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d163ea940a94a31b72403201ae394ac'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:24.950377 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3b5b1aba-341a-42f5-aaea-4ec13b03e76e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d163ea940a94a31b72403201ae394ac'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:24.963527 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3b5b1aba-341a-42f5-aaea-4ec13b03e76e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d163ea940a94a31b72403201ae394ac'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:24.969487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1250/2488] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:17:24 2022] DELETE /identity/v3/users/1d163ea940a94a31b72403201ae394ac => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:24.974382 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bf439-3ae8-40a9-ac42-1758ebdf6232 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:24.974864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bf439-3ae8-40a9-ac42-1758ebdf6232 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:24.974970 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bf439-3ae8-40a9-ac42-1758ebdf6232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:24.995464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a00bf439-3ae8-40a9-ac42-1758ebdf6232 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:24.997239 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a00bf439-3ae8-40a9-ac42-1758ebdf6232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:25.074148 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1239/2489] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:25.084482 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b1aba-341a-42f5-aaea-4ec13b03e76e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:25.085933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3b5b1aba-341a-42f5-aaea-4ec13b03e76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:25.148353 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b1aba-341a-42f5-aaea-4ec13b03e76e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:25.151972 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b01ff4-61b7-4dca-a300-56f3012bcbff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:25.152610 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b01ff4-61b7-4dca-a300-56f3012bcbff service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:25.152901 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b01ff4-61b7-4dca-a300-56f3012bcbff service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:25.153184 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b01ff4-61b7-4dca-a300-56f3012bcbff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:25.162420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b01ff4-61b7-4dca-a300-56f3012bcbff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:25.163850 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b01ff4-61b7-4dca-a300-56f3012bcbff service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:25.173819 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1251/2490] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:17:25.473637 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bf439-3ae8-40a9-ac42-1758ebdf6232 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:25.475127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a00bf439-3ae8-40a9-ac42-1758ebdf6232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:25.490732 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bf439-3ae8-40a9-ac42-1758ebdf6232 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:25.495437 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f06ab2-5f7c-417e-8e96-15a77e76a96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:25.497310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f06ab2-5f7c-417e-8e96-15a77e76a96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:25.497603 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f06ab2-5f7c-417e-8e96-15a77e76a96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:25.497978 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f06ab2-5f7c-417e-8e96-15a77e76a96d admin admin] PATH_INFO: `/v3/projects/7120ec98ab074efa99bf691779b06f7d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:25.499104 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f06ab2-5f7c-417e-8e96-15a77e76a96d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7120ec98ab074efa99bf691779b06f7d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:25.501075 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f06ab2-5f7c-417e-8e96-15a77e76a96d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:25.556401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-21f06ab2-5f7c-417e-8e96-15a77e76a96d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7120ec98ab074efa99bf691779b06f7d', 'request_id': 'req-21f06ab2-5f7c-417e-8e96-15a77e76a96d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:25.562762 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-21f06ab2-5f7c-417e-8e96-15a77e76a96d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7120ec98ab074efa99bf691779b06f7d', 'request_id': 'req-21f06ab2-5f7c-417e-8e96-15a77e76a96d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:25.570576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-21f06ab2-5f7c-417e-8e96-15a77e76a96d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7120ec98ab074efa99bf691779b06f7d', 'request_id': 'req-21f06ab2-5f7c-417e-8e96-15a77e76a96d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:25.582264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-21f06ab2-5f7c-417e-8e96-15a77e76a96d admin admin] The token cache is being invalidate because project 7120ec98ab074efa99bf691779b06f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:17:25.582559 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-21f06ab2-5f7c-417e-8e96-15a77e76a96d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:25.583184 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-21f06ab2-5f7c-417e-8e96-15a77e76a96d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:25.584771 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1240/2491] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:17:25 2022] DELETE /identity/v3/projects/7120ec98ab074efa99bf691779b06f7d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:25.588707 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b01ff4-61b7-4dca-a300-56f3012bcbff service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:25.598729 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b01ff4-61b7-4dca-a300-56f3012bcbff service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:25.654044 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08904d00-3453-47c3-9fa4-c9f1a86f6bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:25.654919 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08904d00-3453-47c3-9fa4-c9f1a86f6bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:25.655354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08904d00-3453-47c3-9fa4-c9f1a86f6bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:25.655798 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08904d00-3453-47c3-9fa4-c9f1a86f6bba admin admin] PATH_INFO: `/v3/users/c4b8eace4820407cbc17c87a18ad199f` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:25.657012 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08904d00-3453-47c3-9fa4-c9f1a86f6bba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b8eace4820407cbc17c87a18ad199f)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:25.658962 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08904d00-3453-47c3-9fa4-c9f1a86f6bba admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:25.682426 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:25.706667 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-08904d00-3453-47c3-9fa4-c9f1a86f6bba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b8eace4820407cbc17c87a18ad199f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:25.707326 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-08904d00-3453-47c3-9fa4-c9f1a86f6bba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b8eace4820407cbc17c87a18ad199f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:25.722531 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-08904d00-3453-47c3-9fa4-c9f1a86f6bba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b8eace4820407cbc17c87a18ad199f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:25.729726 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-08904d00-3453-47c3-9fa4-c9f1a86f6bba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b8eace4820407cbc17c87a18ad199f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:25.741355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-08904d00-3453-47c3-9fa4-c9f1a86f6bba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b8eace4820407cbc17c87a18ad199f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:25.747175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1252/2492] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:17:25 2022] DELETE /identity/v3/users/c4b8eace4820407cbc17c87a18ad199f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:26.012192 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f06ab2-5f7c-417e-8e96-15a77e76a96d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:26.013657 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-21f06ab2-5f7c-417e-8e96-15a77e76a96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:26.026357 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f06ab2-5f7c-417e-8e96-15a77e76a96d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:26.030060 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:26.085038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ee90b-a5ff-45ee-8b4d-43c8165d8907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:26.085897 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ee90b-a5ff-45ee-8b4d-43c8165d8907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:26.086186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ee90b-a5ff-45ee-8b4d-43c8165d8907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:26.086464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ee90b-a5ff-45ee-8b4d-43c8165d8907 admin admin] PATH_INFO: `/v3/projects/0cc9a499ecb249808ab9546285c258e2` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:26.087644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ee90b-a5ff-45ee-8b4d-43c8165d8907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cc9a499ecb249808ab9546285c258e2)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:26.089664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ee90b-a5ff-45ee-8b4d-43c8165d8907 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:26.133624 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-232ee90b-a5ff-45ee-8b4d-43c8165d8907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cc9a499ecb249808ab9546285c258e2', 'request_id': 'req-232ee90b-a5ff-45ee-8b4d-43c8165d8907'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:26.139507 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-232ee90b-a5ff-45ee-8b4d-43c8165d8907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cc9a499ecb249808ab9546285c258e2', 'request_id': 'req-232ee90b-a5ff-45ee-8b4d-43c8165d8907'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:26.147249 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-232ee90b-a5ff-45ee-8b4d-43c8165d8907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cc9a499ecb249808ab9546285c258e2', 'request_id': 'req-232ee90b-a5ff-45ee-8b4d-43c8165d8907'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:26.158058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-232ee90b-a5ff-45ee-8b4d-43c8165d8907 admin admin] The token cache is being invalidate because project 0cc9a499ecb249808ab9546285c258e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:17:26.158369 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-232ee90b-a5ff-45ee-8b4d-43c8165d8907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:26.159130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-232ee90b-a5ff-45ee-8b4d-43c8165d8907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:26.160849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1241/2493] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:17:26 2022] DELETE /identity/v3/projects/0cc9a499ecb249808ab9546285c258e2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:26.166203 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771827ef-c8cf-4601-9129-9fe682edfcf8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:26.166664 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771827ef-c8cf-4601-9129-9fe682edfcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:26.166805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771827ef-c8cf-4601-9129-9fe682edfcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:26.185313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-771827ef-c8cf-4601-9129-9fe682edfcf8 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:26.187229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-771827ef-c8cf-4601-9129-9fe682edfcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:26.251142 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1253/2494] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:26.259100 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe0635-6f10-4963-95f1-546e981bb686 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:26.259388 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe0635-6f10-4963-95f1-546e981bb686 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:26.259666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe0635-6f10-4963-95f1-546e981bb686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:26.278078 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-abbe0635-6f10-4963-95f1-546e981bb686 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:26.279259 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-abbe0635-6f10-4963-95f1-546e981bb686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:26.287285 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1242/2495] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:26.291548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771827ef-c8cf-4601-9129-9fe682edfcf8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:26.301557 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771827ef-c8cf-4601-9129-9fe682edfcf8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:26.306159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbcc1b-c6a8-436e-b1c7-4f2f5ced8277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:26.306810 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbcc1b-c6a8-436e-b1c7-4f2f5ced8277 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:26.307100 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbcc1b-c6a8-436e-b1c7-4f2f5ced8277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:26.307386 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbcc1b-c6a8-436e-b1c7-4f2f5ced8277 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:26.308705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbcc1b-c6a8-436e-b1c7-4f2f5ced8277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:17:26.309023 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbcc1b-c6a8-436e-b1c7-4f2f5ced8277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:26.310609 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbcc1b-c6a8-436e-b1c7-4f2f5ced8277 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:26.322176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1254/2496] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:17:26.326866 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe0635-6f10-4963-95f1-546e981bb686 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:26.336162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe0635-6f10-4963-95f1-546e981bb686 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:26.340852 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0233e-befc-4335-86d3-db440651ec1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:26.341496 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0233e-befc-4335-86d3-db440651ec1d admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:26.341783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0233e-befc-4335-86d3-db440651ec1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:26.342068 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0233e-befc-4335-86d3-db440651ec1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:26.342798 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0233e-befc-4335-86d3-db440651ec1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:26.344737 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0233e-befc-4335-86d3-db440651ec1d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:26.373879 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1243/2497] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:17:26 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:17:26.375038 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbcc1b-c6a8-436e-b1c7-4f2f5ced8277 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:26.385108 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbcc1b-c6a8-436e-b1c7-4f2f5ced8277 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:26.441179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5693d-7be8-4b74-9f18-a652ce5e2b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:26.441773 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5693d-7be8-4b74-9f18-a652ce5e2b34 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:26.442062 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5693d-7be8-4b74-9f18-a652ce5e2b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:26.442343 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5693d-7be8-4b74-9f18-a652ce5e2b34 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:26.443027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5693d-7be8-4b74-9f18-a652ce5e2b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:26.445015 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5693d-7be8-4b74-9f18-a652ce5e2b34 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:26.465114 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1255/2498] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:17:26 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:17:26.469376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0233e-befc-4335-86d3-db440651ec1d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:26.479694 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0233e-befc-4335-86d3-db440651ec1d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:26.484805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963018ba-74e4-4ae2-9739-13773d829efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:26.485491 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963018ba-74e4-4ae2-9739-13773d829efe admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:26.485781 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963018ba-74e4-4ae2-9739-13773d829efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:26.486064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963018ba-74e4-4ae2-9739-13773d829efe admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:26.486793 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963018ba-74e4-4ae2-9739-13773d829efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:26.488476 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963018ba-74e4-4ae2-9739-13773d829efe admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:26.500252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1244/2499] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:17:26.504007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5693d-7be8-4b74-9f18-a652ce5e2b34 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:26.513748 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5693d-7be8-4b74-9f18-a652ce5e2b34 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:26.518327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963bd16-7103-4549-acb6-7a2bf8e26f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:26.518970 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963bd16-7103-4549-acb6-7a2bf8e26f31 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:26.519256 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963bd16-7103-4549-acb6-7a2bf8e26f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:26.519537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963bd16-7103-4549-acb6-7a2bf8e26f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:26.520300 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963bd16-7103-4549-acb6-7a2bf8e26f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:26.521915 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963bd16-7103-4549-acb6-7a2bf8e26f31 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:26.531620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1256/2500] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:17:26.535438 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963018ba-74e4-4ae2-9739-13773d829efe admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:26.546009 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963018ba-74e4-4ae2-9739-13773d829efe admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:26.550604 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4ac89-7f11-47df-a9ec-a2e3a8c99292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:26.551481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ac89-7f11-47df-a9ec-a2e3a8c99292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:26.551768 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ac89-7f11-47df-a9ec-a2e3a8c99292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:26.552083 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ac89-7f11-47df-a9ec-a2e3a8c99292 admin admin] PATH_INFO: `/v3/projects/e4651beff5c04da5bf94957efc6ff5f8/users/5f4ac9b61a664ac5970cf4a05cf97f84/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:26.566787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4ac89-7f11-47df-a9ec-a2e3a8c99292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4651beff5c04da5bf94957efc6ff5f8, user_id=5f4ac9b61a664ac5970cf4a05cf97f84, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:26.569479 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4ac89-7f11-47df-a9ec-a2e3a8c99292 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:26.582497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1245/2501] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:17:26 2022] PUT /identity/v3/projects/e4651beff5c04da5bf94957efc6ff5f8/users/5f4ac9b61a664ac5970cf4a05cf97f84/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:26.593478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c9bbd-bf4e-44a4-9d43-e67f47d5ab2f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:26.593768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c9bbd-bf4e-44a4-9d43-e67f47d5ab2f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:26.594045 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c9bbd-bf4e-44a4-9d43-e67f47d5ab2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:26.606802 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:26.622295 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fd8c9bbd-bf4e-44a4-9d43-e67f47d5ab2f None None] MFA Rules not processed for user `5f4ac9b61a664ac5970cf4a05cf97f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:26.623487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fd8c9bbd-bf4e-44a4-9d43-e67f47d5ab2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:26.687536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1257/2502] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:17:26.698364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4ac89-7f11-47df-a9ec-a2e3a8c99292 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:26.700076 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-42d4ac89-7f11-47df-a9ec-a2e3a8c99292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:26.736583 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:26.759688 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4ac89-7f11-47df-a9ec-a2e3a8c99292 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:26.763301 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1c4c8-c4fa-4aba-b9f3-ab48adef0ed8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182c7bb48c184e9983c02ae86709e803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:26.763971 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1c4c8-c4fa-4aba-b9f3-ab48adef0ed8 service glance] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:26.764257 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1c4c8-c4fa-4aba-b9f3-ab48adef0ed8 service glance] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:26.764531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1c4c8-c4fa-4aba-b9f3-ab48adef0ed8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:26.772664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1c4c8-c4fa-4aba-b9f3-ab48adef0ed8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:26.774147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1c4c8-c4fa-4aba-b9f3-ab48adef0ed8 service glance] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:26.785473 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1246/2503] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:17:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:36.684622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=29 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:36.780749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=11 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:52.716533 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c9bbd-bf4e-44a4-9d43-e67f47d5ab2f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:52.777460 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c9bbd-bf4e-44a4-9d43-e67f47d5ab2f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:52.781968 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c21efa-99bb-432e-b908-a667e9aae8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:52.782851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c21efa-99bb-432e-b908-a667e9aae8ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:52.783133 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c21efa-99bb-432e-b908-a667e9aae8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:52.783407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c21efa-99bb-432e-b908-a667e9aae8ef admin admin] PATH_INFO: `/v3/users/5f4ac9b61a664ac5970cf4a05cf97f84` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:52.784583 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c21efa-99bb-432e-b908-a667e9aae8ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f4ac9b61a664ac5970cf4a05cf97f84)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:52.786525 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c21efa-99bb-432e-b908-a667e9aae8ef admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:52.833144 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b4c21efa-99bb-432e-b908-a667e9aae8ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f4ac9b61a664ac5970cf4a05cf97f84'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:52.833806 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b4c21efa-99bb-432e-b908-a667e9aae8ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f4ac9b61a664ac5970cf4a05cf97f84'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:52.841899 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b4c21efa-99bb-432e-b908-a667e9aae8ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f4ac9b61a664ac5970cf4a05cf97f84'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:52.849342 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b4c21efa-99bb-432e-b908-a667e9aae8ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f4ac9b61a664ac5970cf4a05cf97f84'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:52.861591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b4c21efa-99bb-432e-b908-a667e9aae8ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f4ac9b61a664ac5970cf4a05cf97f84'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:52.867496 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1258/2504] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:17:52 2022] DELETE /identity/v3/users/5f4ac9b61a664ac5970cf4a05cf97f84 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:52.872108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab88a4-216c-4698-8bef-61e84b265cc0 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:52.873097 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab88a4-216c-4698-8bef-61e84b265cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:52.873197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab88a4-216c-4698-8bef-61e84b265cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:52.889811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-49ab88a4-216c-4698-8bef-61e84b265cc0 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:52.891055 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-49ab88a4-216c-4698-8bef-61e84b265cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:52.947986 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1247/2505] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:52.957494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c21efa-99bb-432e-b908-a667e9aae8ef admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:52.958925 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b4c21efa-99bb-432e-b908-a667e9aae8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:53.015529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c21efa-99bb-432e-b908-a667e9aae8ef admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:53.019214 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bc668-0335-47f5-a7dc-4741a5e2cfed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:53.019859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bc668-0335-47f5-a7dc-4741a5e2cfed service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:53.020179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bc668-0335-47f5-a7dc-4741a5e2cfed service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:53.020460 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bc668-0335-47f5-a7dc-4741a5e2cfed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:53.029902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bc668-0335-47f5-a7dc-4741a5e2cfed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:53.031340 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bc668-0335-47f5-a7dc-4741a5e2cfed service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:53.041089 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1259/2506] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:53.303184 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab88a4-216c-4698-8bef-61e84b265cc0 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:53.304803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-49ab88a4-216c-4698-8bef-61e84b265cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:53.317452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab88a4-216c-4698-8bef-61e84b265cc0 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:53.322191 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa3459-386a-4a35-9c27-954579eddc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:53.323055 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa3459-386a-4a35-9c27-954579eddc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:53.323339 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa3459-386a-4a35-9c27-954579eddc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:53.323611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa3459-386a-4a35-9c27-954579eddc7c admin admin] PATH_INFO: `/v3/projects/e4651beff5c04da5bf94957efc6ff5f8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:53.324863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa3459-386a-4a35-9c27-954579eddc7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4651beff5c04da5bf94957efc6ff5f8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:53.327306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa3459-386a-4a35-9c27-954579eddc7c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:53.374805 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9afa3459-386a-4a35-9c27-954579eddc7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4651beff5c04da5bf94957efc6ff5f8', 'request_id': 'req-9afa3459-386a-4a35-9c27-954579eddc7c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:53.380644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9afa3459-386a-4a35-9c27-954579eddc7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4651beff5c04da5bf94957efc6ff5f8', 'request_id': 'req-9afa3459-386a-4a35-9c27-954579eddc7c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:53.388707 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9afa3459-386a-4a35-9c27-954579eddc7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4651beff5c04da5bf94957efc6ff5f8', 'request_id': 'req-9afa3459-386a-4a35-9c27-954579eddc7c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:53.399825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9afa3459-386a-4a35-9c27-954579eddc7c admin admin] The token cache is being invalidate because project e4651beff5c04da5bf94957efc6ff5f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:17:53.400147 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9afa3459-386a-4a35-9c27-954579eddc7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:53.400797 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9afa3459-386a-4a35-9c27-954579eddc7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:17:53.402335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1248/2507] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:17:53 2022] DELETE /identity/v3/projects/e4651beff5c04da5bf94957efc6ff5f8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:53.407852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc02e7-ae44-4272-a72e-e2ae29305df2 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:53.408173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc02e7-ae44-4272-a72e-e2ae29305df2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:53.408457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc02e7-ae44-4272-a72e-e2ae29305df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:53.426016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7adc02e7-ae44-4272-a72e-e2ae29305df2 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:53.427227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7adc02e7-ae44-4272-a72e-e2ae29305df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:53.443755 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:53.487817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1260/2508] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:53.495442 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cf275-e301-4fc3-8bb5-3a562dc7eb89 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:53.495734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cf275-e301-4fc3-8bb5-3a562dc7eb89 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:53.496045 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cf275-e301-4fc3-8bb5-3a562dc7eb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:53.514537 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0f0cf275-e301-4fc3-8bb5-3a562dc7eb89 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:53.515727 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0f0cf275-e301-4fc3-8bb5-3a562dc7eb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:53.523554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1249/2509] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:53.527699 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc02e7-ae44-4272-a72e-e2ae29305df2 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:53.538199 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc02e7-ae44-4272-a72e-e2ae29305df2 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:53.542766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f944c-9e08-4d7f-be8d-a26ad23a55a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:53.543419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f944c-9e08-4d7f-be8d-a26ad23a55a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:53.543710 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f944c-9e08-4d7f-be8d-a26ad23a55a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:53.544104 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f944c-9e08-4d7f-be8d-a26ad23a55a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:53.544838 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f944c-9e08-4d7f-be8d-a26ad23a55a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:17:53.545151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f944c-9e08-4d7f-be8d-a26ad23a55a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:53.546749 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f944c-9e08-4d7f-be8d-a26ad23a55a2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:53.558207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1261/2510] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:17:53.562410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cf275-e301-4fc3-8bb5-3a562dc7eb89 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:53.571549 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cf275-e301-4fc3-8bb5-3a562dc7eb89 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:53.576790 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44dfd3-ac5b-4170-bb17-8b0923c106c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:53.577432 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44dfd3-ac5b-4170-bb17-8b0923c106c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:53.577715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44dfd3-ac5b-4170-bb17-8b0923c106c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:53.577985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44dfd3-ac5b-4170-bb17-8b0923c106c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:53.578693 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44dfd3-ac5b-4170-bb17-8b0923c106c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:53.580611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44dfd3-ac5b-4170-bb17-8b0923c106c7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:53.606788 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1250/2511] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:17:53 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:17:53.610815 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f944c-9e08-4d7f-be8d-a26ad23a55a2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:53.620721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f944c-9e08-4d7f-be8d-a26ad23a55a2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:53.676281 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d4ef3-4167-42fb-8ecc-3a23f106ff35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:53.676942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d4ef3-4167-42fb-8ecc-3a23f106ff35 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:53.677226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d4ef3-4167-42fb-8ecc-3a23f106ff35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:53.677502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d4ef3-4167-42fb-8ecc-3a23f106ff35 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:53.678188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d4ef3-4167-42fb-8ecc-3a23f106ff35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:53.680108 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d4ef3-4167-42fb-8ecc-3a23f106ff35 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:53.702313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1262/2512] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:17:53 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:17:53.706277 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44dfd3-ac5b-4170-bb17-8b0923c106c7 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:53.716552 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44dfd3-ac5b-4170-bb17-8b0923c106c7 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:53.721110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c2f80-c0e2-4eb3-9898-0d88d4d2450a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:53.721763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c2f80-c0e2-4eb3-9898-0d88d4d2450a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:53.722047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c2f80-c0e2-4eb3-9898-0d88d4d2450a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:53.722319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c2f80-c0e2-4eb3-9898-0d88d4d2450a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:53.723076 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c2f80-c0e2-4eb3-9898-0d88d4d2450a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:53.724717 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c2f80-c0e2-4eb3-9898-0d88d4d2450a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:53.735238 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1251/2513] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:17:53.739012 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d4ef3-4167-42fb-8ecc-3a23f106ff35 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:53.749529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d4ef3-4167-42fb-8ecc-3a23f106ff35 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:53.754302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270e515-5f49-475c-bfe0-792dd376a36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:53.754958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270e515-5f49-475c-bfe0-792dd376a36b admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:53.755245 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270e515-5f49-475c-bfe0-792dd376a36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:53.755531 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270e515-5f49-475c-bfe0-792dd376a36b admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:53.756301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270e515-5f49-475c-bfe0-792dd376a36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:53.757892 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270e515-5f49-475c-bfe0-792dd376a36b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:53.768309 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1263/2514] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:17:53.772172 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c2f80-c0e2-4eb3-9898-0d88d4d2450a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:53.781785 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c2f80-c0e2-4eb3-9898-0d88d4d2450a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:53.786430 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d127d6-2bf2-41aa-b13c-876ef26f6d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:53.787637 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d127d6-2bf2-41aa-b13c-876ef26f6d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:53.788067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d127d6-2bf2-41aa-b13c-876ef26f6d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:53.788357 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d127d6-2bf2-41aa-b13c-876ef26f6d05 admin admin] PATH_INFO: `/v3/projects/c7d24260d3f048df88c31749a48744d5/users/04976993a29a40bd9663d3c26f9066bb/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:53.802928 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d127d6-2bf2-41aa-b13c-876ef26f6d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d24260d3f048df88c31749a48744d5, user_id=04976993a29a40bd9663d3c26f9066bb, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:53.805657 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d127d6-2bf2-41aa-b13c-876ef26f6d05 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:53.818498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1252/2515] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:17:53 2022] PUT /identity/v3/projects/c7d24260d3f048df88c31749a48744d5/users/04976993a29a40bd9663d3c26f9066bb/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:53.830253 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5bde2-34bf-4603-8d6b-d1e914035db2 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:53.830547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5bde2-34bf-4603-8d6b-d1e914035db2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:53.830828 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5bde2-34bf-4603-8d6b-d1e914035db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:53.859562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8cd5bde2-34bf-4603-8d6b-d1e914035db2 None None] MFA Rules not processed for user `04976993a29a40bd9663d3c26f9066bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:53.860841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8cd5bde2-34bf-4603-8d6b-d1e914035db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:53.930530 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1264/2516] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:53.935616 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d127d6-2bf2-41aa-b13c-876ef26f6d05 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:53.956763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:53.999732 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d127d6-2bf2-41aa-b13c-876ef26f6d05 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:54.004401 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b07b14-44b8-4c87-abe1-fd6c315ae918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:54.005060 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b07b14-44b8-4c87-abe1-fd6c315ae918 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:54.005346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b07b14-44b8-4c87-abe1-fd6c315ae918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:54.005625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b07b14-44b8-4c87-abe1-fd6c315ae918 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:54.006317 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b07b14-44b8-4c87-abe1-fd6c315ae918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:54.008256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b07b14-44b8-4c87-abe1-fd6c315ae918 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:54.033721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1253/2517] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:17:53 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:17:54.038006 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5bde2-34bf-4603-8d6b-d1e914035db2 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:54.049072 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5bde2-34bf-4603-8d6b-d1e914035db2 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:54.061588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:54.105759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280147c3-e358-428e-8703-a066dbe10678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:54.106950 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280147c3-e358-428e-8703-a066dbe10678 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:54.107230 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280147c3-e358-428e-8703-a066dbe10678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:54.107502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280147c3-e358-428e-8703-a066dbe10678 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:54.108222 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280147c3-e358-428e-8703-a066dbe10678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:54.110233 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280147c3-e358-428e-8703-a066dbe10678 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:54.129812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1265/2518] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:17:54 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:17:54.133777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b07b14-44b8-4c87-abe1-fd6c315ae918 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:54.143794 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b07b14-44b8-4c87-abe1-fd6c315ae918 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:54.148334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdecc7d-05dc-4341-846f-828c0fb3e1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:54.148982 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdecc7d-05dc-4341-846f-828c0fb3e1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:54.149268 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdecc7d-05dc-4341-846f-828c0fb3e1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:54.149540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdecc7d-05dc-4341-846f-828c0fb3e1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:54.150258 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdecc7d-05dc-4341-846f-828c0fb3e1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:54.151832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdecc7d-05dc-4341-846f-828c0fb3e1b9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:54.164400 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1254/2519] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:17:54.168241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280147c3-e358-428e-8703-a066dbe10678 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:54.178763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280147c3-e358-428e-8703-a066dbe10678 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:54.183385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9c48b-0a09-4644-90c6-fb32904d488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:54.184100 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9c48b-0a09-4644-90c6-fb32904d488a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:54.184370 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9c48b-0a09-4644-90c6-fb32904d488a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:54.185199 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9c48b-0a09-4644-90c6-fb32904d488a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:54.185952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9c48b-0a09-4644-90c6-fb32904d488a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:54.187532 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9c48b-0a09-4644-90c6-fb32904d488a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:54.197503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1266/2520] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:17:54.201450 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdecc7d-05dc-4341-846f-828c0fb3e1b9 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:54.211076 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdecc7d-05dc-4341-846f-828c0fb3e1b9 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:54.215670 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94945e7c-d4b7-464c-958e-c8d5cca336a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:54.216616 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94945e7c-d4b7-464c-958e-c8d5cca336a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:54.216902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94945e7c-d4b7-464c-958e-c8d5cca336a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:54.217179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94945e7c-d4b7-464c-958e-c8d5cca336a6 admin admin] PATH_INFO: `/v3/projects/8c89cb3478ac477d9cccfe5a39332580/users/465aa503778e4b6a9f471db750417dc5/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:54.232393 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94945e7c-d4b7-464c-958e-c8d5cca336a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c89cb3478ac477d9cccfe5a39332580, user_id=465aa503778e4b6a9f471db750417dc5, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:54.235065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94945e7c-d4b7-464c-958e-c8d5cca336a6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:54.247330 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1255/2521] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:17:54 2022] PUT /identity/v3/projects/8c89cb3478ac477d9cccfe5a39332580/users/465aa503778e4b6a9f471db750417dc5/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:54.257318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1421a-4cad-449b-a733-9ecc153aedf8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:54.257567 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1421a-4cad-449b-a733-9ecc153aedf8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:54.257853 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1421a-4cad-449b-a733-9ecc153aedf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:54.284544 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e2f1421a-4cad-449b-a733-9ecc153aedf8 None None] MFA Rules not processed for user `465aa503778e4b6a9f471db750417dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:54.285756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e2f1421a-4cad-449b-a733-9ecc153aedf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:54.350936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1267/2522] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:54.355402 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94945e7c-d4b7-464c-958e-c8d5cca336a6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:54.416936 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94945e7c-d4b7-464c-958e-c8d5cca336a6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:54.421751 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80be91c-cd88-4b82-aecd-839ff3ab6c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:54.422404 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80be91c-cd88-4b82-aecd-839ff3ab6c4c admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:54.422690 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80be91c-cd88-4b82-aecd-839ff3ab6c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:54.422975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80be91c-cd88-4b82-aecd-839ff3ab6c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:54.423669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80be91c-cd88-4b82-aecd-839ff3ab6c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:54.425825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80be91c-cd88-4b82-aecd-839ff3ab6c4c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:54.459223 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1256/2523] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:17:54 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:17:54.463565 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1421a-4cad-449b-a733-9ecc153aedf8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:54.474477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1421a-4cad-449b-a733-9ecc153aedf8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:54.530204 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923535b9-3863-4922-a1ed-c625c9068e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:54.530803 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923535b9-3863-4922-a1ed-c625c9068e64 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:54.531092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923535b9-3863-4922-a1ed-c625c9068e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:54.531372 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923535b9-3863-4922-a1ed-c625c9068e64 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:54.532101 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923535b9-3863-4922-a1ed-c625c9068e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:54.534061 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923535b9-3863-4922-a1ed-c625c9068e64 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:54.553556 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1268/2524] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:17:54 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:17:54.557688 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80be91c-cd88-4b82-aecd-839ff3ab6c4c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:54.568465 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80be91c-cd88-4b82-aecd-839ff3ab6c4c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:54.573057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb5f3c-e6c8-4f4d-b08e-1a69fd8c9b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:54.573713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb5f3c-e6c8-4f4d-b08e-1a69fd8c9b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:54.574002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb5f3c-e6c8-4f4d-b08e-1a69fd8c9b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:54.574284 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb5f3c-e6c8-4f4d-b08e-1a69fd8c9b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:54.575135 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb5f3c-e6c8-4f4d-b08e-1a69fd8c9b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:54.577264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb5f3c-e6c8-4f4d-b08e-1a69fd8c9b0b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:54.588806 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1257/2525] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:17:54.592862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923535b9-3863-4922-a1ed-c625c9068e64 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:54.602679 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923535b9-3863-4922-a1ed-c625c9068e64 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:54.607324 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dac0c-9170-4d77-94db-cf029d3d2651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:54.608261 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dac0c-9170-4d77-94db-cf029d3d2651 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:54.608548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dac0c-9170-4d77-94db-cf029d3d2651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:54.608830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dac0c-9170-4d77-94db-cf029d3d2651 admin admin] PATH_INFO: `/v3/projects/1225f757bf034ab38c97e29441c50145/users/026bb1b57b384ecc89bd44fbd96481c9/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:54.622731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:54.626014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dac0c-9170-4d77-94db-cf029d3d2651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1225f757bf034ab38c97e29441c50145, user_id=026bb1b57b384ecc89bd44fbd96481c9, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:54.629411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dac0c-9170-4d77-94db-cf029d3d2651 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:54.642322 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1269/2526] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:17:54 2022] PUT /identity/v3/projects/1225f757bf034ab38c97e29441c50145/users/026bb1b57b384ecc89bd44fbd96481c9/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:54.646299 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb5f3c-e6c8-4f4d-b08e-1a69fd8c9b0b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:54.656282 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb5f3c-e6c8-4f4d-b08e-1a69fd8c9b0b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:54.697170 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:17:54.713497 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0c11d-6b9c-4dd9-8ce4-05e43e71b545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:54.714304 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0c11d-6b9c-4dd9-8ce4-05e43e71b545 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:54.714593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0c11d-6b9c-4dd9-8ce4-05e43e71b545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:54.714874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0c11d-6b9c-4dd9-8ce4-05e43e71b545 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:54.715606 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0c11d-6b9c-4dd9-8ce4-05e43e71b545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:54.717257 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0c11d-6b9c-4dd9-8ce4-05e43e71b545 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:54.726842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1258/2527] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:17:54.730930 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dac0c-9170-4d77-94db-cf029d3d2651 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:54.741162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dac0c-9170-4d77-94db-cf029d3d2651 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:54.745779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25da8b7-52ef-4863-8ea5-9e56163af72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:54.746654 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25da8b7-52ef-4863-8ea5-9e56163af72d admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:54.747432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25da8b7-52ef-4863-8ea5-9e56163af72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:54.747714 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25da8b7-52ef-4863-8ea5-9e56163af72d admin admin] PATH_INFO: `/v3/projects/1225f757bf034ab38c97e29441c50145/users/026bb1b57b384ecc89bd44fbd96481c9/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:54.749727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25da8b7-52ef-4863-8ea5-9e56163af72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1225f757bf034ab38c97e29441c50145, user_id=026bb1b57b384ecc89bd44fbd96481c9, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:54.752404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25da8b7-52ef-4863-8ea5-9e56163af72d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:54.762334 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1270/2528] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:17:54 2022] PUT /identity/v3/projects/1225f757bf034ab38c97e29441c50145/users/026bb1b57b384ecc89bd44fbd96481c9/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:17:54.772285 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d429c95-066e-4e55-abff-aff96b0d4823 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:54.772582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d429c95-066e-4e55-abff-aff96b0d4823 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:54.772868 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d429c95-066e-4e55-abff-aff96b0d4823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:54.799506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5d429c95-066e-4e55-abff-aff96b0d4823 None None] MFA Rules not processed for user `026bb1b57b384ecc89bd44fbd96481c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:17:54.800675 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5d429c95-066e-4e55-abff-aff96b0d4823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:54.867442 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1259/2529] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:17:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:17:54.879109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25da8b7-52ef-4863-8ea5-9e56163af72d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:54.880836 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d25da8b7-52ef-4863-8ea5-9e56163af72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:17:54.937876 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25da8b7-52ef-4863-8ea5-9e56163af72d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:54.941528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d460a63-f50b-4271-b1c4-3be7cb200a50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:54.942169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d460a63-f50b-4271-b1c4-3be7cb200a50 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:54.942458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d460a63-f50b-4271-b1c4-3be7cb200a50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:54.942767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d460a63-f50b-4271-b1c4-3be7cb200a50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:55.002749 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d460a63-f50b-4271-b1c4-3be7cb200a50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:55.005105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d460a63-f50b-4271-b1c4-3be7cb200a50 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:55.017250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1271/2530] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:17:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:56.516785 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d429c95-066e-4e55-abff-aff96b0d4823 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:56.527000 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d429c95-066e-4e55-abff-aff96b0d4823 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:56.533609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0f836-0efc-4f48-b754-c86cc2cdaae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:56.535014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0f836-0efc-4f48-b754-c86cc2cdaae7 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:56.535435 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0f836-0efc-4f48-b754-c86cc2cdaae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:56.535746 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0f836-0efc-4f48-b754-c86cc2cdaae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:56.608758 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0f836-0efc-4f48-b754-c86cc2cdaae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:56.610393 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0f836-0efc-4f48-b754-c86cc2cdaae7 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:56.622595 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1260/2531] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:17:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:17:57.130588 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d460a63-f50b-4271-b1c4-3be7cb200a50 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:17:57.138977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d460a63-f50b-4271-b1c4-3be7cb200a50 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:17:57.142499 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689e430-b5e3-4dde-8af5-0a91474058a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:17:57.143135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689e430-b5e3-4dde-8af5-0a91474058a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:17:57.143418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689e430-b5e3-4dde-8af5-0a91474058a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:17:57.143693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689e430-b5e3-4dde-8af5-0a91474058a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:17:57.152467 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689e430-b5e3-4dde-8af5-0a91474058a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:17:57.153905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689e430-b5e3-4dde-8af5-0a91474058a2 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:17:57.163344 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1272/2532] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:17:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:18:01.024382 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0f836-0efc-4f48-b754-c86cc2cdaae7 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:01.086118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0f836-0efc-4f48-b754-c86cc2cdaae7 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:01.091217 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d70f2-49cb-44ff-b9ff-e73eacc28259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:01.092120 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d70f2-49cb-44ff-b9ff-e73eacc28259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:01.092412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d70f2-49cb-44ff-b9ff-e73eacc28259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:01.092722 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d70f2-49cb-44ff-b9ff-e73eacc28259 admin admin] PATH_INFO: `/v3/users/04976993a29a40bd9663d3c26f9066bb` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:01.093978 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d70f2-49cb-44ff-b9ff-e73eacc28259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04976993a29a40bd9663d3c26f9066bb)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:01.095907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d70f2-49cb-44ff-b9ff-e73eacc28259 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:01.100540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:01.142499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d09d70f2-49cb-44ff-b9ff-e73eacc28259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04976993a29a40bd9663d3c26f9066bb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:01.149320 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d09d70f2-49cb-44ff-b9ff-e73eacc28259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04976993a29a40bd9663d3c26f9066bb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:01.156207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d09d70f2-49cb-44ff-b9ff-e73eacc28259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04976993a29a40bd9663d3c26f9066bb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:01.156856 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d09d70f2-49cb-44ff-b9ff-e73eacc28259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04976993a29a40bd9663d3c26f9066bb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:01.157460 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d09d70f2-49cb-44ff-b9ff-e73eacc28259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04976993a29a40bd9663d3c26f9066bb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:01.174839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1261/2533] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:18:01 2022] DELETE /identity/v3/users/04976993a29a40bd9663d3c26f9066bb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:18:01.179383 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a3d84-ed2e-4d9c-9142-d6bdb6002646 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:01.179886 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a3d84-ed2e-4d9c-9142-d6bdb6002646 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:01.180016 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a3d84-ed2e-4d9c-9142-d6bdb6002646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:01.197312 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a00a3d84-ed2e-4d9c-9142-d6bdb6002646 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:18:01.198520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a00a3d84-ed2e-4d9c-9142-d6bdb6002646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:01.257276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1273/2534] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:18:01.267057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d70f2-49cb-44ff-b9ff-e73eacc28259 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:01.268527 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d09d70f2-49cb-44ff-b9ff-e73eacc28259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:01.324329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d70f2-49cb-44ff-b9ff-e73eacc28259 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:01.328153 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103de6d-9995-4f78-ab7d-cd4441d28ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:01.328796 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103de6d-9995-4f78-ab7d-cd4441d28ccd service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:01.329083 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103de6d-9995-4f78-ab7d-cd4441d28ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:01.329370 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103de6d-9995-4f78-ab7d-cd4441d28ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:01.338233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103de6d-9995-4f78-ab7d-cd4441d28ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:01.339648 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103de6d-9995-4f78-ab7d-cd4441d28ccd service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:01.349724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1262/2535] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:18:01.612131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a3d84-ed2e-4d9c-9142-d6bdb6002646 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:01.613573 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a00a3d84-ed2e-4d9c-9142-d6bdb6002646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:01.627851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a3d84-ed2e-4d9c-9142-d6bdb6002646 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:01.632502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78272f5f-dc31-4e03-af85-3f62fa62a826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:01.634113 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78272f5f-dc31-4e03-af85-3f62fa62a826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:01.634404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78272f5f-dc31-4e03-af85-3f62fa62a826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:01.634680 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78272f5f-dc31-4e03-af85-3f62fa62a826 admin admin] PATH_INFO: `/v3/projects/c7d24260d3f048df88c31749a48744d5` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:01.635883 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78272f5f-dc31-4e03-af85-3f62fa62a826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d24260d3f048df88c31749a48744d5)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:01.638100 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78272f5f-dc31-4e03-af85-3f62fa62a826 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:01.653917 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:01.686800 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-78272f5f-dc31-4e03-af85-3f62fa62a826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d24260d3f048df88c31749a48744d5', 'request_id': 'req-78272f5f-dc31-4e03-af85-3f62fa62a826'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:01.693350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-78272f5f-dc31-4e03-af85-3f62fa62a826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d24260d3f048df88c31749a48744d5', 'request_id': 'req-78272f5f-dc31-4e03-af85-3f62fa62a826'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:01.699876 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-78272f5f-dc31-4e03-af85-3f62fa62a826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d24260d3f048df88c31749a48744d5', 'request_id': 'req-78272f5f-dc31-4e03-af85-3f62fa62a826'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:01.709917 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-78272f5f-dc31-4e03-af85-3f62fa62a826 admin admin] The token cache is being invalidate because project c7d24260d3f048df88c31749a48744d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:18:01.710204 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-78272f5f-dc31-4e03-af85-3f62fa62a826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:01.710830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-78272f5f-dc31-4e03-af85-3f62fa62a826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:01.712376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1274/2536] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:18:01 2022] DELETE /identity/v3/projects/c7d24260d3f048df88c31749a48744d5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:18:01.716457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103de6d-9995-4f78-ab7d-cd4441d28ccd service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:01.725876 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103de6d-9995-4f78-ab7d-cd4441d28ccd service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:01.780421 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79673289-ee99-48ce-93f1-5ec44352f138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:01.781292 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79673289-ee99-48ce-93f1-5ec44352f138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:01.781571 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79673289-ee99-48ce-93f1-5ec44352f138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:01.781846 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79673289-ee99-48ce-93f1-5ec44352f138 admin admin] PATH_INFO: `/v3/users/465aa503778e4b6a9f471db750417dc5` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:01.783017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79673289-ee99-48ce-93f1-5ec44352f138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=465aa503778e4b6a9f471db750417dc5)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:01.785069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79673289-ee99-48ce-93f1-5ec44352f138 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:01.814283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:01.833185 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-79673289-ee99-48ce-93f1-5ec44352f138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '465aa503778e4b6a9f471db750417dc5'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:01.839870 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-79673289-ee99-48ce-93f1-5ec44352f138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '465aa503778e4b6a9f471db750417dc5'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:01.847203 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-79673289-ee99-48ce-93f1-5ec44352f138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '465aa503778e4b6a9f471db750417dc5'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:01.847834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-79673289-ee99-48ce-93f1-5ec44352f138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '465aa503778e4b6a9f471db750417dc5'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:01.848478 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-79673289-ee99-48ce-93f1-5ec44352f138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '465aa503778e4b6a9f471db750417dc5'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:01.865796 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1263/2537] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:18:01 2022] DELETE /identity/v3/users/465aa503778e4b6a9f471db750417dc5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:18:02.131725 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78272f5f-dc31-4e03-af85-3f62fa62a826 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:02.132793 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-78272f5f-dc31-4e03-af85-3f62fa62a826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:02.146329 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78272f5f-dc31-4e03-af85-3f62fa62a826 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:02.207285 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612bf44-a552-421a-9d1f-4ea3e04f2626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:02.208197 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612bf44-a552-421a-9d1f-4ea3e04f2626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:02.208485 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612bf44-a552-421a-9d1f-4ea3e04f2626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:02.208766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612bf44-a552-421a-9d1f-4ea3e04f2626 admin admin] PATH_INFO: `/v3/projects/8c89cb3478ac477d9cccfe5a39332580` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:02.209941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612bf44-a552-421a-9d1f-4ea3e04f2626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c89cb3478ac477d9cccfe5a39332580)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:02.211869 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612bf44-a552-421a-9d1f-4ea3e04f2626 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:02.256636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d612bf44-a552-421a-9d1f-4ea3e04f2626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c89cb3478ac477d9cccfe5a39332580', 'request_id': 'req-d612bf44-a552-421a-9d1f-4ea3e04f2626'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:02.264154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d612bf44-a552-421a-9d1f-4ea3e04f2626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c89cb3478ac477d9cccfe5a39332580', 'request_id': 'req-d612bf44-a552-421a-9d1f-4ea3e04f2626'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:02.270281 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d612bf44-a552-421a-9d1f-4ea3e04f2626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c89cb3478ac477d9cccfe5a39332580', 'request_id': 'req-d612bf44-a552-421a-9d1f-4ea3e04f2626'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:02.281052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d612bf44-a552-421a-9d1f-4ea3e04f2626 admin admin] The token cache is being invalidate because project 8c89cb3478ac477d9cccfe5a39332580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:18:02.281355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d612bf44-a552-421a-9d1f-4ea3e04f2626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:02.282013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d612bf44-a552-421a-9d1f-4ea3e04f2626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:02.283553 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1275/2538] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:18:02 2022] DELETE /identity/v3/projects/8c89cb3478ac477d9cccfe5a39332580 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:18:02.287946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79673289-ee99-48ce-93f1-5ec44352f138 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:02.289350 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-79673289-ee99-48ce-93f1-5ec44352f138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:02.302334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79673289-ee99-48ce-93f1-5ec44352f138 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:02.356413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02efdae-aa78-49df-a732-713a32474e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:02.357274 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02efdae-aa78-49df-a732-713a32474e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:02.357560 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02efdae-aa78-49df-a732-713a32474e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:02.357831 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02efdae-aa78-49df-a732-713a32474e6a admin admin] PATH_INFO: `/v3/users/026bb1b57b384ecc89bd44fbd96481c9` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:02.358995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02efdae-aa78-49df-a732-713a32474e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=026bb1b57b384ecc89bd44fbd96481c9)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:02.360948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02efdae-aa78-49df-a732-713a32474e6a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:02.408051 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f02efdae-aa78-49df-a732-713a32474e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '026bb1b57b384ecc89bd44fbd96481c9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:02.415654 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f02efdae-aa78-49df-a732-713a32474e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '026bb1b57b384ecc89bd44fbd96481c9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:02.427622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f02efdae-aa78-49df-a732-713a32474e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '026bb1b57b384ecc89bd44fbd96481c9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:02.428286 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f02efdae-aa78-49df-a732-713a32474e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '026bb1b57b384ecc89bd44fbd96481c9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:02.428931 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f02efdae-aa78-49df-a732-713a32474e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '026bb1b57b384ecc89bd44fbd96481c9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:02.445800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1264/2539] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:18:02 2022] DELETE /identity/v3/users/026bb1b57b384ecc89bd44fbd96481c9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:18:02.718389 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612bf44-a552-421a-9d1f-4ea3e04f2626 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:02.719924 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d612bf44-a552-421a-9d1f-4ea3e04f2626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:02.734283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612bf44-a552-421a-9d1f-4ea3e04f2626 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:02.765801 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:02.793951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c236177-c639-43d9-9e8c-4983d23f4e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:02.794833 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c236177-c639-43d9-9e8c-4983d23f4e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:02.795280 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c236177-c639-43d9-9e8c-4983d23f4e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:02.795548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c236177-c639-43d9-9e8c-4983d23f4e4a admin admin] PATH_INFO: `/v3/projects/1225f757bf034ab38c97e29441c50145` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:02.796775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c236177-c639-43d9-9e8c-4983d23f4e4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1225f757bf034ab38c97e29441c50145)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:02.798687 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c236177-c639-43d9-9e8c-4983d23f4e4a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:02.844019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1c236177-c639-43d9-9e8c-4983d23f4e4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1225f757bf034ab38c97e29441c50145', 'request_id': 'req-1c236177-c639-43d9-9e8c-4983d23f4e4a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:02.851607 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1c236177-c639-43d9-9e8c-4983d23f4e4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1225f757bf034ab38c97e29441c50145', 'request_id': 'req-1c236177-c639-43d9-9e8c-4983d23f4e4a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:02.858199 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1c236177-c639-43d9-9e8c-4983d23f4e4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1225f757bf034ab38c97e29441c50145', 'request_id': 'req-1c236177-c639-43d9-9e8c-4983d23f4e4a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:02.868830 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1c236177-c639-43d9-9e8c-4983d23f4e4a admin admin] The token cache is being invalidate because project 1225f757bf034ab38c97e29441c50145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:18:02.869120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1c236177-c639-43d9-9e8c-4983d23f4e4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:02.869783 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1c236177-c639-43d9-9e8c-4983d23f4e4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:02.871351 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1276/2540] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:18:02 2022] DELETE /identity/v3/projects/1225f757bf034ab38c97e29441c50145 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:18:02.876784 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6613225-0b51-46a8-9474-18da37585f9c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:02.877077 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6613225-0b51-46a8-9474-18da37585f9c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:02.877358 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6613225-0b51-46a8-9474-18da37585f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:02.896549 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e6613225-0b51-46a8-9474-18da37585f9c None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:18:02.897694 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e6613225-0b51-46a8-9474-18da37585f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:02.916405 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:02.958306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1265/2541] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:18:02.966510 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeca14-0dd9-4770-8aeb-fca239268db8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:02.966804 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeca14-0dd9-4770-8aeb-fca239268db8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:02.967084 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeca14-0dd9-4770-8aeb-fca239268db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:02.986251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c6aeca14-0dd9-4770-8aeb-fca239268db8 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:18:02.987459 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c6aeca14-0dd9-4770-8aeb-fca239268db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:02.995332 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1277/2542] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:18:02.999561 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6613225-0b51-46a8-9474-18da37585f9c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:03.009191 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6613225-0b51-46a8-9474-18da37585f9c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:03.014242 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd20c4-9bdb-48a4-acd9-b7de3969c51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:03.014898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd20c4-9bdb-48a4-acd9-b7de3969c51b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:03.015184 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd20c4-9bdb-48a4-acd9-b7de3969c51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:03.015462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd20c4-9bdb-48a4-acd9-b7de3969c51b admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:03.016226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd20c4-9bdb-48a4-acd9-b7de3969c51b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:18:03.016536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd20c4-9bdb-48a4-acd9-b7de3969c51b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:03.018127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd20c4-9bdb-48a4-acd9-b7de3969c51b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:03.029996 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1266/2543] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:18:03.034348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeca14-0dd9-4770-8aeb-fca239268db8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:03.043983 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeca14-0dd9-4770-8aeb-fca239268db8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:03.048732 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af679b1-2dc8-4fd4-860d-d46180ed800f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:03.049434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af679b1-2dc8-4fd4-860d-d46180ed800f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:03.049726 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af679b1-2dc8-4fd4-860d-d46180ed800f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:03.050008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af679b1-2dc8-4fd4-860d-d46180ed800f admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:03.050743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af679b1-2dc8-4fd4-860d-d46180ed800f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:03.052681 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af679b1-2dc8-4fd4-860d-d46180ed800f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:03.077987 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1278/2544] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:18:03 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:18:03.081978 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd20c4-9bdb-48a4-acd9-b7de3969c51b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:03.092205 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd20c4-9bdb-48a4-acd9-b7de3969c51b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:03.146703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d8689-99dd-4b22-a676-ab6f7af1863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:03.147297 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d8689-99dd-4b22-a676-ab6f7af1863c admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:03.147582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d8689-99dd-4b22-a676-ab6f7af1863c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:03.147888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d8689-99dd-4b22-a676-ab6f7af1863c admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:03.148610 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d8689-99dd-4b22-a676-ab6f7af1863c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:03.150518 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d8689-99dd-4b22-a676-ab6f7af1863c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:03.170456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1267/2545] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:18:03 2022] POST /identity/v3/users => generated 284 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:18:03.174477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af679b1-2dc8-4fd4-860d-d46180ed800f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:03.184968 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af679b1-2dc8-4fd4-860d-d46180ed800f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:03.189660 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bf1f6-e978-4234-94c8-d80aedd53385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:03.190330 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bf1f6-e978-4234-94c8-d80aedd53385 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:03.190618 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bf1f6-e978-4234-94c8-d80aedd53385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:03.190900 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bf1f6-e978-4234-94c8-d80aedd53385 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:03.191634 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bf1f6-e978-4234-94c8-d80aedd53385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:03.193258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bf1f6-e978-4234-94c8-d80aedd53385 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:03.205384 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1279/2546] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:18:03.209459 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d8689-99dd-4b22-a676-ab6f7af1863c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:03.219955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d8689-99dd-4b22-a676-ab6f7af1863c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:03.224766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079791c-fcc8-4102-a6b2-8714b034019d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:03.225500 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079791c-fcc8-4102-a6b2-8714b034019d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:03.225835 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079791c-fcc8-4102-a6b2-8714b034019d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:03.226134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079791c-fcc8-4102-a6b2-8714b034019d admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:03.226906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079791c-fcc8-4102-a6b2-8714b034019d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:03.228545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079791c-fcc8-4102-a6b2-8714b034019d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:03.239015 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1268/2547] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:18:03.242931 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bf1f6-e978-4234-94c8-d80aedd53385 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:03.253229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bf1f6-e978-4234-94c8-d80aedd53385 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:03.257891 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6bd0f-6b70-4a19-96f8-236bca255548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:03.258787 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6bd0f-6b70-4a19-96f8-236bca255548 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:03.259077 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6bd0f-6b70-4a19-96f8-236bca255548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:03.259362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6bd0f-6b70-4a19-96f8-236bca255548 admin admin] PATH_INFO: `/v3/projects/ae510f2cee30402b88fbe66522cd7885/users/c38429b6f7c14eee855c98462495714e/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:03.274804 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6bd0f-6b70-4a19-96f8-236bca255548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae510f2cee30402b88fbe66522cd7885, user_id=c38429b6f7c14eee855c98462495714e, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:03.277635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6bd0f-6b70-4a19-96f8-236bca255548 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:03.293990 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1280/2548] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:18:03 2022] PUT /identity/v3/projects/ae510f2cee30402b88fbe66522cd7885/users/c38429b6f7c14eee855c98462495714e/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:18:03.304062 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60e289-c2a6-485b-9a49-6ca7b5150212 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:03.304616 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60e289-c2a6-485b-9a49-6ca7b5150212 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:03.304616 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60e289-c2a6-485b-9a49-6ca7b5150212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:03.330871 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1b60e289-c2a6-485b-9a49-6ca7b5150212 None None] MFA Rules not processed for user `c38429b6f7c14eee855c98462495714e`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:18:03.332171 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1b60e289-c2a6-485b-9a49-6ca7b5150212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:03.395318 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1269/2549] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:18:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:18:03.406326 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6bd0f-6b70-4a19-96f8-236bca255548 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:03.408144 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-feb6bd0f-6b70-4a19-96f8-236bca255548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:03.465042 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6bd0f-6b70-4a19-96f8-236bca255548 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:03.468701 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d148ae6-1503-4841-865e-222042c1f478 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '182c7bb48c184e9983c02ae86709e803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:03.469349 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d148ae6-1503-4841-865e-222042c1f478 service glance] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:03.469641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d148ae6-1503-4841-865e-222042c1f478 service glance] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:03.469923 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d148ae6-1503-4841-865e-222042c1f478 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:03.478361 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d148ae6-1503-4841-865e-222042c1f478 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:03.479777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d148ae6-1503-4841-865e-222042c1f478 service glance] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:03.488531 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1281/2550] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:18:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:18:13.388624 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60e289-c2a6-485b-9a49-6ca7b5150212 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:13.390033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1b60e289-c2a6-485b-9a49-6ca7b5150212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:13.392898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:13.463829 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60e289-c2a6-485b-9a49-6ca7b5150212 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:13.469357 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c28bd2-25fd-44a8-ae6d-7b61f9ab1884 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cccb366fc6429e9a30d4f9de64e8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:13.470011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c28bd2-25fd-44a8-ae6d-7b61f9ab1884 service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:13.470300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c28bd2-25fd-44a8-ae6d-7b61f9ab1884 service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:13.470576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c28bd2-25fd-44a8-ae6d-7b61f9ab1884 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:13.472443 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-60c28bd2-25fd-44a8-ae6d-7b61f9ab1884 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:13.484384 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c28bd2-25fd-44a8-ae6d-7b61f9ab1884 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:13.484564 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:13.486128 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c28bd2-25fd-44a8-ae6d-7b61f9ab1884 service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:13.498175 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1270/2551] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:18:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:18:18.046298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3779bc-2c1f-41eb-b95b-1447041260e0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:18.046812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3779bc-2c1f-41eb-b95b-1447041260e0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:18.046940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3779bc-2c1f-41eb-b95b-1447041260e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:18.064999 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9e3779bc-2c1f-41eb-b95b-1447041260e0 None None] MFA Rules not processed for user `b6c5da324ab2405a84036db91a1366a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:18:18.066189 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9e3779bc-2c1f-41eb-b95b-1447041260e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:18.123967 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1282/2552] 10.222.0.73 () {58 vars in 1009 bytes} [Thu May 19 12:18:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:18:18.170748 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c28bd2-25fd-44a8-ae6d-7b61f9ab1884 service placement] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:18.172302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-60c28bd2-25fd-44a8-ae6d-7b61f9ab1884 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:18.241470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c28bd2-25fd-44a8-ae6d-7b61f9ab1884 service placement] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:18.246460 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5167bd-a9b1-4d69-ac04-3b07c7e1bf5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371dae58e95d403b97e311c6616adab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:18.247102 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5167bd-a9b1-4d69-ac04-3b07c7e1bf5f service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:18.247385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5167bd-a9b1-4d69-ac04-3b07c7e1bf5f service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:18.247659 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5167bd-a9b1-4d69-ac04-3b07c7e1bf5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:18.255961 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5167bd-a9b1-4d69-ac04-3b07c7e1bf5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:18.257538 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5167bd-a9b1-4d69-ac04-3b07c7e1bf5f service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:18.266000 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1271/2553] 10.222.0.73 () {60 vars in 1384 bytes} [Thu May 19 12:18:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:18:28.117002 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=25 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:28.262739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=64 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:42.516081 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73366-3ee1-4fc3-9e46-04291e7c5d3b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:42.516555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73366-3ee1-4fc3-9e46-04291e7c5d3b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:42.516650 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73366-3ee1-4fc3-9e46-04291e7c5d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:42.534293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-dbd73366-3ee1-4fc3-9e46-04291e7c5d3b None None] MFA Rules not processed for user `b6c5da324ab2405a84036db91a1366a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:18:42.535474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-dbd73366-3ee1-4fc3-9e46-04291e7c5d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:42.543722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1283/2554] 10.222.0.73 () {58 vars in 1009 bytes} [Thu May 19 12:18:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:18:42.556130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5167bd-a9b1-4d69-ac04-3b07c7e1bf5f service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:42.567126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5167bd-a9b1-4d69-ac04-3b07c7e1bf5f service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:42.572218 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f13eec-ae29-4e5f-94b3-299947c407a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371dae58e95d403b97e311c6616adab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:42.572857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f13eec-ae29-4e5f-94b3-299947c407a5 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:42.573137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f13eec-ae29-4e5f-94b3-299947c407a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:42.573412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f13eec-ae29-4e5f-94b3-299947c407a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:42.581642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f13eec-ae29-4e5f-94b3-299947c407a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:42.583149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f13eec-ae29-4e5f-94b3-299947c407a5 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:42.591779 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1272/2555] 10.222.0.73 () {60 vars in 1384 bytes} [Thu May 19 12:18:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:18:52.528819 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:52.588078 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:55.817156 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd73366-3ee1-4fc3-9e46-04291e7c5d3b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:55.877419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd73366-3ee1-4fc3-9e46-04291e7c5d3b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:55.881852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868ceb1-2799-46c2-a605-09a2c5e80625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:55.882712 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868ceb1-2799-46c2-a605-09a2c5e80625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:55.882993 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868ceb1-2799-46c2-a605-09a2c5e80625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:55.883284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868ceb1-2799-46c2-a605-09a2c5e80625 admin admin] PATH_INFO: `/v3/users/c38429b6f7c14eee855c98462495714e` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:55.884474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868ceb1-2799-46c2-a605-09a2c5e80625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c38429b6f7c14eee855c98462495714e)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:55.886376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868ceb1-2799-46c2-a605-09a2c5e80625 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:55.930783 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0868ceb1-2799-46c2-a605-09a2c5e80625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c38429b6f7c14eee855c98462495714e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:55.931435 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0868ceb1-2799-46c2-a605-09a2c5e80625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c38429b6f7c14eee855c98462495714e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:55.938864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0868ceb1-2799-46c2-a605-09a2c5e80625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c38429b6f7c14eee855c98462495714e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:55.945737 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0868ceb1-2799-46c2-a605-09a2c5e80625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c38429b6f7c14eee855c98462495714e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:55.958143 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0868ceb1-2799-46c2-a605-09a2c5e80625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c38429b6f7c14eee855c98462495714e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:55.963968 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1284/2556] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:18:55 2022] DELETE /identity/v3/users/c38429b6f7c14eee855c98462495714e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:18:55.968494 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94fdd5-11f6-436f-9d18-8cff823bde60 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:55.968997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94fdd5-11f6-436f-9d18-8cff823bde60 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:55.969103 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94fdd5-11f6-436f-9d18-8cff823bde60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:55.986019 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ca94fdd5-11f6-436f-9d18-8cff823bde60 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:18:55.987196 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ca94fdd5-11f6-436f-9d18-8cff823bde60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:56.048356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1273/2557] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:18:56.057726 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868ceb1-2799-46c2-a605-09a2c5e80625 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:56.059104 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0868ceb1-2799-46c2-a605-09a2c5e80625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:56.117689 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868ceb1-2799-46c2-a605-09a2c5e80625 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:56.121410 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b8318-ccc7-4ef9-b7a0-84a6571b315c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:56.122075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b8318-ccc7-4ef9-b7a0-84a6571b315c service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:56.122371 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b8318-ccc7-4ef9-b7a0-84a6571b315c service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:56.123673 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b8318-ccc7-4ef9-b7a0-84a6571b315c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:56.132413 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b8318-ccc7-4ef9-b7a0-84a6571b315c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:56.133860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b8318-ccc7-4ef9-b7a0-84a6571b315c service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:56.144195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1285/2558] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:18:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:18:56.478866 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94fdd5-11f6-436f-9d18-8cff823bde60 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:56.480425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ca94fdd5-11f6-436f-9d18-8cff823bde60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:56.493108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94fdd5-11f6-436f-9d18-8cff823bde60 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:56.498122 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b363d-24a1-4a66-b6ba-40a2788f942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:56.499020 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b363d-24a1-4a66-b6ba-40a2788f942a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:56.499302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b363d-24a1-4a66-b6ba-40a2788f942a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:56.499577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b363d-24a1-4a66-b6ba-40a2788f942a admin admin] PATH_INFO: `/v3/projects/ae510f2cee30402b88fbe66522cd7885` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:56.500833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b363d-24a1-4a66-b6ba-40a2788f942a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae510f2cee30402b88fbe66522cd7885)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:56.502773 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b363d-24a1-4a66-b6ba-40a2788f942a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:56.550781 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb9b363d-24a1-4a66-b6ba-40a2788f942a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae510f2cee30402b88fbe66522cd7885', 'request_id': 'req-bb9b363d-24a1-4a66-b6ba-40a2788f942a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:56.556466 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb9b363d-24a1-4a66-b6ba-40a2788f942a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae510f2cee30402b88fbe66522cd7885', 'request_id': 'req-bb9b363d-24a1-4a66-b6ba-40a2788f942a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:56.563697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb9b363d-24a1-4a66-b6ba-40a2788f942a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae510f2cee30402b88fbe66522cd7885', 'request_id': 'req-bb9b363d-24a1-4a66-b6ba-40a2788f942a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:56.574461 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb9b363d-24a1-4a66-b6ba-40a2788f942a admin admin] The token cache is being invalidate because project ae510f2cee30402b88fbe66522cd7885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:18:56.574751 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb9b363d-24a1-4a66-b6ba-40a2788f942a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:56.575373 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bb9b363d-24a1-4a66-b6ba-40a2788f942a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:18:56.576927 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1274/2559] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:18:56 2022] DELETE /identity/v3/projects/ae510f2cee30402b88fbe66522cd7885 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:18:56.581787 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cdfc2-79bd-406c-9207-4f73ad343d04 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:56.582083 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cdfc2-79bd-406c-9207-4f73ad343d04 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:56.582367 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cdfc2-79bd-406c-9207-4f73ad343d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:56.600075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6c8cdfc2-79bd-406c-9207-4f73ad343d04 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:18:56.601281 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6c8cdfc2-79bd-406c-9207-4f73ad343d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:56.618331 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:56.660939 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1286/2560] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:18:56.721130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f6a45-02c8-4f9f-b571-4014f7271551 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:56.721574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f6a45-02c8-4f9f-b571-4014f7271551 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:56.721955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f6a45-02c8-4f9f-b571-4014f7271551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:56.740376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f67f6a45-02c8-4f9f-b571-4014f7271551 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:18:56.741577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f67f6a45-02c8-4f9f-b571-4014f7271551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:56.749376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1275/2561] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:18:56.753463 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cdfc2-79bd-406c-9207-4f73ad343d04 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:56.763117 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8cdfc2-79bd-406c-9207-4f73ad343d04 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:56.768283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfac34-9e44-4755-8769-eb05949356bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:56.768942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfac34-9e44-4755-8769-eb05949356bc admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:56.769226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfac34-9e44-4755-8769-eb05949356bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:56.769504 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfac34-9e44-4755-8769-eb05949356bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:56.770234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfac34-9e44-4755-8769-eb05949356bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:18:56.770545 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfac34-9e44-4755-8769-eb05949356bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:56.772159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfac34-9e44-4755-8769-eb05949356bc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:56.784471 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1287/2562] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:18:56.788770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f6a45-02c8-4f9f-b571-4014f7271551 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:56.797876 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f6a45-02c8-4f9f-b571-4014f7271551 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:56.802574 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40d858-afad-4bc7-a236-7da196035436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:56.803228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40d858-afad-4bc7-a236-7da196035436 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:56.803515 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40d858-afad-4bc7-a236-7da196035436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:56.803793 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40d858-afad-4bc7-a236-7da196035436 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:56.804542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40d858-afad-4bc7-a236-7da196035436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:56.806454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40d858-afad-4bc7-a236-7da196035436 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:56.832712 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1276/2563] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:18:56 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:18:56.836616 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfac34-9e44-4755-8769-eb05949356bc admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:56.847042 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfac34-9e44-4755-8769-eb05949356bc admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:56.902323 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b59874-ae13-46f7-a5f7-9fabbc1e06e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:56.902984 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b59874-ae13-46f7-a5f7-9fabbc1e06e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:56.903270 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b59874-ae13-46f7-a5f7-9fabbc1e06e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:56.903546 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b59874-ae13-46f7-a5f7-9fabbc1e06e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:56.904259 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b59874-ae13-46f7-a5f7-9fabbc1e06e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:56.906742 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b59874-ae13-46f7-a5f7-9fabbc1e06e7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:56.927582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1288/2564] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:18:56 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:18:56.931718 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40d858-afad-4bc7-a236-7da196035436 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:56.942763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40d858-afad-4bc7-a236-7da196035436 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:56.947498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fa206-403b-41f0-83ad-ceeb209b955f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:56.948188 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fa206-403b-41f0-83ad-ceeb209b955f admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:56.948480 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fa206-403b-41f0-83ad-ceeb209b955f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:56.948766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fa206-403b-41f0-83ad-ceeb209b955f admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:56.949500 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fa206-403b-41f0-83ad-ceeb209b955f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:56.951110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fa206-403b-41f0-83ad-ceeb209b955f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:56.965649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1277/2565] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:18:56.965840 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b59874-ae13-46f7-a5f7-9fabbc1e06e7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:56.975621 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b59874-ae13-46f7-a5f7-9fabbc1e06e7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:56.980245 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a70956-fb2c-45ee-9a40-7e9152490b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:56.980903 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70956-fb2c-45ee-9a40-7e9152490b07 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:56.981190 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70956-fb2c-45ee-9a40-7e9152490b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:56.981475 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70956-fb2c-45ee-9a40-7e9152490b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:56.982229 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a70956-fb2c-45ee-9a40-7e9152490b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:56.984355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a70956-fb2c-45ee-9a40-7e9152490b07 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:56.994106 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1289/2566] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:18:57.000209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fa206-403b-41f0-83ad-ceeb209b955f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:57.008891 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fa206-403b-41f0-83ad-ceeb209b955f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:57.013569 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284ead7-2a01-4360-8218-44afab117952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:57.014456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284ead7-2a01-4360-8218-44afab117952 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:57.014741 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284ead7-2a01-4360-8218-44afab117952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:57.015024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284ead7-2a01-4360-8218-44afab117952 admin admin] PATH_INFO: `/v3/projects/59e0b3baca5648c9a20ca57e0529a7c7/users/9778bd2585c8469399ce4b2a5db1c6ff/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:57.030334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284ead7-2a01-4360-8218-44afab117952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e0b3baca5648c9a20ca57e0529a7c7, user_id=9778bd2585c8469399ce4b2a5db1c6ff, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:57.033113 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284ead7-2a01-4360-8218-44afab117952 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:57.046969 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1278/2567] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:18:56 2022] PUT /identity/v3/projects/59e0b3baca5648c9a20ca57e0529a7c7/users/9778bd2585c8469399ce4b2a5db1c6ff/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:18:57.052055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fccb5-e706-40dd-9f5c-f331259a4f2b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:57.052369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fccb5-e706-40dd-9f5c-f331259a4f2b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:57.052662 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fccb5-e706-40dd-9f5c-f331259a4f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:57.070887 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-838fccb5-e706-40dd-9f5c-f331259a4f2b None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:18:57.072093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-838fccb5-e706-40dd-9f5c-f331259a4f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:57.131934 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1290/2568] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:18:57.141501 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284ead7-2a01-4360-8218-44afab117952 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:18:57.143183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9284ead7-2a01-4360-8218-44afab117952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:18:57.165364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:57.205094 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284ead7-2a01-4360-8218-44afab117952 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:18:57.208825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12114ff-0aab-42b6-85cc-25c027eb5189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:18:57.209481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12114ff-0aab-42b6-85cc-25c027eb5189 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:18:57.209766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12114ff-0aab-42b6-85cc-25c027eb5189 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:18:57.210046 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12114ff-0aab-42b6-85cc-25c027eb5189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:18:57.219631 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12114ff-0aab-42b6-85cc-25c027eb5189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:18:57.221171 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12114ff-0aab-42b6-85cc-25c027eb5189 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:18:57.230591 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1279/2569] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:01.662864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73074dea-f631-473b-9640-9b64108a1e77 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:01.663399 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73074dea-f631-473b-9640-9b64108a1e77 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:01.663520 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73074dea-f631-473b-9640-9b64108a1e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:01.693017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-73074dea-f631-473b-9640-9b64108a1e77 None None] MFA Rules not processed for user `9778bd2585c8469399ce4b2a5db1c6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:01.694153 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-73074dea-f631-473b-9640-9b64108a1e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:01.714157 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:01.771017 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1291/2570] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:19:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:01.776739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12114ff-0aab-42b6-85cc-25c027eb5189 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:01.789058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12114ff-0aab-42b6-85cc-25c027eb5189 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:01.793874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed05a2-242b-4d88-821f-5f145403e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:01.794557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed05a2-242b-4d88-821f-5f145403e2be admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:01.794902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed05a2-242b-4d88-821f-5f145403e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:01.795674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed05a2-242b-4d88-821f-5f145403e2be admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:01.796428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed05a2-242b-4d88-821f-5f145403e2be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:01.798336 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed05a2-242b-4d88-821f-5f145403e2be admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:01.824995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1280/2571] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:19:01 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:01.829029 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73074dea-f631-473b-9640-9b64108a1e77 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:01.842331 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73074dea-f631-473b-9640-9b64108a1e77 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:01.905497 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22408d2-d4c8-4a9e-8c30-14ddc0694bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:01.906276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22408d2-d4c8-4a9e-8c30-14ddc0694bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:01.906599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22408d2-d4c8-4a9e-8c30-14ddc0694bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:01.906888 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22408d2-d4c8-4a9e-8c30-14ddc0694bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:01.907516 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22408d2-d4c8-4a9e-8c30-14ddc0694bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:01.909502 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22408d2-d4c8-4a9e-8c30-14ddc0694bb3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:01.929809 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1292/2572] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:19:01 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:19:01.933725 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed05a2-242b-4d88-821f-5f145403e2be admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:01.943804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed05a2-242b-4d88-821f-5f145403e2be admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:01.948349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffc494-77ad-4e0a-84b7-f8a18c9a3218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:01.948999 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffc494-77ad-4e0a-84b7-f8a18c9a3218 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:01.949283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffc494-77ad-4e0a-84b7-f8a18c9a3218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:01.949558 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffc494-77ad-4e0a-84b7-f8a18c9a3218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:01.950295 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffc494-77ad-4e0a-84b7-f8a18c9a3218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:01.952450 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffc494-77ad-4e0a-84b7-f8a18c9a3218 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:01.962699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1281/2573] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:01.966700 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22408d2-d4c8-4a9e-8c30-14ddc0694bb3 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:01.977162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22408d2-d4c8-4a9e-8c30-14ddc0694bb3 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:01.981740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d17401-8c38-4a69-8a42-f7f3c808ed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:01.982647 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d17401-8c38-4a69-8a42-f7f3c808ed8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:01.982932 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d17401-8c38-4a69-8a42-f7f3c808ed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:01.983211 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d17401-8c38-4a69-8a42-f7f3c808ed8c admin admin] PATH_INFO: `/v3/projects/63b225219d2f4c4394f589b0892ec958/users/976b3335cbb1490b8992c2c3ff067bd2/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:01.998210 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d17401-8c38-4a69-8a42-f7f3c808ed8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b225219d2f4c4394f589b0892ec958, user_id=976b3335cbb1490b8992c2c3ff067bd2, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:02.000923 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d17401-8c38-4a69-8a42-f7f3c808ed8c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:02.014737 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1293/2574] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:19:01 2022] PUT /identity/v3/projects/63b225219d2f4c4394f589b0892ec958/users/976b3335cbb1490b8992c2c3ff067bd2/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:19:02.018794 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffc494-77ad-4e0a-84b7-f8a18c9a3218 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:02.028788 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffc494-77ad-4e0a-84b7-f8a18c9a3218 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:02.084195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f41c0-d09d-4fc7-887e-ef92654471bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:02.084858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f41c0-d09d-4fc7-887e-ef92654471bd admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:02.085138 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f41c0-d09d-4fc7-887e-ef92654471bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:02.085412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f41c0-d09d-4fc7-887e-ef92654471bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:02.086126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f41c0-d09d-4fc7-887e-ef92654471bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:02.087701 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f41c0-d09d-4fc7-887e-ef92654471bd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:02.097277 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1282/2575] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:19:02.101851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d17401-8c38-4a69-8a42-f7f3c808ed8c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:02.112054 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d17401-8c38-4a69-8a42-f7f3c808ed8c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:02.116651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7f490-dbfe-4f72-a18e-467ded682e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:02.117528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7f490-dbfe-4f72-a18e-467ded682e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:02.117809 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7f490-dbfe-4f72-a18e-467ded682e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:02.118088 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7f490-dbfe-4f72-a18e-467ded682e76 admin admin] PATH_INFO: `/v3/projects/63b225219d2f4c4394f589b0892ec958/users/976b3335cbb1490b8992c2c3ff067bd2/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:02.120281 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7f490-dbfe-4f72-a18e-467ded682e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b225219d2f4c4394f589b0892ec958, user_id=976b3335cbb1490b8992c2c3ff067bd2, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:02.122902 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7f490-dbfe-4f72-a18e-467ded682e76 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:02.135358 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1294/2576] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:19:02 2022] PUT /identity/v3/projects/63b225219d2f4c4394f589b0892ec958/users/976b3335cbb1490b8992c2c3ff067bd2/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:19:05.097066 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f41c0-d09d-4fc7-887e-ef92654471bd admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:05.168620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f41c0-d09d-4fc7-887e-ef92654471bd admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:05.246857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:05.263360 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ab32f-0503-4b40-9688-870e4b378e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:05.264775 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ab32f-0503-4b40-9688-870e4b378e54 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:05.265533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ab32f-0503-4b40-9688-870e4b378e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:05.265533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ab32f-0503-4b40-9688-870e4b378e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:05.268669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-355ab32f-0503-4b40-9688-870e4b378e54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:05.370525 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ab32f-0503-4b40-9688-870e4b378e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:05.370525 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ab32f-0503-4b40-9688-870e4b378e54 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:05.385449 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1283/2577] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:19:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:06.168873 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec983cde-b730-42aa-b44e-1b5922a28f25 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:06.169818 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec983cde-b730-42aa-b44e-1b5922a28f25 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:06.170270 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec983cde-b730-42aa-b44e-1b5922a28f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:06.193975 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ec983cde-b730-42aa-b44e-1b5922a28f25 None None] MFA Rules not processed for user `b6c5da324ab2405a84036db91a1366a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:06.195234 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ec983cde-b730-42aa-b44e-1b5922a28f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:06.400733 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1295/2578] 10.222.0.73 () {58 vars in 967 bytes} [Thu May 19 12:19:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:19:06.403092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ab32f-0503-4b40-9688-870e4b378e54 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:06.404608 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-355ab32f-0503-4b40-9688-870e4b378e54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:06.589404 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ab32f-0503-4b40-9688-870e4b378e54 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:06.601763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321701a-45ea-44f0-931b-64c999745088 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371dae58e95d403b97e311c6616adab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:06.602550 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321701a-45ea-44f0-931b-64c999745088 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:06.602994 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321701a-45ea-44f0-931b-64c999745088 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:06.603503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321701a-45ea-44f0-931b-64c999745088 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:06.626483 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321701a-45ea-44f0-931b-64c999745088 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:06.629862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321701a-45ea-44f0-931b-64c999745088 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:06.651863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1284/2579] 10.222.0.73 () {60 vars in 1384 bytes} [Thu May 19 12:19:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:19:06.781769 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec983cde-b730-42aa-b44e-1b5922a28f25 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:06.784145 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ec983cde-b730-42aa-b44e-1b5922a28f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:06.824964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec983cde-b730-42aa-b44e-1b5922a28f25 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:06.833848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a2c04-8ca0-4d62-9b29-550809a42b5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:06.846815 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a2c04-8ca0-4d62-9b29-550809a42b5e service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:06.847285 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a2c04-8ca0-4d62-9b29-550809a42b5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:06.849758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a2c04-8ca0-4d62-9b29-550809a42b5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:06.853052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8a3a2c04-8ca0-4d62-9b29-550809a42b5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:06.894124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a2c04-8ca0-4d62-9b29-550809a42b5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:06.895620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a2c04-8ca0-4d62-9b29-550809a42b5e service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:06.918937 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1296/2580] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:19:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:07.460943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6258fb3-ee76-41b8-9a2c-1e5ef98c0b3d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:07.461399 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6258fb3-ee76-41b8-9a2c-1e5ef98c0b3d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:07.461675 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6258fb3-ee76-41b8-9a2c-1e5ef98c0b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:07.524290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e6258fb3-ee76-41b8-9a2c-1e5ef98c0b3d None None] MFA Rules not processed for user `976b3335cbb1490b8992c2c3ff067bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:07.525556 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e6258fb3-ee76-41b8-9a2c-1e5ef98c0b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:07.639037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:07.650508 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1285/2581] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:07.666794 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a2c04-8ca0-4d62-9b29-550809a42b5e service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:07.668406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8a3a2c04-8ca0-4d62-9b29-550809a42b5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:07.677391 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:07.684764 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a2c04-8ca0-4d62-9b29-550809a42b5e service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:07.698663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32809a-cf10-4b0a-916c-21b9914a162e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:07.699695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32809a-cf10-4b0a-916c-21b9914a162e service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:07.700025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32809a-cf10-4b0a-916c-21b9914a162e service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:07.700320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32809a-cf10-4b0a-916c-21b9914a162e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:07.773985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32809a-cf10-4b0a-916c-21b9914a162e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:07.776251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32809a-cf10-4b0a-916c-21b9914a162e service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:07.788780 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1297/2582] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:19:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:08.859285 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf13c1-9bf9-44cf-9083-46159abe255a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:08.859786 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf13c1-9bf9-44cf-9083-46159abe255a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:08.859905 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf13c1-9bf9-44cf-9083-46159abe255a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:08.879264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-62bf13c1-9bf9-44cf-9083-46159abe255a None None] MFA Rules not processed for user `9778bd2585c8469399ce4b2a5db1c6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:08.880442 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-62bf13c1-9bf9-44cf-9083-46159abe255a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:08.892506 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1286/2583] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:16.136999 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fc05c-c574-43d3-a1be-72780ee7e4ff None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:16.137446 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fc05c-c574-43d3-a1be-72780ee7e4ff None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:16.137569 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fc05c-c574-43d3-a1be-72780ee7e4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:16.156372 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-209fc05c-c574-43d3-a1be-72780ee7e4ff None None] MFA Rules not processed for user `28ab60df0ab542279092f80971a74204`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:19:16.157600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-209fc05c-c574-43d3-a1be-72780ee7e4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:16.213636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1298/2584] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:19:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:19:16.520367 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf13c1-9bf9-44cf-9083-46159abe255a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:16.530790 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf13c1-9bf9-44cf-9083-46159abe255a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:16.534503 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38979b66-bd93-4d8c-bc0c-54336d1c0f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:16.535184 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979b66-bd93-4d8c-bc0c-54336d1c0f42 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:16.535470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979b66-bd93-4d8c-bc0c-54336d1c0f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:16.535752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979b66-bd93-4d8c-bc0c-54336d1c0f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:16.537834 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-38979b66-bd93-4d8c-bc0c-54336d1c0f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:16.548798 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38979b66-bd93-4d8c-bc0c-54336d1c0f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:16.550587 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38979b66-bd93-4d8c-bc0c-54336d1c0f42 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:16.558706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1287/2585] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:19:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:26.206776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=52 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:26.555007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=10 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:19:48.215541 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fc05c-c574-43d3-a1be-72780ee7e4ff None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:48.225509 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fc05c-c574-43d3-a1be-72780ee7e4ff None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:48.229086 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a7ca0-7cab-4b20-b7bf-1754ba9bc701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:48.229731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a7ca0-7cab-4b20-b7bf-1754ba9bc701 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:48.230030 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a7ca0-7cab-4b20-b7bf-1754ba9bc701 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:48.230294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a7ca0-7cab-4b20-b7bf-1754ba9bc701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:48.232852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-793a7ca0-7cab-4b20-b7bf-1754ba9bc701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:19:48.243779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a7ca0-7cab-4b20-b7bf-1754ba9bc701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:48.245381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a7ca0-7cab-4b20-b7bf-1754ba9bc701 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:48.253990 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1299/2586] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:19:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:50.865752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38979b66-bd93-4d8c-bc0c-54336d1c0f42 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:19:50.874911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38979b66-bd93-4d8c-bc0c-54336d1c0f42 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:19:50.878530 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f1302-0aa9-4e9b-944d-c6a18ede451e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:19:50.879163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f1302-0aa9-4e9b-944d-c6a18ede451e service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:19:50.879447 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f1302-0aa9-4e9b-944d-c6a18ede451e service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:19:50.879724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f1302-0aa9-4e9b-944d-c6a18ede451e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:19:50.888760 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f1302-0aa9-4e9b-944d-c6a18ede451e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:19:50.890180 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f1302-0aa9-4e9b-944d-c6a18ede451e service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:19:50.899465 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1288/2587] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:19:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:19:58.250023 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:00.895306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:13.505750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a7ca0-7cab-4b20-b7bf-1754ba9bc701 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:13.507186 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-793a7ca0-7cab-4b20-b7bf-1754ba9bc701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:13.562444 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a7ca0-7cab-4b20-b7bf-1754ba9bc701 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:13.565938 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5ee7e-b237-4a67-acca-582aea337ef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:13.566574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5ee7e-b237-4a67-acca-582aea337ef1 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:13.566863 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5ee7e-b237-4a67-acca-582aea337ef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:13.567137 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5ee7e-b237-4a67-acca-582aea337ef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:13.568909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-17b5ee7e-b237-4a67-acca-582aea337ef1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:13.646866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5ee7e-b237-4a67-acca-582aea337ef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:13.648243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5ee7e-b237-4a67-acca-582aea337ef1 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:13.667614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1300/2588] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:20:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:16.896392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f1302-0aa9-4e9b-944d-c6a18ede451e service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:16.911323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f1302-0aa9-4e9b-944d-c6a18ede451e service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:16.917085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deec90-d70c-43bb-931b-e749ebcf3d00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:16.917847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deec90-d70c-43bb-931b-e749ebcf3d00 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:16.918748 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deec90-d70c-43bb-931b-e749ebcf3d00 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:16.919293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deec90-d70c-43bb-931b-e749ebcf3d00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:16.921299 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f8deec90-d70c-43bb-931b-e749ebcf3d00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:16.934478 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8deec90-d70c-43bb-931b-e749ebcf3d00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:16.936752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8deec90-d70c-43bb-931b-e749ebcf3d00 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:16.949315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1289/2589] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:20:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:20.645296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5ee7e-b237-4a67-acca-582aea337ef1 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:20.654958 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5ee7e-b237-4a67-acca-582aea337ef1 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:20.658485 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67e074-619a-4c52-b6a0-e842ee1eabb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:20.659116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67e074-619a-4c52-b6a0-e842ee1eabb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:20.659400 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67e074-619a-4c52-b6a0-e842ee1eabb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:20.659679 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67e074-619a-4c52-b6a0-e842ee1eabb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:20.661700 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6b67e074-619a-4c52-b6a0-e842ee1eabb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:20.726241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67e074-619a-4c52-b6a0-e842ee1eabb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:20.727690 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67e074-619a-4c52-b6a0-e842ee1eabb6 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:20.737392 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1301/2590] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:23.767803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deec90-d70c-43bb-931b-e749ebcf3d00 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:23.769371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f8deec90-d70c-43bb-931b-e749ebcf3d00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:23.783453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deec90-d70c-43bb-931b-e749ebcf3d00 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:23.788469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0899e3f-c8e3-48b1-a1c0-03f1764d712b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:23.789337 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0899e3f-c8e3-48b1-a1c0-03f1764d712b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:23.789624 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0899e3f-c8e3-48b1-a1c0-03f1764d712b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:23.789903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0899e3f-c8e3-48b1-a1c0-03f1764d712b admin admin] PATH_INFO: `/v3/users/dd29391d48434f67894eb8efcec99012` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:23.791096 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0899e3f-c8e3-48b1-a1c0-03f1764d712b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd29391d48434f67894eb8efcec99012)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:23.793703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0899e3f-c8e3-48b1-a1c0-03f1764d712b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:23.838627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f0899e3f-c8e3-48b1-a1c0-03f1764d712b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd29391d48434f67894eb8efcec99012'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:23.853612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f0899e3f-c8e3-48b1-a1c0-03f1764d712b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd29391d48434f67894eb8efcec99012'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:23.862240 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f0899e3f-c8e3-48b1-a1c0-03f1764d712b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd29391d48434f67894eb8efcec99012'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:23.862921 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f0899e3f-c8e3-48b1-a1c0-03f1764d712b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd29391d48434f67894eb8efcec99012'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:23.863571 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f0899e3f-c8e3-48b1-a1c0-03f1764d712b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd29391d48434f67894eb8efcec99012'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:23.881736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1290/2591] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:20:23 2022] DELETE /identity/v3/users/dd29391d48434f67894eb8efcec99012 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:24.048661 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67e074-619a-4c52-b6a0-e842ee1eabb6 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:24.059217 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67e074-619a-4c52-b6a0-e842ee1eabb6 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:24.078050 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:24.117923 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864818ce-d0c2-468e-9edc-c553c1ad7eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:24.118720 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864818ce-d0c2-468e-9edc-c553c1ad7eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.119008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864818ce-d0c2-468e-9edc-c553c1ad7eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.119294 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864818ce-d0c2-468e-9edc-c553c1ad7eed admin admin] PATH_INFO: `/v3/projects/2c81f2396c844183bcb29107917af0c4` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.120500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864818ce-d0c2-468e-9edc-c553c1ad7eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c81f2396c844183bcb29107917af0c4)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:24.122447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864818ce-d0c2-468e-9edc-c553c1ad7eed admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:24.170471 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-864818ce-d0c2-468e-9edc-c553c1ad7eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c81f2396c844183bcb29107917af0c4', 'request_id': 'req-864818ce-d0c2-468e-9edc-c553c1ad7eed'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:24.177848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-864818ce-d0c2-468e-9edc-c553c1ad7eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c81f2396c844183bcb29107917af0c4', 'request_id': 'req-864818ce-d0c2-468e-9edc-c553c1ad7eed'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:24.184123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-864818ce-d0c2-468e-9edc-c553c1ad7eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c81f2396c844183bcb29107917af0c4', 'request_id': 'req-864818ce-d0c2-468e-9edc-c553c1ad7eed'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:24.194138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-864818ce-d0c2-468e-9edc-c553c1ad7eed admin admin] The token cache is being invalidate because project 2c81f2396c844183bcb29107917af0c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:20:24.194425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-864818ce-d0c2-468e-9edc-c553c1ad7eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:24.195034 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-864818ce-d0c2-468e-9edc-c553c1ad7eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:20:24.196651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1302/2592] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:20:24 2022] DELETE /identity/v3/projects/2c81f2396c844183bcb29107917af0c4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:24.202135 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f8bc6-b772-4432-9975-aeb98877299b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.202432 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f8bc6-b772-4432-9975-aeb98877299b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.202734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f8bc6-b772-4432-9975-aeb98877299b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.222182 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e45f8bc6-b772-4432-9975-aeb98877299b None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:24.223369 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e45f8bc6-b772-4432-9975-aeb98877299b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:24.285809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1291/2593] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:24.294179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e6c1-6844-44b1-9559-fbd861a1cae7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.294477 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e6c1-6844-44b1-9559-fbd861a1cae7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.294765 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e6c1-6844-44b1-9559-fbd861a1cae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.314456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f350e6c1-6844-44b1-9559-fbd861a1cae7 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:24.315670 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f350e6c1-6844-44b1-9559-fbd861a1cae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:24.324576 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1303/2594] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:24.328632 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f8bc6-b772-4432-9975-aeb98877299b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:24.338150 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f8bc6-b772-4432-9975-aeb98877299b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:24.343405 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bc591-639c-460c-9832-f32311cfb5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:24.344162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bc591-639c-460c-9832-f32311cfb5da admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.344374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bc591-639c-460c-9832-f32311cfb5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.344655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bc591-639c-460c-9832-f32311cfb5da admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.345389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bc591-639c-460c-9832-f32311cfb5da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:20:24.345698 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bc591-639c-460c-9832-f32311cfb5da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:24.347301 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bc591-639c-460c-9832-f32311cfb5da admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:24.358895 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1292/2595] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:20:24.363565 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350e6c1-6844-44b1-9559-fbd861a1cae7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:24.373179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350e6c1-6844-44b1-9559-fbd861a1cae7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:24.377913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ef99d-377a-4894-add6-35e651311e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:24.378561 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ef99d-377a-4894-add6-35e651311e40 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.378842 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ef99d-377a-4894-add6-35e651311e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.379115 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ef99d-377a-4894-add6-35e651311e40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.379837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ef99d-377a-4894-add6-35e651311e40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:24.381895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ef99d-377a-4894-add6-35e651311e40 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:24.409463 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1304/2596] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:20:24 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:24.413888 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bc591-639c-460c-9832-f32311cfb5da admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:24.423781 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bc591-639c-460c-9832-f32311cfb5da admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:24.467107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:24.481070 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7117a-51b3-4d77-9b80-0e604f125331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:24.481743 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7117a-51b3-4d77-9b80-0e604f125331 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.482029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7117a-51b3-4d77-9b80-0e604f125331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.482305 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7117a-51b3-4d77-9b80-0e604f125331 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.483010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7117a-51b3-4d77-9b80-0e604f125331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:24.484982 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7117a-51b3-4d77-9b80-0e604f125331 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:24.504302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1293/2597] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:20:24 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:20:24.508355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ef99d-377a-4894-add6-35e651311e40 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:24.519215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ef99d-377a-4894-add6-35e651311e40 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:24.523775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fb548-c979-4bfb-9fe3-712d53855a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:24.524453 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb548-c979-4bfb-9fe3-712d53855a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.524736 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb548-c979-4bfb-9fe3-712d53855a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.525009 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb548-c979-4bfb-9fe3-712d53855a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.525726 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fb548-c979-4bfb-9fe3-712d53855a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:24.527295 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fb548-c979-4bfb-9fe3-712d53855a7c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:24.537835 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1305/2598] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:24.541729 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7117a-51b3-4d77-9b80-0e604f125331 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:24.551830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7117a-51b3-4d77-9b80-0e604f125331 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:24.556462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ebb69-0729-4f8f-a18b-f7af3b1cd98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:24.557107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ebb69-0729-4f8f-a18b-f7af3b1cd98f admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.557393 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ebb69-0729-4f8f-a18b-f7af3b1cd98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.557678 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ebb69-0729-4f8f-a18b-f7af3b1cd98f admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.558939 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ebb69-0729-4f8f-a18b-f7af3b1cd98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:24.560567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ebb69-0729-4f8f-a18b-f7af3b1cd98f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:24.570308 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1294/2599] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:20:24.574870 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fb548-c979-4bfb-9fe3-712d53855a7c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:24.584651 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fb548-c979-4bfb-9fe3-712d53855a7c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:24.589246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34377712-9010-48df-a58a-aec4b2e14f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:24.590115 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34377712-9010-48df-a58a-aec4b2e14f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.590402 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34377712-9010-48df-a58a-aec4b2e14f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.590677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34377712-9010-48df-a58a-aec4b2e14f47 admin admin] PATH_INFO: `/v3/projects/e168e4c51b294ece9801b8aab0699afe/users/66a9a7d0456a45049b29216b3d0f89c7/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.604797 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34377712-9010-48df-a58a-aec4b2e14f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e168e4c51b294ece9801b8aab0699afe, user_id=66a9a7d0456a45049b29216b3d0f89c7, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:24.607504 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34377712-9010-48df-a58a-aec4b2e14f47 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:24.620657 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1306/2600] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:20:24 2022] PUT /identity/v3/projects/e168e4c51b294ece9801b8aab0699afe/users/66a9a7d0456a45049b29216b3d0f89c7/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:20:24.626346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0a03e-0b67-411a-9240-c94ad8e6086f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.626586 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0a03e-0b67-411a-9240-c94ad8e6086f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.626866 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0a03e-0b67-411a-9240-c94ad8e6086f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.644631 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a7c0a03e-0b67-411a-9240-c94ad8e6086f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:24.645847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a7c0a03e-0b67-411a-9240-c94ad8e6086f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:24.703310 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1295/2601] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:24.712851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34377712-9010-48df-a58a-aec4b2e14f47 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:24.714563 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-34377712-9010-48df-a58a-aec4b2e14f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:24.766504 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:24.772903 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34377712-9010-48df-a58a-aec4b2e14f47 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:24.777553 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f77e3b-79b3-4959-8eb3-82a3a8b8a411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:24.778200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f77e3b-79b3-4959-8eb3-82a3a8b8a411 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:24.778488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f77e3b-79b3-4959-8eb3-82a3a8b8a411 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:24.778769 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f77e3b-79b3-4959-8eb3-82a3a8b8a411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:24.788007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f77e3b-79b3-4959-8eb3-82a3a8b8a411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:24.789436 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f77e3b-79b3-4959-8eb3-82a3a8b8a411 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:24.799249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1307/2602] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:28.712677 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c69ab5-412a-45e6-9f93-134f6f868e3e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:28.713260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c69ab5-412a-45e6-9f93-134f6f868e3e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:28.713260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c69ab5-412a-45e6-9f93-134f6f868e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:28.747447 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-81c69ab5-412a-45e6-9f93-134f6f868e3e None None] MFA Rules not processed for user `66a9a7d0456a45049b29216b3d0f89c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:28.748994 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-81c69ab5-412a-45e6-9f93-134f6f868e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:28.818482 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1296/2603] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:20:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:28.832897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f77e3b-79b3-4959-8eb3-82a3a8b8a411 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:28.834474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-24f77e3b-79b3-4959-8eb3-82a3a8b8a411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:28.912065 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f77e3b-79b3-4959-8eb3-82a3a8b8a411 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:28.918422 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774af8b8-ab13-4eab-ac9e-855ee7644770 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:28.919094 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774af8b8-ab13-4eab-ac9e-855ee7644770 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:28.919377 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774af8b8-ab13-4eab-ac9e-855ee7644770 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:28.919656 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774af8b8-ab13-4eab-ac9e-855ee7644770 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:28.928572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774af8b8-ab13-4eab-ac9e-855ee7644770 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:28.930087 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774af8b8-ab13-4eab-ac9e-855ee7644770 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:28.940054 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1308/2604] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:20:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:30.246477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebdbba-4b53-4a86-814d-215cca7abea6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:30.247052 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebdbba-4b53-4a86-814d-215cca7abea6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:30.247052 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebdbba-4b53-4a86-814d-215cca7abea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:30.268109 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-91ebdbba-4b53-4a86-814d-215cca7abea6 None None] MFA Rules not processed for user `66a9a7d0456a45049b29216b3d0f89c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:20:30.269233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-91ebdbba-4b53-4a86-814d-215cca7abea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:30.276874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1297/2605] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:20:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:20:30.927859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774af8b8-ab13-4eab-ac9e-855ee7644770 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:30.929441 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-774af8b8-ab13-4eab-ac9e-855ee7644770 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:31.017714 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774af8b8-ab13-4eab-ac9e-855ee7644770 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:31.023757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b8a20-c639-4859-b18e-27ff057291ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cccb366fc6429e9a30d4f9de64e8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:31.024485 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b8a20-c639-4859-b18e-27ff057291ab service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:31.024820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b8a20-c639-4859-b18e-27ff057291ab service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:31.025104 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b8a20-c639-4859-b18e-27ff057291ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:31.027177 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a38b8a20-c639-4859-b18e-27ff057291ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:31.040171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b8a20-c639-4859-b18e-27ff057291ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:31.041897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b8a20-c639-4859-b18e-27ff057291ab service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:31.052898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1309/2606] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:20:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:40.212440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebdbba-4b53-4a86-814d-215cca7abea6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:40.213907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-91ebdbba-4b53-4a86-814d-215cca7abea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:40.230575 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebdbba-4b53-4a86-814d-215cca7abea6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:40.236162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296283de-cc17-4546-a602-1b85522c7b6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:40.236849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296283de-cc17-4546-a602-1b85522c7b6a service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:40.237132 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296283de-cc17-4546-a602-1b85522c7b6a service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:40.237412 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296283de-cc17-4546-a602-1b85522c7b6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:40.239303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-296283de-cc17-4546-a602-1b85522c7b6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:40.253251 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296283de-cc17-4546-a602-1b85522c7b6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:40.254839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296283de-cc17-4546-a602-1b85522c7b6a service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:40.266171 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1298/2607] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:20:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:41.048313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=71 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:43.768697 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b8a20-c639-4859-b18e-27ff057291ab service placement] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:20:43.781805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b8a20-c639-4859-b18e-27ff057291ab service placement] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:20:43.787571 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e9424-ae02-48c5-ad6b-f92fa5789942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:20:43.788251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e9424-ae02-48c5-ad6b-f92fa5789942 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:20:43.788542 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e9424-ae02-48c5-ad6b-f92fa5789942 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:20:43.788825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e9424-ae02-48c5-ad6b-f92fa5789942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:20:43.790596 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-486e9424-ae02-48c5-ad6b-f92fa5789942 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:20:43.803116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e9424-ae02-48c5-ad6b-f92fa5789942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:20:43.804838 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e9424-ae02-48c5-ad6b-f92fa5789942 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:20:43.816061 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1310/2608] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:20:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:20:50.261644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:20:53.811404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:14.784349 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296283de-cc17-4546-a602-1b85522c7b6a service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:14.786121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-296283de-cc17-4546-a602-1b85522c7b6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:14.845966 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296283de-cc17-4546-a602-1b85522c7b6a service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:14.849559 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a38ad-2a61-4122-8c70-3ecdca7bbff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:14.850199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a38ad-2a61-4122-8c70-3ecdca7bbff3 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:14.850487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a38ad-2a61-4122-8c70-3ecdca7bbff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:14.850770 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a38ad-2a61-4122-8c70-3ecdca7bbff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:14.852567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-924a38ad-2a61-4122-8c70-3ecdca7bbff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:14.904691 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a38ad-2a61-4122-8c70-3ecdca7bbff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:14.906108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a38ad-2a61-4122-8c70-3ecdca7bbff3 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:14.924973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1299/2609] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:21:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:18.413985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e9424-ae02-48c5-ad6b-f92fa5789942 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:18.416242 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-486e9424-ae02-48c5-ad6b-f92fa5789942 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:18.474942 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e9424-ae02-48c5-ad6b-f92fa5789942 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:18.480183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae691032-598f-4d66-9601-55d21eea9319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:18.481055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae691032-598f-4d66-9601-55d21eea9319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:18.481348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae691032-598f-4d66-9601-55d21eea9319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:18.481628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae691032-598f-4d66-9601-55d21eea9319 admin admin] PATH_INFO: `/v3/users/28ab60df0ab542279092f80971a74204` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:18.495074 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae691032-598f-4d66-9601-55d21eea9319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ab60df0ab542279092f80971a74204)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:18.497053 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae691032-598f-4d66-9601-55d21eea9319 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:18.543716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ae691032-598f-4d66-9601-55d21eea9319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ab60df0ab542279092f80971a74204'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:18.544403 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ae691032-598f-4d66-9601-55d21eea9319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ab60df0ab542279092f80971a74204'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:18.551562 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ae691032-598f-4d66-9601-55d21eea9319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ab60df0ab542279092f80971a74204'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:18.558905 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ae691032-598f-4d66-9601-55d21eea9319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ab60df0ab542279092f80971a74204'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:18.570628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ae691032-598f-4d66-9601-55d21eea9319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ab60df0ab542279092f80971a74204'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:18.577124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1311/2610] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:21:18 2022] DELETE /identity/v3/users/28ab60df0ab542279092f80971a74204 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:18.751556 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a38ad-2a61-4122-8c70-3ecdca7bbff3 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:18.762298 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a38ad-2a61-4122-8c70-3ecdca7bbff3 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:18.818444 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd6f02-f415-476a-aee2-81fe80e95a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:18.819309 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd6f02-f415-476a-aee2-81fe80e95a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:18.819596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd6f02-f415-476a-aee2-81fe80e95a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:18.819875 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd6f02-f415-476a-aee2-81fe80e95a76 admin admin] PATH_INFO: `/v3/projects/072c0221130e445f974fdcbf289c79d8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:18.830148 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd6f02-f415-476a-aee2-81fe80e95a76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=072c0221130e445f974fdcbf289c79d8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:18.832105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd6f02-f415-476a-aee2-81fe80e95a76 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:18.874925 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:18.878707 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4cbd6f02-f415-476a-aee2-81fe80e95a76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '072c0221130e445f974fdcbf289c79d8', 'request_id': 'req-4cbd6f02-f415-476a-aee2-81fe80e95a76'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:18.884374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4cbd6f02-f415-476a-aee2-81fe80e95a76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '072c0221130e445f974fdcbf289c79d8', 'request_id': 'req-4cbd6f02-f415-476a-aee2-81fe80e95a76'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:18.891833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4cbd6f02-f415-476a-aee2-81fe80e95a76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '072c0221130e445f974fdcbf289c79d8', 'request_id': 'req-4cbd6f02-f415-476a-aee2-81fe80e95a76'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:18.903280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4cbd6f02-f415-476a-aee2-81fe80e95a76 admin admin] The token cache is being invalidate because project 072c0221130e445f974fdcbf289c79d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:18.903568 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4cbd6f02-f415-476a-aee2-81fe80e95a76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:18.904221 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4cbd6f02-f415-476a-aee2-81fe80e95a76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:18.905766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1300/2611] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:21:18 2022] DELETE /identity/v3/projects/072c0221130e445f974fdcbf289c79d8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:18.911022 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925eacf-2fe0-4d7d-9c1e-dd9dab3029f4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:18.911336 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925eacf-2fe0-4d7d-9c1e-dd9dab3029f4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:18.911605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925eacf-2fe0-4d7d-9c1e-dd9dab3029f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:18.967170 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2925eacf-2fe0-4d7d-9c1e-dd9dab3029f4 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:18.968337 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2925eacf-2fe0-4d7d-9c1e-dd9dab3029f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:19.017780 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:19.029357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1312/2612] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:19.037424 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3a94d-0920-4034-b470-af60b3b93e76 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:19.037738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3a94d-0920-4034-b470-af60b3b93e76 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:19.038016 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3a94d-0920-4034-b470-af60b3b93e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:19.055463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c8a3a94d-0920-4034-b470-af60b3b93e76 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:19.056701 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c8a3a94d-0920-4034-b470-af60b3b93e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:19.064501 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1301/2613] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:19.068599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925eacf-2fe0-4d7d-9c1e-dd9dab3029f4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:19.078816 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925eacf-2fe0-4d7d-9c1e-dd9dab3029f4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:19.083424 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1316e8b-ba1a-47c6-8f12-4959b4e5135a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:19.084127 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1316e8b-ba1a-47c6-8f12-4959b4e5135a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:19.084415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1316e8b-ba1a-47c6-8f12-4959b4e5135a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:19.084696 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1316e8b-ba1a-47c6-8f12-4959b4e5135a admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:19.085432 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1316e8b-ba1a-47c6-8f12-4959b4e5135a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:21:19.085744 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1316e8b-ba1a-47c6-8f12-4959b4e5135a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:19.087360 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1316e8b-ba1a-47c6-8f12-4959b4e5135a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:19.098859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1313/2614] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:21:19.102765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3a94d-0920-4034-b470-af60b3b93e76 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:19.112321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3a94d-0920-4034-b470-af60b3b93e76 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:19.116899 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd438c-8704-4beb-ad88-3c0e9150b6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:19.117537 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd438c-8704-4beb-ad88-3c0e9150b6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:19.117823 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd438c-8704-4beb-ad88-3c0e9150b6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:19.118103 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd438c-8704-4beb-ad88-3c0e9150b6d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:19.118788 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd438c-8704-4beb-ad88-3c0e9150b6d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:19.121279 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd438c-8704-4beb-ad88-3c0e9150b6d2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:19.146627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1302/2615] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:21:19 2022] POST /identity/v3/projects => generated 355 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:19.151007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1316e8b-ba1a-47c6-8f12-4959b4e5135a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:19.161199 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1316e8b-ba1a-47c6-8f12-4959b4e5135a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:19.215420 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69495b1d-fbf1-4ab7-bc9f-4be94c1e632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:19.216118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69495b1d-fbf1-4ab7-bc9f-4be94c1e632f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:19.216405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69495b1d-fbf1-4ab7-bc9f-4be94c1e632f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:19.216694 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69495b1d-fbf1-4ab7-bc9f-4be94c1e632f admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:19.217382 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69495b1d-fbf1-4ab7-bc9f-4be94c1e632f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:19.219303 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69495b1d-fbf1-4ab7-bc9f-4be94c1e632f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:19.238848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1314/2616] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:21:19 2022] POST /identity/v3/users => generated 278 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:19.243028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd438c-8704-4beb-ad88-3c0e9150b6d2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:19.253139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd438c-8704-4beb-ad88-3c0e9150b6d2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:19.257662 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52089836-fee7-407d-8889-59e43141c62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:19.258307 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52089836-fee7-407d-8889-59e43141c62f admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:19.258652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52089836-fee7-407d-8889-59e43141c62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:19.258850 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52089836-fee7-407d-8889-59e43141c62f admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:19.259567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52089836-fee7-407d-8889-59e43141c62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:19.261182 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52089836-fee7-407d-8889-59e43141c62f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:19.270905 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1303/2617] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:19.274683 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69495b1d-fbf1-4ab7-bc9f-4be94c1e632f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:19.284933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69495b1d-fbf1-4ab7-bc9f-4be94c1e632f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:19.289833 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438dcb8-27cd-4ed3-88d3-b2638f190eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:19.290486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438dcb8-27cd-4ed3-88d3-b2638f190eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:19.290777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438dcb8-27cd-4ed3-88d3-b2638f190eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:19.291624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438dcb8-27cd-4ed3-88d3-b2638f190eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:19.292389 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438dcb8-27cd-4ed3-88d3-b2638f190eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:19.293998 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438dcb8-27cd-4ed3-88d3-b2638f190eb5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:19.305791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1315/2618] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:19.309878 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52089836-fee7-407d-8889-59e43141c62f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:19.319844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52089836-fee7-407d-8889-59e43141c62f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:19.324481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73226526-5ff5-4113-b5cf-dd3eaeb468da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:19.325357 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73226526-5ff5-4113-b5cf-dd3eaeb468da admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:19.325639 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73226526-5ff5-4113-b5cf-dd3eaeb468da admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:19.325916 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73226526-5ff5-4113-b5cf-dd3eaeb468da admin admin] PATH_INFO: `/v3/projects/c92929eed717467c8a307924781fdb2b/users/82507701b37b49149316dcae096a99bb/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:19.340631 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73226526-5ff5-4113-b5cf-dd3eaeb468da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c92929eed717467c8a307924781fdb2b, user_id=82507701b37b49149316dcae096a99bb, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:19.343280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73226526-5ff5-4113-b5cf-dd3eaeb468da admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:19.355957 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1304/2619] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:21:19 2022] PUT /identity/v3/projects/c92929eed717467c8a307924781fdb2b/users/82507701b37b49149316dcae096a99bb/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:19.366722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69c597-4c4d-4773-ba35-12c5ea07579b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:19.367075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69c597-4c4d-4773-ba35-12c5ea07579b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:19.367365 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69c597-4c4d-4773-ba35-12c5ea07579b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:19.395689 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9f69c597-4c4d-4773-ba35-12c5ea07579b None None] MFA Rules not processed for user `82507701b37b49149316dcae096a99bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:19.397093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9f69c597-4c4d-4773-ba35-12c5ea07579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:19.459869 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1316/2620] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:19 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:19.464307 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73226526-5ff5-4113-b5cf-dd3eaeb468da admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:19.525157 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73226526-5ff5-4113-b5cf-dd3eaeb468da admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:19.534579 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d69496-66a1-430b-8d7c-c891407c027d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:19.535235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d69496-66a1-430b-8d7c-c891407c027d admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:19.536002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d69496-66a1-430b-8d7c-c891407c027d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:19.536280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d69496-66a1-430b-8d7c-c891407c027d admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:19.536970 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d69496-66a1-430b-8d7c-c891407c027d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:19.539079 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d69496-66a1-430b-8d7c-c891407c027d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:19.565379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1305/2621] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:21:19 2022] POST /identity/v3/projects => generated 353 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:19.569410 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69c597-4c4d-4773-ba35-12c5ea07579b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:19.580110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69c597-4c4d-4773-ba35-12c5ea07579b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:19.628099 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:19.638228 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df50895-b4d2-4c48-9b59-2815b08251c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:19.638903 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df50895-b4d2-4c48-9b59-2815b08251c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:19.639192 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df50895-b4d2-4c48-9b59-2815b08251c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:19.639474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df50895-b4d2-4c48-9b59-2815b08251c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:19.640199 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df50895-b4d2-4c48-9b59-2815b08251c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:19.642116 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df50895-b4d2-4c48-9b59-2815b08251c2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:19.661590 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1317/2622] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:21:19 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:19.665577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d69496-66a1-430b-8d7c-c891407c027d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:19.676787 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d69496-66a1-430b-8d7c-c891407c027d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:19.681892 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959762bc-ed2c-4454-b676-2b3e8dc99b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:19.682534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959762bc-ed2c-4454-b676-2b3e8dc99b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:19.682936 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959762bc-ed2c-4454-b676-2b3e8dc99b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:19.683264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959762bc-ed2c-4454-b676-2b3e8dc99b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:19.684101 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959762bc-ed2c-4454-b676-2b3e8dc99b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:19.685849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959762bc-ed2c-4454-b676-2b3e8dc99b2b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:19.696854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1306/2623] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:19.701302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df50895-b4d2-4c48-9b59-2815b08251c2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:19.711326 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df50895-b4d2-4c48-9b59-2815b08251c2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:19.716577 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd10b3-e169-4eba-8ddc-9e66067b6b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:19.717577 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd10b3-e169-4eba-8ddc-9e66067b6b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:19.717935 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd10b3-e169-4eba-8ddc-9e66067b6b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:19.718219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd10b3-e169-4eba-8ddc-9e66067b6b97 admin admin] PATH_INFO: `/v3/projects/402686e5d8a64298a99e3ad5c9af84c1/users/d57cfd81cc7c422e9e6f01a8923390cd/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:19.732882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd10b3-e169-4eba-8ddc-9e66067b6b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=402686e5d8a64298a99e3ad5c9af84c1, user_id=d57cfd81cc7c422e9e6f01a8923390cd, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:19.735538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd10b3-e169-4eba-8ddc-9e66067b6b97 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:19.748019 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1318/2624] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:21:19 2022] PUT /identity/v3/projects/402686e5d8a64298a99e3ad5c9af84c1/users/d57cfd81cc7c422e9e6f01a8923390cd/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:19.751885 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959762bc-ed2c-4454-b676-2b3e8dc99b2b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:19.762386 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959762bc-ed2c-4454-b676-2b3e8dc99b2b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:19.801611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:19.819426 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40ba11-f31f-446d-9f14-4ab7a140c306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:19.820130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40ba11-f31f-446d-9f14-4ab7a140c306 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:19.820414 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40ba11-f31f-446d-9f14-4ab7a140c306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:19.820688 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40ba11-f31f-446d-9f14-4ab7a140c306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:19.821410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40ba11-f31f-446d-9f14-4ab7a140c306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:19.823531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40ba11-f31f-446d-9f14-4ab7a140c306 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:19.832959 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1307/2625] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:19.836992 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd10b3-e169-4eba-8ddc-9e66067b6b97 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:19.847205 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd10b3-e169-4eba-8ddc-9e66067b6b97 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:19.851772 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3e10d-2a1a-4498-a31c-ab517086413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:19.852724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3e10d-2a1a-4498-a31c-ab517086413e admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:19.853007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3e10d-2a1a-4498-a31c-ab517086413e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:19.853772 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3e10d-2a1a-4498-a31c-ab517086413e admin admin] PATH_INFO: `/v3/projects/402686e5d8a64298a99e3ad5c9af84c1/users/d57cfd81cc7c422e9e6f01a8923390cd/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:19.855722 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3e10d-2a1a-4498-a31c-ab517086413e admin admin] RBAC: Authorizing `identity:create_grant(project_id=402686e5d8a64298a99e3ad5c9af84c1, user_id=d57cfd81cc7c422e9e6f01a8923390cd, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:19.858424 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3e10d-2a1a-4498-a31c-ab517086413e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:19.868316 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1319/2626] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:21:19 2022] PUT /identity/v3/projects/402686e5d8a64298a99e3ad5c9af84c1/users/d57cfd81cc7c422e9e6f01a8923390cd/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:19.878486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c44b10-2f81-43e3-8362-f2d119b8bf5d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:19.878779 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c44b10-2f81-43e3-8362-f2d119b8bf5d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:19.879060 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c44b10-2f81-43e3-8362-f2d119b8bf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:19.905021 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b0c44b10-2f81-43e3-8362-f2d119b8bf5d None None] MFA Rules not processed for user `d57cfd81cc7c422e9e6f01a8923390cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:19.906241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b0c44b10-2f81-43e3-8362-f2d119b8bf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:19.980540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1308/2627] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:19 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:19.991621 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3e10d-2a1a-4498-a31c-ab517086413e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:19.993487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-94b3e10d-2a1a-4498-a31c-ab517086413e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:20.049169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3e10d-2a1a-4498-a31c-ab517086413e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:20.052750 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243dc48-35d1-4979-ba9f-3e9ef6247844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:20.053380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243dc48-35d1-4979-ba9f-3e9ef6247844 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:20.053663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243dc48-35d1-4979-ba9f-3e9ef6247844 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:20.053937 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243dc48-35d1-4979-ba9f-3e9ef6247844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:20.063078 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243dc48-35d1-4979-ba9f-3e9ef6247844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:20.064682 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243dc48-35d1-4979-ba9f-3e9ef6247844 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:20.074480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1320/2628] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:21:19 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:20.147529 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c44b10-2f81-43e3-8362-f2d119b8bf5d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:20.157582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c44b10-2f81-43e3-8362-f2d119b8bf5d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:20.161454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1bb17-9f2a-4837-83ad-becc2384a279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:20.162087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1bb17-9f2a-4837-83ad-becc2384a279 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:20.162374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1bb17-9f2a-4837-83ad-becc2384a279 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:20.162652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1bb17-9f2a-4837-83ad-becc2384a279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:20.219462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1bb17-9f2a-4837-83ad-becc2384a279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:20.221051 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1bb17-9f2a-4837-83ad-becc2384a279 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:20.231445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1309/2629] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:21:20 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:30.070282 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=46,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:30.226121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=72 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:34.869956 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243dc48-35d1-4979-ba9f-3e9ef6247844 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:34.932061 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243dc48-35d1-4979-ba9f-3e9ef6247844 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:34.936693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a3e12-96af-4936-bf17-76a986e54e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:34.937602 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a3e12-96af-4936-bf17-76a986e54e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:34.937895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a3e12-96af-4936-bf17-76a986e54e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:34.938176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a3e12-96af-4936-bf17-76a986e54e20 admin admin] PATH_INFO: `/v3/users/82507701b37b49149316dcae096a99bb` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:34.939367 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a3e12-96af-4936-bf17-76a986e54e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82507701b37b49149316dcae096a99bb)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:34.941313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a3e12-96af-4936-bf17-76a986e54e20 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:34.986301 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-752a3e12-96af-4936-bf17-76a986e54e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82507701b37b49149316dcae096a99bb'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:34.986956 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-752a3e12-96af-4936-bf17-76a986e54e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82507701b37b49149316dcae096a99bb'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:34.994544 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-752a3e12-96af-4936-bf17-76a986e54e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82507701b37b49149316dcae096a99bb'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:35.001769 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-752a3e12-96af-4936-bf17-76a986e54e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82507701b37b49149316dcae096a99bb'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:35.014250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-752a3e12-96af-4936-bf17-76a986e54e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82507701b37b49149316dcae096a99bb'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:35.020274 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1321/2630] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:21:34 2022] DELETE /identity/v3/users/82507701b37b49149316dcae096a99bb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:35.024904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ba5e-05fa-4d15-8438-00730fb14859 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:35.025410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ba5e-05fa-4d15-8438-00730fb14859 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:35.025521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ba5e-05fa-4d15-8438-00730fb14859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:35.042546 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1fa1ba5e-05fa-4d15-8438-00730fb14859 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:35.043750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1fa1ba5e-05fa-4d15-8438-00730fb14859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:35.107209 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1310/2631] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:35.116746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a3e12-96af-4936-bf17-76a986e54e20 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:35.118155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-752a3e12-96af-4936-bf17-76a986e54e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:35.175411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a3e12-96af-4936-bf17-76a986e54e20 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:35.179095 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cc6df-8912-4670-b9fe-402bd4fb5762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:35.179749 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cc6df-8912-4670-b9fe-402bd4fb5762 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:35.180069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cc6df-8912-4670-b9fe-402bd4fb5762 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:35.180356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cc6df-8912-4670-b9fe-402bd4fb5762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:35.190250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cc6df-8912-4670-b9fe-402bd4fb5762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:35.191622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cc6df-8912-4670-b9fe-402bd4fb5762 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:35.201553 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1322/2632] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:35.720079 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ba5e-05fa-4d15-8438-00730fb14859 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:35.721622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1fa1ba5e-05fa-4d15-8438-00730fb14859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:35.734245 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ba5e-05fa-4d15-8438-00730fb14859 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:35.738919 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73747374-d2d6-481d-951e-0e1b8de92e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:35.741053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73747374-d2d6-481d-951e-0e1b8de92e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:35.741348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73747374-d2d6-481d-951e-0e1b8de92e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:35.741629 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73747374-d2d6-481d-951e-0e1b8de92e80 admin admin] PATH_INFO: `/v3/projects/c92929eed717467c8a307924781fdb2b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:35.743322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73747374-d2d6-481d-951e-0e1b8de92e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c92929eed717467c8a307924781fdb2b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:35.746509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73747374-d2d6-481d-951e-0e1b8de92e80 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:35.795605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73747374-d2d6-481d-951e-0e1b8de92e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c92929eed717467c8a307924781fdb2b', 'request_id': 'req-73747374-d2d6-481d-951e-0e1b8de92e80'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:35.801135 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73747374-d2d6-481d-951e-0e1b8de92e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c92929eed717467c8a307924781fdb2b', 'request_id': 'req-73747374-d2d6-481d-951e-0e1b8de92e80'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:35.809731 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73747374-d2d6-481d-951e-0e1b8de92e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c92929eed717467c8a307924781fdb2b', 'request_id': 'req-73747374-d2d6-481d-951e-0e1b8de92e80'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:35.820875 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73747374-d2d6-481d-951e-0e1b8de92e80 admin admin] The token cache is being invalidate because project c92929eed717467c8a307924781fdb2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:35.821170 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73747374-d2d6-481d-951e-0e1b8de92e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:35.821840 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73747374-d2d6-481d-951e-0e1b8de92e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:35.823734 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1311/2633] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:21:35 2022] DELETE /identity/v3/projects/c92929eed717467c8a307924781fdb2b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:35.828137 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cc6df-8912-4670-b9fe-402bd4fb5762 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:35.838706 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cc6df-8912-4670-b9fe-402bd4fb5762 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:35.857622 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:35.901213 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d21db-36bf-4f15-a02c-5a3938f5500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:35.902102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d21db-36bf-4f15-a02c-5a3938f5500c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:35.902387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d21db-36bf-4f15-a02c-5a3938f5500c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:35.902667 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d21db-36bf-4f15-a02c-5a3938f5500c admin admin] PATH_INFO: `/v3/users/d57cfd81cc7c422e9e6f01a8923390cd` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:35.903861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d21db-36bf-4f15-a02c-5a3938f5500c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57cfd81cc7c422e9e6f01a8923390cd)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:35.905826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d21db-36bf-4f15-a02c-5a3938f5500c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:35.950575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9d9d21db-36bf-4f15-a02c-5a3938f5500c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57cfd81cc7c422e9e6f01a8923390cd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:35.951135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9d9d21db-36bf-4f15-a02c-5a3938f5500c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57cfd81cc7c422e9e6f01a8923390cd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:35.957624 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9d9d21db-36bf-4f15-a02c-5a3938f5500c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57cfd81cc7c422e9e6f01a8923390cd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:35.965500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9d9d21db-36bf-4f15-a02c-5a3938f5500c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57cfd81cc7c422e9e6f01a8923390cd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:35.977646 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9d9d21db-36bf-4f15-a02c-5a3938f5500c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57cfd81cc7c422e9e6f01a8923390cd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:35.984052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1323/2634] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:21:35 2022] DELETE /identity/v3/users/d57cfd81cc7c422e9e6f01a8923390cd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:36.244192 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73747374-d2d6-481d-951e-0e1b8de92e80 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:36.245745 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-73747374-d2d6-481d-951e-0e1b8de92e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:36.265247 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73747374-d2d6-481d-951e-0e1b8de92e80 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:36.324833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a658b-79b5-4398-bc30-2f5611551eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:36.325702 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a658b-79b5-4398-bc30-2f5611551eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:36.325989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a658b-79b5-4398-bc30-2f5611551eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:36.326273 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a658b-79b5-4398-bc30-2f5611551eb7 admin admin] PATH_INFO: `/v3/projects/402686e5d8a64298a99e3ad5c9af84c1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:36.327455 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a658b-79b5-4398-bc30-2f5611551eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=402686e5d8a64298a99e3ad5c9af84c1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:36.329597 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a658b-79b5-4398-bc30-2f5611551eb7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:36.360004 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:36.377754 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8e7a658b-79b5-4398-bc30-2f5611551eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '402686e5d8a64298a99e3ad5c9af84c1', 'request_id': 'req-8e7a658b-79b5-4398-bc30-2f5611551eb7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:36.383051 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8e7a658b-79b5-4398-bc30-2f5611551eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '402686e5d8a64298a99e3ad5c9af84c1', 'request_id': 'req-8e7a658b-79b5-4398-bc30-2f5611551eb7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:36.391522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8e7a658b-79b5-4398-bc30-2f5611551eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '402686e5d8a64298a99e3ad5c9af84c1', 'request_id': 'req-8e7a658b-79b5-4398-bc30-2f5611551eb7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:36.403045 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8e7a658b-79b5-4398-bc30-2f5611551eb7 admin admin] The token cache is being invalidate because project 402686e5d8a64298a99e3ad5c9af84c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:36.403353 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8e7a658b-79b5-4398-bc30-2f5611551eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:36.403985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8e7a658b-79b5-4398-bc30-2f5611551eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:36.405539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1312/2635] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:21:36 2022] DELETE /identity/v3/projects/402686e5d8a64298a99e3ad5c9af84c1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:36.410357 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78293554-3440-4bbb-9c15-1e9a54edb712 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:36.410911 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78293554-3440-4bbb-9c15-1e9a54edb712 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:36.411193 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78293554-3440-4bbb-9c15-1e9a54edb712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:36.428636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-78293554-3440-4bbb-9c15-1e9a54edb712 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:36.429820 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-78293554-3440-4bbb-9c15-1e9a54edb712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:36.487632 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1324/2636] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:36.495823 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eb3ee-365c-480d-9a2a-88069f1f415e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:36.496210 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eb3ee-365c-480d-9a2a-88069f1f415e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:36.496526 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eb3ee-365c-480d-9a2a-88069f1f415e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:36.514976 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ed7eb3ee-365c-480d-9a2a-88069f1f415e None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:36.516220 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ed7eb3ee-365c-480d-9a2a-88069f1f415e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:36.524335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1313/2637] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:36.528768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78293554-3440-4bbb-9c15-1e9a54edb712 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:36.538611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78293554-3440-4bbb-9c15-1e9a54edb712 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:36.543117 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed34a7-8d66-464e-b3ae-15360b92a463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:36.543770 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed34a7-8d66-464e-b3ae-15360b92a463 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:36.544090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed34a7-8d66-464e-b3ae-15360b92a463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:36.544369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed34a7-8d66-464e-b3ae-15360b92a463 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:36.545094 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed34a7-8d66-464e-b3ae-15360b92a463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:21:36.545402 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed34a7-8d66-464e-b3ae-15360b92a463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:36.546999 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed34a7-8d66-464e-b3ae-15360b92a463 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:36.558983 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1325/2638] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:21:36.563142 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7eb3ee-365c-480d-9a2a-88069f1f415e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:36.572994 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7eb3ee-365c-480d-9a2a-88069f1f415e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:36.577813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3419b-a6ee-4fa6-a53f-6c381a43e943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:36.578470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3419b-a6ee-4fa6-a53f-6c381a43e943 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:36.578754 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3419b-a6ee-4fa6-a53f-6c381a43e943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:36.579032 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3419b-a6ee-4fa6-a53f-6c381a43e943 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:36.579719 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3419b-a6ee-4fa6-a53f-6c381a43e943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:36.581646 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3419b-a6ee-4fa6-a53f-6c381a43e943 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:36.606640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1314/2639] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:21:36 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:36.610875 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed34a7-8d66-464e-b3ae-15360b92a463 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:36.622505 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed34a7-8d66-464e-b3ae-15360b92a463 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:36.649670 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:36.681647 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd14f0-11e5-4e9a-a1f5-9a239f6164aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:36.682320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd14f0-11e5-4e9a-a1f5-9a239f6164aa admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:36.682605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd14f0-11e5-4e9a-a1f5-9a239f6164aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:36.682886 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd14f0-11e5-4e9a-a1f5-9a239f6164aa admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:36.683581 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd14f0-11e5-4e9a-a1f5-9a239f6164aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:36.685538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd14f0-11e5-4e9a-a1f5-9a239f6164aa admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:36.705051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1326/2640] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:21:36 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:21:36.709087 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3419b-a6ee-4fa6-a53f-6c381a43e943 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:36.719332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3419b-a6ee-4fa6-a53f-6c381a43e943 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:36.724204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5ae3b-2d01-4d6b-9b67-b5b5114d5739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:36.724858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5ae3b-2d01-4d6b-9b67-b5b5114d5739 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:36.725140 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5ae3b-2d01-4d6b-9b67-b5b5114d5739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:36.725415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5ae3b-2d01-4d6b-9b67-b5b5114d5739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:36.726136 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5ae3b-2d01-4d6b-9b67-b5b5114d5739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:36.727722 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5ae3b-2d01-4d6b-9b67-b5b5114d5739 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:36.737951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1315/2641] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:36.741636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd14f0-11e5-4e9a-a1f5-9a239f6164aa admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:36.752169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd14f0-11e5-4e9a-a1f5-9a239f6164aa admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:36.756760 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae92fdf-58b0-4d4e-a9bf-b06a8e014a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:36.757419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae92fdf-58b0-4d4e-a9bf-b06a8e014a40 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:36.757708 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae92fdf-58b0-4d4e-a9bf-b06a8e014a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:36.757990 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae92fdf-58b0-4d4e-a9bf-b06a8e014a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:36.758716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae92fdf-58b0-4d4e-a9bf-b06a8e014a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:36.760867 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae92fdf-58b0-4d4e-a9bf-b06a8e014a40 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:36.771250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1327/2642] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:36.775252 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5ae3b-2d01-4d6b-9b67-b5b5114d5739 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:36.785299 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5ae3b-2d01-4d6b-9b67-b5b5114d5739 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:36.790768 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd44734-5d20-483d-b8da-a37d17a7f8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:36.791639 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd44734-5d20-483d-b8da-a37d17a7f8ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:36.791943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd44734-5d20-483d-b8da-a37d17a7f8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:36.792235 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd44734-5d20-483d-b8da-a37d17a7f8ea admin admin] PATH_INFO: `/v3/projects/924869516f16459f9a45c105ea9f4cb8/users/93ff759b92fe40b68b6f7d362561f7f9/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:36.806398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd44734-5d20-483d-b8da-a37d17a7f8ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=924869516f16459f9a45c105ea9f4cb8, user_id=93ff759b92fe40b68b6f7d362561f7f9, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:36.809086 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd44734-5d20-483d-b8da-a37d17a7f8ea admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:36.822248 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1316/2643] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:21:36 2022] PUT /identity/v3/projects/924869516f16459f9a45c105ea9f4cb8/users/93ff759b92fe40b68b6f7d362561f7f9/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:36.833417 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238929a6-c4ec-42a3-82fb-33911f0e634b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:36.833737 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238929a6-c4ec-42a3-82fb-33911f0e634b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:36.834045 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238929a6-c4ec-42a3-82fb-33911f0e634b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:36.861105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-238929a6-c4ec-42a3-82fb-33911f0e634b None None] MFA Rules not processed for user `93ff759b92fe40b68b6f7d362561f7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:36.862327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-238929a6-c4ec-42a3-82fb-33911f0e634b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:36.929388 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1328/2644] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:36.934011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd44734-5d20-483d-b8da-a37d17a7f8ea admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:36.994842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd44734-5d20-483d-b8da-a37d17a7f8ea admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:36.999398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f592d0-5c36-4ea9-a4da-5b3a17659ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:37.000079 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f592d0-5c36-4ea9-a4da-5b3a17659ecd admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:37.000369 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f592d0-5c36-4ea9-a4da-5b3a17659ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:37.000649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f592d0-5c36-4ea9-a4da-5b3a17659ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:37.001367 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f592d0-5c36-4ea9-a4da-5b3a17659ecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:37.003266 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f592d0-5c36-4ea9-a4da-5b3a17659ecd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:37.030413 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1317/2645] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:21:36 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:37.034457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238929a6-c4ec-42a3-82fb-33911f0e634b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:37.045537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238929a6-c4ec-42a3-82fb-33911f0e634b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:37.102161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152db707-3f75-4539-b0b1-326c4e7d7df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:37.102837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db707-3f75-4539-b0b1-326c4e7d7df7 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:37.103123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db707-3f75-4539-b0b1-326c4e7d7df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:37.103407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db707-3f75-4539-b0b1-326c4e7d7df7 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:37.104143 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152db707-3f75-4539-b0b1-326c4e7d7df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:37.106200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152db707-3f75-4539-b0b1-326c4e7d7df7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:37.125674 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1329/2646] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:21:37 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:21:37.129713 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f592d0-5c36-4ea9-a4da-5b3a17659ecd admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:37.140943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f592d0-5c36-4ea9-a4da-5b3a17659ecd admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:37.145664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151712e8-7c8e-472f-a594-4b1e85df001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:37.146323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151712e8-7c8e-472f-a594-4b1e85df001c admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:37.146611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151712e8-7c8e-472f-a594-4b1e85df001c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:37.146890 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151712e8-7c8e-472f-a594-4b1e85df001c admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:37.147620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151712e8-7c8e-472f-a594-4b1e85df001c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:37.149266 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151712e8-7c8e-472f-a594-4b1e85df001c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:37.160703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1318/2647] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:21:37.164838 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152db707-3f75-4539-b0b1-326c4e7d7df7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:37.174790 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152db707-3f75-4539-b0b1-326c4e7d7df7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:37.179359 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de616c-adee-4e4e-8287-9498c77dc450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:37.180322 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de616c-adee-4e4e-8287-9498c77dc450 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:37.180611 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de616c-adee-4e4e-8287-9498c77dc450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:37.181410 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de616c-adee-4e4e-8287-9498c77dc450 admin admin] PATH_INFO: `/v3/projects/dd29cc6cffdf48e19f35160defe348d8/users/5896db7d207048a593ccbb2557b10efd/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:37.195780 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de616c-adee-4e4e-8287-9498c77dc450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd29cc6cffdf48e19f35160defe348d8, user_id=5896db7d207048a593ccbb2557b10efd, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:37.199033 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de616c-adee-4e4e-8287-9498c77dc450 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:37.212151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1330/2648] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:21:37 2022] PUT /identity/v3/projects/dd29cc6cffdf48e19f35160defe348d8/users/5896db7d207048a593ccbb2557b10efd/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:37.216062 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151712e8-7c8e-472f-a594-4b1e85df001c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:37.225811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151712e8-7c8e-472f-a594-4b1e85df001c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:37.246036 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:37.284421 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17a2d1-f2f1-492c-b4bd-cc9d005a6203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:37.285108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17a2d1-f2f1-492c-b4bd-cc9d005a6203 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:37.285350 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17a2d1-f2f1-492c-b4bd-cc9d005a6203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:37.286070 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17a2d1-f2f1-492c-b4bd-cc9d005a6203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:37.286800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17a2d1-f2f1-492c-b4bd-cc9d005a6203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:37.288593 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17a2d1-f2f1-492c-b4bd-cc9d005a6203 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:37.299249 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1319/2649] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:37.303421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de616c-adee-4e4e-8287-9498c77dc450 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:37.309480 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:37.315715 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de616c-adee-4e4e-8287-9498c77dc450 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:37.321021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b04c6-660b-4149-bc42-41aec2d49735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:37.322476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b04c6-660b-4149-bc42-41aec2d49735 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:37.322763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b04c6-660b-4149-bc42-41aec2d49735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:37.323075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b04c6-660b-4149-bc42-41aec2d49735 admin admin] PATH_INFO: `/v3/projects/dd29cc6cffdf48e19f35160defe348d8/users/5896db7d207048a593ccbb2557b10efd/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:37.325099 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b04c6-660b-4149-bc42-41aec2d49735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd29cc6cffdf48e19f35160defe348d8, user_id=5896db7d207048a593ccbb2557b10efd, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:37.327732 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b04c6-660b-4149-bc42-41aec2d49735 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:37.338242 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1331/2650] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:21:37 2022] PUT /identity/v3/projects/dd29cc6cffdf48e19f35160defe348d8/users/5896db7d207048a593ccbb2557b10efd/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:37.348283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733166ae-d6b2-4e89-905f-26bd1a29dae1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:37.348576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733166ae-d6b2-4e89-905f-26bd1a29dae1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:37.348853 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733166ae-d6b2-4e89-905f-26bd1a29dae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:37.375855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-733166ae-d6b2-4e89-905f-26bd1a29dae1 None None] MFA Rules not processed for user `5896db7d207048a593ccbb2557b10efd`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:37.377197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-733166ae-d6b2-4e89-905f-26bd1a29dae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:37.444493 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1320/2651] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:37.455293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b04c6-660b-4149-bc42-41aec2d49735 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:37.457022 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-251b04c6-660b-4149-bc42-41aec2d49735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:37.513567 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b04c6-660b-4149-bc42-41aec2d49735 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:37.517204 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29211386-183f-435f-8f44-0676850f18b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:37.517854 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29211386-183f-435f-8f44-0676850f18b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:37.518142 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29211386-183f-435f-8f44-0676850f18b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:37.518423 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29211386-183f-435f-8f44-0676850f18b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:37.528043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29211386-183f-435f-8f44-0676850f18b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:37.529475 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29211386-183f-435f-8f44-0676850f18b5 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:37.539137 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1332/2652] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:21:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:38.094797 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733166ae-d6b2-4e89-905f-26bd1a29dae1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:38.161742 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733166ae-d6b2-4e89-905f-26bd1a29dae1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:38.166302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447eba8-32d6-43d0-9f46-ad6a970b1e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:38.167173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447eba8-32d6-43d0-9f46-ad6a970b1e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:38.167460 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447eba8-32d6-43d0-9f46-ad6a970b1e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:38.167746 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447eba8-32d6-43d0-9f46-ad6a970b1e8a admin admin] PATH_INFO: `/v3/users/93ff759b92fe40b68b6f7d362561f7f9` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:38.168970 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447eba8-32d6-43d0-9f46-ad6a970b1e8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=93ff759b92fe40b68b6f7d362561f7f9)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:38.170907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447eba8-32d6-43d0-9f46-ad6a970b1e8a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:38.215231 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f447eba8-32d6-43d0-9f46-ad6a970b1e8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93ff759b92fe40b68b6f7d362561f7f9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:38.216450 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:38.223687 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f447eba8-32d6-43d0-9f46-ad6a970b1e8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93ff759b92fe40b68b6f7d362561f7f9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:38.231490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f447eba8-32d6-43d0-9f46-ad6a970b1e8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93ff759b92fe40b68b6f7d362561f7f9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:38.232137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f447eba8-32d6-43d0-9f46-ad6a970b1e8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93ff759b92fe40b68b6f7d362561f7f9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:38.232746 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f447eba8-32d6-43d0-9f46-ad6a970b1e8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93ff759b92fe40b68b6f7d362561f7f9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:38.251457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1321/2653] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:21:38 2022] DELETE /identity/v3/users/93ff759b92fe40b68b6f7d362561f7f9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:38.256187 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2944ab7-f9ef-40b9-9d6a-e50c51fff4a5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:38.256645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2944ab7-f9ef-40b9-9d6a-e50c51fff4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:38.256745 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2944ab7-f9ef-40b9-9d6a-e50c51fff4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:38.275149 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f2944ab7-f9ef-40b9-9d6a-e50c51fff4a5 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:38.276393 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f2944ab7-f9ef-40b9-9d6a-e50c51fff4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:38.335940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1333/2654] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:38.346224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447eba8-32d6-43d0-9f46-ad6a970b1e8a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:38.347767 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f447eba8-32d6-43d0-9f46-ad6a970b1e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:38.406090 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447eba8-32d6-43d0-9f46-ad6a970b1e8a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:38.409894 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c77321-4a6b-495c-b242-a26ca0cc4ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:38.410795 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c77321-4a6b-495c-b242-a26ca0cc4ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:38.411081 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c77321-4a6b-495c-b242-a26ca0cc4ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:38.411359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c77321-4a6b-495c-b242-a26ca0cc4ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:38.420314 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c77321-4a6b-495c-b242-a26ca0cc4ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:38.421748 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c77321-4a6b-495c-b242-a26ca0cc4ae1 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:38.431242 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1322/2655] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:21:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:38.687573 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2944ab7-f9ef-40b9-9d6a-e50c51fff4a5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:38.689133 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f2944ab7-f9ef-40b9-9d6a-e50c51fff4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:38.701679 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2944ab7-f9ef-40b9-9d6a-e50c51fff4a5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:38.706351 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:38.707214 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:38.707500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:38.707784 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5 admin admin] PATH_INFO: `/v3/projects/924869516f16459f9a45c105ea9f4cb8` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:38.709000 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=924869516f16459f9a45c105ea9f4cb8)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:38.710894 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:38.756626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924869516f16459f9a45c105ea9f4cb8', 'request_id': 'req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:38.763714 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924869516f16459f9a45c105ea9f4cb8', 'request_id': 'req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:38.769997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924869516f16459f9a45c105ea9f4cb8', 'request_id': 'req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:38.780980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5 admin admin] The token cache is being invalidate because project 924869516f16459f9a45c105ea9f4cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:38.781276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:38.781918 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:38.783488 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1334/2656] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:21:38 2022] DELETE /identity/v3/projects/924869516f16459f9a45c105ea9f4cb8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:38.787727 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c77321-4a6b-495c-b242-a26ca0cc4ae1 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:38.797465 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c77321-4a6b-495c-b242-a26ca0cc4ae1 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:38.852678 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376d8f5-23ea-442e-9dad-ea9eead7fa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:38.853551 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376d8f5-23ea-442e-9dad-ea9eead7fa89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:38.853837 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376d8f5-23ea-442e-9dad-ea9eead7fa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:38.854114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376d8f5-23ea-442e-9dad-ea9eead7fa89 admin admin] PATH_INFO: `/v3/users/5896db7d207048a593ccbb2557b10efd` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:38.855339 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376d8f5-23ea-442e-9dad-ea9eead7fa89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5896db7d207048a593ccbb2557b10efd)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:38.857291 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376d8f5-23ea-442e-9dad-ea9eead7fa89 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:38.908473 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c376d8f5-23ea-442e-9dad-ea9eead7fa89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5896db7d207048a593ccbb2557b10efd'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:38.915453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c376d8f5-23ea-442e-9dad-ea9eead7fa89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5896db7d207048a593ccbb2557b10efd'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:38.922936 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c376d8f5-23ea-442e-9dad-ea9eead7fa89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5896db7d207048a593ccbb2557b10efd'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:38.923605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c376d8f5-23ea-442e-9dad-ea9eead7fa89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5896db7d207048a593ccbb2557b10efd'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:38.924306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c376d8f5-23ea-442e-9dad-ea9eead7fa89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5896db7d207048a593ccbb2557b10efd'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:38.930030 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:38.944198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1323/2657] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:21:38 2022] DELETE /identity/v3/users/5896db7d207048a593ccbb2557b10efd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:39.217118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:39.218609 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:39.234596 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29cdc6-344f-47f8-b97a-2510d6dc10d5 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:39.250039 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:39.296247 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5dd9f4-e2eb-4ba3-9dca-0fef5f16841f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:39.297112 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dd9f4-e2eb-4ba3-9dca-0fef5f16841f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:39.297393 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dd9f4-e2eb-4ba3-9dca-0fef5f16841f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:39.297665 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dd9f4-e2eb-4ba3-9dca-0fef5f16841f admin admin] PATH_INFO: `/v3/projects/dd29cc6cffdf48e19f35160defe348d8` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:39.298838 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5dd9f4-e2eb-4ba3-9dca-0fef5f16841f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd29cc6cffdf48e19f35160defe348d8)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:39.300771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5dd9f4-e2eb-4ba3-9dca-0fef5f16841f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:39.347064 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4f5dd9f4-e2eb-4ba3-9dca-0fef5f16841f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd29cc6cffdf48e19f35160defe348d8', 'request_id': 'req-4f5dd9f4-e2eb-4ba3-9dca-0fef5f16841f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:39.353633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4f5dd9f4-e2eb-4ba3-9dca-0fef5f16841f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd29cc6cffdf48e19f35160defe348d8', 'request_id': 'req-4f5dd9f4-e2eb-4ba3-9dca-0fef5f16841f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:39.359964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4f5dd9f4-e2eb-4ba3-9dca-0fef5f16841f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd29cc6cffdf48e19f35160defe348d8', 'request_id': 'req-4f5dd9f4-e2eb-4ba3-9dca-0fef5f16841f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:39.371670 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4f5dd9f4-e2eb-4ba3-9dca-0fef5f16841f admin admin] The token cache is being invalidate because project dd29cc6cffdf48e19f35160defe348d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:39.372332 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4f5dd9f4-e2eb-4ba3-9dca-0fef5f16841f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:39.373126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4f5dd9f4-e2eb-4ba3-9dca-0fef5f16841f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:39.374678 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1335/2658] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:21:39 2022] DELETE /identity/v3/projects/dd29cc6cffdf48e19f35160defe348d8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:39.379694 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1285ed-0bfb-4dda-94df-4880e06c9a59 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:39.380151 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1285ed-0bfb-4dda-94df-4880e06c9a59 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:39.380323 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1285ed-0bfb-4dda-94df-4880e06c9a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:39.400703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3f1285ed-0bfb-4dda-94df-4880e06c9a59 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:39.401924 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3f1285ed-0bfb-4dda-94df-4880e06c9a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:39.461033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1324/2659] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:39.469999 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578102a-1611-42f9-b3cd-28114626fbad None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:39.470291 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578102a-1611-42f9-b3cd-28114626fbad None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:39.470574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578102a-1611-42f9-b3cd-28114626fbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:39.488663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8578102a-1611-42f9-b3cd-28114626fbad None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:39.489862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8578102a-1611-42f9-b3cd-28114626fbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:39.498710 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1336/2660] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:39.502869 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1285ed-0bfb-4dda-94df-4880e06c9a59 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:39.513302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1285ed-0bfb-4dda-94df-4880e06c9a59 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:39.517905 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c6039-a925-4d04-8639-e0b07c3d87fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:39.518557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c6039-a925-4d04-8639-e0b07c3d87fb admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:39.518846 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c6039-a925-4d04-8639-e0b07c3d87fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:39.519128 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c6039-a925-4d04-8639-e0b07c3d87fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:39.519862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c6039-a925-4d04-8639-e0b07c3d87fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:21:39.520197 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c6039-a925-4d04-8639-e0b07c3d87fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:39.521801 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c6039-a925-4d04-8639-e0b07c3d87fb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:39.533224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1325/2661] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:21:39.537495 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578102a-1611-42f9-b3cd-28114626fbad None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:39.546695 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578102a-1611-42f9-b3cd-28114626fbad None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:39.551311 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61199a36-a450-4699-815e-416ad45cba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:39.551985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61199a36-a450-4699-815e-416ad45cba54 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:39.552276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61199a36-a450-4699-815e-416ad45cba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:39.552556 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61199a36-a450-4699-815e-416ad45cba54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:39.553250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61199a36-a450-4699-815e-416ad45cba54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:39.555163 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61199a36-a450-4699-815e-416ad45cba54 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:39.581415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1337/2662] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:21:39 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:21:39.585272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c6039-a925-4d04-8639-e0b07c3d87fb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:39.595201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c6039-a925-4d04-8639-e0b07c3d87fb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:39.652639 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f132e69-0669-4389-b03a-96d2c4892b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:39.653319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f132e69-0669-4389-b03a-96d2c4892b47 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:39.653609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f132e69-0669-4389-b03a-96d2c4892b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:39.653893 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f132e69-0669-4389-b03a-96d2c4892b47 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:39.654599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f132e69-0669-4389-b03a-96d2c4892b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:39.656625 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f132e69-0669-4389-b03a-96d2c4892b47 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:39.676985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1326/2663] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:21:39 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:39.681846 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61199a36-a450-4699-815e-416ad45cba54 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:39.692268 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61199a36-a450-4699-815e-416ad45cba54 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:39.697423 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c10eac-c6fa-4d36-9a28-ae524aac3125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:39.698083 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c10eac-c6fa-4d36-9a28-ae524aac3125 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:39.698373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c10eac-c6fa-4d36-9a28-ae524aac3125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:39.698662 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c10eac-c6fa-4d36-9a28-ae524aac3125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:39.699400 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c10eac-c6fa-4d36-9a28-ae524aac3125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:39.701050 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c10eac-c6fa-4d36-9a28-ae524aac3125 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:39.712587 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1338/2664] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:39.716392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f132e69-0669-4389-b03a-96d2c4892b47 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:39.726186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f132e69-0669-4389-b03a-96d2c4892b47 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:39.730774 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837af6f-a50f-41b2-ada2-4ea6bd798e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:39.731431 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837af6f-a50f-41b2-ada2-4ea6bd798e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:39.731724 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837af6f-a50f-41b2-ada2-4ea6bd798e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:39.732069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837af6f-a50f-41b2-ada2-4ea6bd798e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:39.732867 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837af6f-a50f-41b2-ada2-4ea6bd798e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:39.734455 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837af6f-a50f-41b2-ada2-4ea6bd798e39 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:39.745182 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1327/2665] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:39.749373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c10eac-c6fa-4d36-9a28-ae524aac3125 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:39.759866 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c10eac-c6fa-4d36-9a28-ae524aac3125 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:39.764413 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2004064-4d0a-44f9-ae10-ab25b3c486e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:39.765288 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2004064-4d0a-44f9-ae10-ab25b3c486e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:39.765574 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2004064-4d0a-44f9-ae10-ab25b3c486e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:39.765851 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2004064-4d0a-44f9-ae10-ab25b3c486e2 admin admin] PATH_INFO: `/v3/projects/8a6f42a9f0464514b5a8f31433af3420/users/02cae4ec7ea34c5399e60794aa932688/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:39.780080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2004064-4d0a-44f9-ae10-ab25b3c486e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6f42a9f0464514b5a8f31433af3420, user_id=02cae4ec7ea34c5399e60794aa932688, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:39.782748 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2004064-4d0a-44f9-ae10-ab25b3c486e2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:39.796085 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1339/2666] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:21:39 2022] PUT /identity/v3/projects/8a6f42a9f0464514b5a8f31433af3420/users/02cae4ec7ea34c5399e60794aa932688/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:39.806690 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37d99b-b6a6-4347-bc1c-093de3038629 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:39.807011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37d99b-b6a6-4347-bc1c-093de3038629 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:39.807293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37d99b-b6a6-4347-bc1c-093de3038629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:39.833200 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0f37d99b-b6a6-4347-bc1c-093de3038629 None None] MFA Rules not processed for user `02cae4ec7ea34c5399e60794aa932688`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:39.834513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0f37d99b-b6a6-4347-bc1c-093de3038629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:39.875457 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:39.899607 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1328/2667] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:39.910260 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2004064-4d0a-44f9-ae10-ab25b3c486e2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:39.912244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c2004064-4d0a-44f9-ae10-ab25b3c486e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:39.957599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:39.971312 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2004064-4d0a-44f9-ae10-ab25b3c486e2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:39.974871 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574569f-47f3-4669-a34f-0dcaf98b7447 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:39.975521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574569f-47f3-4669-a34f-0dcaf98b7447 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:39.975807 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574569f-47f3-4669-a34f-0dcaf98b7447 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:39.976117 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574569f-47f3-4669-a34f-0dcaf98b7447 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:39.985282 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574569f-47f3-4669-a34f-0dcaf98b7447 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:39.986723 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574569f-47f3-4669-a34f-0dcaf98b7447 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:39.995633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1340/2668] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:21:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:40.015516 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37d99b-b6a6-4347-bc1c-093de3038629 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:40.080428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37d99b-b6a6-4347-bc1c-093de3038629 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:40.090982 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4ed8a-b973-4dff-af8a-ebb9b1d4fc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:40.091849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ed8a-b973-4dff-af8a-ebb9b1d4fc5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:40.092158 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ed8a-b973-4dff-af8a-ebb9b1d4fc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:40.092452 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ed8a-b973-4dff-af8a-ebb9b1d4fc5a admin admin] PATH_INFO: `/v3/users/02cae4ec7ea34c5399e60794aa932688` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:40.093638 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4ed8a-b973-4dff-af8a-ebb9b1d4fc5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=02cae4ec7ea34c5399e60794aa932688)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:40.095557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4ed8a-b973-4dff-af8a-ebb9b1d4fc5a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:40.140177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-eda4ed8a-b973-4dff-af8a-ebb9b1d4fc5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02cae4ec7ea34c5399e60794aa932688'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:40.146828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-eda4ed8a-b973-4dff-af8a-ebb9b1d4fc5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02cae4ec7ea34c5399e60794aa932688'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:40.155940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-eda4ed8a-b973-4dff-af8a-ebb9b1d4fc5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02cae4ec7ea34c5399e60794aa932688'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:40.156618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-eda4ed8a-b973-4dff-af8a-ebb9b1d4fc5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02cae4ec7ea34c5399e60794aa932688'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:40.157278 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-eda4ed8a-b973-4dff-af8a-ebb9b1d4fc5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02cae4ec7ea34c5399e60794aa932688'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:40.174512 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1329/2669] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:21:40 2022] DELETE /identity/v3/users/02cae4ec7ea34c5399e60794aa932688 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:40.178978 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175ffe7-7232-435e-9a97-74ef2f79f941 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:40.179271 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175ffe7-7232-435e-9a97-74ef2f79f941 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:40.179551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175ffe7-7232-435e-9a97-74ef2f79f941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:40.197288 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1175ffe7-7232-435e-9a97-74ef2f79f941 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:40.198481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1175ffe7-7232-435e-9a97-74ef2f79f941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:40.256000 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1341/2670] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:40.266130 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4ed8a-b973-4dff-af8a-ebb9b1d4fc5a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:40.267523 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-eda4ed8a-b973-4dff-af8a-ebb9b1d4fc5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:40.325629 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4ed8a-b973-4dff-af8a-ebb9b1d4fc5a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:40.329353 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51c6c7-b49d-4de1-8532-acc7dd0c5de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:40.330001 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51c6c7-b49d-4de1-8532-acc7dd0c5de5 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:40.330290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51c6c7-b49d-4de1-8532-acc7dd0c5de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:40.330575 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51c6c7-b49d-4de1-8532-acc7dd0c5de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:40.339741 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51c6c7-b49d-4de1-8532-acc7dd0c5de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:40.341266 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51c6c7-b49d-4de1-8532-acc7dd0c5de5 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:40.350797 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1330/2671] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:40.619826 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175ffe7-7232-435e-9a97-74ef2f79f941 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:40.621309 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1175ffe7-7232-435e-9a97-74ef2f79f941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:40.634013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175ffe7-7232-435e-9a97-74ef2f79f941 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:40.638741 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e335f3-72d2-4f0b-acbc-13f0f9abc0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:40.639731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e335f3-72d2-4f0b-acbc-13f0f9abc0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:40.639891 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e335f3-72d2-4f0b-acbc-13f0f9abc0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:40.640200 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e335f3-72d2-4f0b-acbc-13f0f9abc0ec admin admin] PATH_INFO: `/v3/projects/8a6f42a9f0464514b5a8f31433af3420` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:40.641372 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e335f3-72d2-4f0b-acbc-13f0f9abc0ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a6f42a9f0464514b5a8f31433af3420)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:40.643344 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e335f3-72d2-4f0b-acbc-13f0f9abc0ec admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:40.690299 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e1e335f3-72d2-4f0b-acbc-13f0f9abc0ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a6f42a9f0464514b5a8f31433af3420', 'request_id': 'req-e1e335f3-72d2-4f0b-acbc-13f0f9abc0ec'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:40.696765 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e1e335f3-72d2-4f0b-acbc-13f0f9abc0ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a6f42a9f0464514b5a8f31433af3420', 'request_id': 'req-e1e335f3-72d2-4f0b-acbc-13f0f9abc0ec'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:40.703143 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e1e335f3-72d2-4f0b-acbc-13f0f9abc0ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a6f42a9f0464514b5a8f31433af3420', 'request_id': 'req-e1e335f3-72d2-4f0b-acbc-13f0f9abc0ec'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:40.713794 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e1e335f3-72d2-4f0b-acbc-13f0f9abc0ec admin admin] The token cache is being invalidate because project 8a6f42a9f0464514b5a8f31433af3420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:40.714088 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e1e335f3-72d2-4f0b-acbc-13f0f9abc0ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:40.714735 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e1e335f3-72d2-4f0b-acbc-13f0f9abc0ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:40.716337 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1342/2672] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:21:40 2022] DELETE /identity/v3/projects/8a6f42a9f0464514b5a8f31433af3420 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:40.721221 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd714e-1ea2-4b46-85c6-2569e8e96c30 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:40.721716 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd714e-1ea2-4b46-85c6-2569e8e96c30 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:40.721816 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd714e-1ea2-4b46-85c6-2569e8e96c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:40.729609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:40.742050 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-cefd714e-1ea2-4b46-85c6-2569e8e96c30 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:40.744055 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cefd714e-1ea2-4b46-85c6-2569e8e96c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:40.802382 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1331/2673] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:40.810756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38574243-7212-4d2d-8d61-637ce6575c99 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:40.811051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38574243-7212-4d2d-8d61-637ce6575c99 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:40.811339 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38574243-7212-4d2d-8d61-637ce6575c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:40.829727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-38574243-7212-4d2d-8d61-637ce6575c99 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:40.830955 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-38574243-7212-4d2d-8d61-637ce6575c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:40.838859 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1343/2674] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:40.842876 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd714e-1ea2-4b46-85c6-2569e8e96c30 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:40.852249 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd714e-1ea2-4b46-85c6-2569e8e96c30 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:40.857346 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6cf6e-ebd4-44ec-bdff-abeb138e772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:40.857987 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6cf6e-ebd4-44ec-bdff-abeb138e772d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:40.858270 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6cf6e-ebd4-44ec-bdff-abeb138e772d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:40.858544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6cf6e-ebd4-44ec-bdff-abeb138e772d admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:40.859263 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6cf6e-ebd4-44ec-bdff-abeb138e772d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:21:40.859567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6cf6e-ebd4-44ec-bdff-abeb138e772d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:40.861179 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6cf6e-ebd4-44ec-bdff-abeb138e772d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:40.872397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1332/2675] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:21:40.876591 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38574243-7212-4d2d-8d61-637ce6575c99 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:40.886396 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38574243-7212-4d2d-8d61-637ce6575c99 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:40.891144 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecb789-44c2-49c7-b58d-58fc5cc28454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:40.891805 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecb789-44c2-49c7-b58d-58fc5cc28454 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:40.892128 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecb789-44c2-49c7-b58d-58fc5cc28454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:40.892410 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecb789-44c2-49c7-b58d-58fc5cc28454 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:40.893109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecb789-44c2-49c7-b58d-58fc5cc28454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:40.895012 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecb789-44c2-49c7-b58d-58fc5cc28454 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:40.921896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1344/2676] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:21:40 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:40.927534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6cf6e-ebd4-44ec-bdff-abeb138e772d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:40.939738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6cf6e-ebd4-44ec-bdff-abeb138e772d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:40.995764 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55e6c5-8b39-49f2-8e79-f11d94b0f944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:40.996462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55e6c5-8b39-49f2-8e79-f11d94b0f944 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:40.996751 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55e6c5-8b39-49f2-8e79-f11d94b0f944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:40.997033 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55e6c5-8b39-49f2-8e79-f11d94b0f944 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:40.997736 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55e6c5-8b39-49f2-8e79-f11d94b0f944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:40.999652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55e6c5-8b39-49f2-8e79-f11d94b0f944 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:41.020682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1333/2677] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:21:40 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:41.024751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecb789-44c2-49c7-b58d-58fc5cc28454 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:41.035832 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecb789-44c2-49c7-b58d-58fc5cc28454 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:41.041348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a337f-cf6d-4c4e-8e3c-f4e4ba593839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:41.042106 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a337f-cf6d-4c4e-8e3c-f4e4ba593839 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:41.042423 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a337f-cf6d-4c4e-8e3c-f4e4ba593839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:41.042712 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a337f-cf6d-4c4e-8e3c-f4e4ba593839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:41.043452 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a337f-cf6d-4c4e-8e3c-f4e4ba593839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:41.045083 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a337f-cf6d-4c4e-8e3c-f4e4ba593839 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:41.056424 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1345/2678] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:41.060522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55e6c5-8b39-49f2-8e79-f11d94b0f944 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:41.070475 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55e6c5-8b39-49f2-8e79-f11d94b0f944 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:41.075638 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f514bb-65dc-4065-a460-284642eaf0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:41.076331 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f514bb-65dc-4065-a460-284642eaf0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:41.076609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f514bb-65dc-4065-a460-284642eaf0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:41.076887 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f514bb-65dc-4065-a460-284642eaf0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:41.077610 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f514bb-65dc-4065-a460-284642eaf0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:41.079199 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f514bb-65dc-4065-a460-284642eaf0c3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:41.089049 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1334/2679] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:41.093170 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a337f-cf6d-4c4e-8e3c-f4e4ba593839 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:41.103050 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a337f-cf6d-4c4e-8e3c-f4e4ba593839 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:41.107759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecda563-17d1-43de-9b51-5759362eea61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:41.108665 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecda563-17d1-43de-9b51-5759362eea61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:41.108956 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecda563-17d1-43de-9b51-5759362eea61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:41.109240 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecda563-17d1-43de-9b51-5759362eea61 admin admin] PATH_INFO: `/v3/projects/ae1ab399083f4ae096376539daa263bd/users/c24ddb1d61bd4b0183d03ad650ebbe95/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:41.124076 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecda563-17d1-43de-9b51-5759362eea61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1ab399083f4ae096376539daa263bd, user_id=c24ddb1d61bd4b0183d03ad650ebbe95, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:41.128734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecda563-17d1-43de-9b51-5759362eea61 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:41.140003 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1346/2680] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:21:41 2022] PUT /identity/v3/projects/ae1ab399083f4ae096376539daa263bd/users/c24ddb1d61bd4b0183d03ad650ebbe95/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:41.151018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be28df2-bfe8-41af-a3eb-c225119b2afa None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:41.151342 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be28df2-bfe8-41af-a3eb-c225119b2afa None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:41.151627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be28df2-bfe8-41af-a3eb-c225119b2afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:41.181345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3be28df2-bfe8-41af-a3eb-c225119b2afa None None] MFA Rules not processed for user `c24ddb1d61bd4b0183d03ad650ebbe95`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:41.182568 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3be28df2-bfe8-41af-a3eb-c225119b2afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:41.242149 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:41.251283 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1335/2681] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:41.258582 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecda563-17d1-43de-9b51-5759362eea61 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:41.260861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6ecda563-17d1-43de-9b51-5759362eea61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:41.267483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:41.320729 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecda563-17d1-43de-9b51-5759362eea61 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:41.324465 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612cadf-c755-4164-8f2b-7f2225fa9a36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:41.325113 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612cadf-c755-4164-8f2b-7f2225fa9a36 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:41.325397 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612cadf-c755-4164-8f2b-7f2225fa9a36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:41.325678 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612cadf-c755-4164-8f2b-7f2225fa9a36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:41.334307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612cadf-c755-4164-8f2b-7f2225fa9a36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:41.335763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612cadf-c755-4164-8f2b-7f2225fa9a36 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:41.344493 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1347/2682] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:21:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:41.363863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be28df2-bfe8-41af-a3eb-c225119b2afa None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:41.426132 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be28df2-bfe8-41af-a3eb-c225119b2afa None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:41.431274 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59f5d3-5f18-4e61-8b21-d21201cb0fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:41.432173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59f5d3-5f18-4e61-8b21-d21201cb0fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:41.432462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59f5d3-5f18-4e61-8b21-d21201cb0fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:41.432739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59f5d3-5f18-4e61-8b21-d21201cb0fdb admin admin] PATH_INFO: `/v3/users/c24ddb1d61bd4b0183d03ad650ebbe95` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:41.433927 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59f5d3-5f18-4e61-8b21-d21201cb0fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24ddb1d61bd4b0183d03ad650ebbe95)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:41.435874 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59f5d3-5f18-4e61-8b21-d21201cb0fdb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:41.481848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4e59f5d3-5f18-4e61-8b21-d21201cb0fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24ddb1d61bd4b0183d03ad650ebbe95'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:41.488631 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4e59f5d3-5f18-4e61-8b21-d21201cb0fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24ddb1d61bd4b0183d03ad650ebbe95'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:41.496030 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4e59f5d3-5f18-4e61-8b21-d21201cb0fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24ddb1d61bd4b0183d03ad650ebbe95'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:41.496654 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4e59f5d3-5f18-4e61-8b21-d21201cb0fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24ddb1d61bd4b0183d03ad650ebbe95'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:41.497290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4e59f5d3-5f18-4e61-8b21-d21201cb0fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24ddb1d61bd4b0183d03ad650ebbe95'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:41.515241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1336/2683] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:21:41 2022] DELETE /identity/v3/users/c24ddb1d61bd4b0183d03ad650ebbe95 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:41.519723 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f25cf9-5435-472c-8900-681bd377303b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:41.520060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f25cf9-5435-472c-8900-681bd377303b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:41.520341 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f25cf9-5435-472c-8900-681bd377303b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:41.537988 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-58f25cf9-5435-472c-8900-681bd377303b None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:41.539178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-58f25cf9-5435-472c-8900-681bd377303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:41.596120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1348/2684] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:41.605757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59f5d3-5f18-4e61-8b21-d21201cb0fdb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:41.607139 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4e59f5d3-5f18-4e61-8b21-d21201cb0fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:41.663344 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59f5d3-5f18-4e61-8b21-d21201cb0fdb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:41.667005 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118edbda-f64a-4304-ba16-8749d7aa5b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:41.667651 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118edbda-f64a-4304-ba16-8749d7aa5b43 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:41.667960 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118edbda-f64a-4304-ba16-8749d7aa5b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:41.668241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118edbda-f64a-4304-ba16-8749d7aa5b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:41.677236 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118edbda-f64a-4304-ba16-8749d7aa5b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:41.678648 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118edbda-f64a-4304-ba16-8749d7aa5b43 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:41.688571 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1337/2685] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:41.951677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f25cf9-5435-472c-8900-681bd377303b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:41.953170 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-58f25cf9-5435-472c-8900-681bd377303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:41.966740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f25cf9-5435-472c-8900-681bd377303b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:41.971401 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02832fd4-06e6-4436-9d40-ef03572a5395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:41.972309 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832fd4-06e6-4436-9d40-ef03572a5395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:41.972620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832fd4-06e6-4436-9d40-ef03572a5395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:41.973058 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832fd4-06e6-4436-9d40-ef03572a5395 admin admin] PATH_INFO: `/v3/projects/ae1ab399083f4ae096376539daa263bd` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:41.974231 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02832fd4-06e6-4436-9d40-ef03572a5395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae1ab399083f4ae096376539daa263bd)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:41.976175 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02832fd4-06e6-4436-9d40-ef03572a5395 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:42.023758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-02832fd4-06e6-4436-9d40-ef03572a5395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae1ab399083f4ae096376539daa263bd', 'request_id': 'req-02832fd4-06e6-4436-9d40-ef03572a5395'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:42.032073 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-02832fd4-06e6-4436-9d40-ef03572a5395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae1ab399083f4ae096376539daa263bd', 'request_id': 'req-02832fd4-06e6-4436-9d40-ef03572a5395'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:42.038727 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-02832fd4-06e6-4436-9d40-ef03572a5395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae1ab399083f4ae096376539daa263bd', 'request_id': 'req-02832fd4-06e6-4436-9d40-ef03572a5395'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:42.049447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-02832fd4-06e6-4436-9d40-ef03572a5395 admin admin] The token cache is being invalidate because project ae1ab399083f4ae096376539daa263bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:42.049740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-02832fd4-06e6-4436-9d40-ef03572a5395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:42.050366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-02832fd4-06e6-4436-9d40-ef03572a5395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:42.051909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1349/2686] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:21:41 2022] DELETE /identity/v3/projects/ae1ab399083f4ae096376539daa263bd => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:42.056989 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f158bb-e5a8-462b-9b77-41f8ae9089bc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.057463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f158bb-e5a8-462b-9b77-41f8ae9089bc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.057565 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f158bb-e5a8-462b-9b77-41f8ae9089bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.075483 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-33f158bb-e5a8-462b-9b77-41f8ae9089bc None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:42.076720 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-33f158bb-e5a8-462b-9b77-41f8ae9089bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:42.093549 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:42.136492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1338/2687] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:42.144075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5abfd-c8f9-4383-9d6b-a54a278b2238 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.144368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5abfd-c8f9-4383-9d6b-a54a278b2238 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.144645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5abfd-c8f9-4383-9d6b-a54a278b2238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.163391 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2aa5abfd-c8f9-4383-9d6b-a54a278b2238 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:42.164642 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2aa5abfd-c8f9-4383-9d6b-a54a278b2238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:42.172527 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1350/2688] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:42.176650 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f158bb-e5a8-462b-9b77-41f8ae9089bc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:42.186488 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f158bb-e5a8-462b-9b77-41f8ae9089bc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:42.191077 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7083999-bfe1-4cbe-8c1f-55bdc78d8428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:42.191729 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7083999-bfe1-4cbe-8c1f-55bdc78d8428 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.192051 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7083999-bfe1-4cbe-8c1f-55bdc78d8428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.192334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7083999-bfe1-4cbe-8c1f-55bdc78d8428 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.193064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7083999-bfe1-4cbe-8c1f-55bdc78d8428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:21:42.193373 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7083999-bfe1-4cbe-8c1f-55bdc78d8428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:42.194975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7083999-bfe1-4cbe-8c1f-55bdc78d8428 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:42.206911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1339/2689] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:21:42.211014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5abfd-c8f9-4383-9d6b-a54a278b2238 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:42.220716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5abfd-c8f9-4383-9d6b-a54a278b2238 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:42.225391 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea1018-416f-4587-93ac-7a92d8ecfc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:42.226043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea1018-416f-4587-93ac-7a92d8ecfc64 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.226326 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea1018-416f-4587-93ac-7a92d8ecfc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.226608 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea1018-416f-4587-93ac-7a92d8ecfc64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.227314 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea1018-416f-4587-93ac-7a92d8ecfc64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:42.229324 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea1018-416f-4587-93ac-7a92d8ecfc64 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:42.255018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1351/2690] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:21:42 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:42.259498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7083999-bfe1-4cbe-8c1f-55bdc78d8428 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:42.269647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7083999-bfe1-4cbe-8c1f-55bdc78d8428 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:42.326160 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec23452-5ea7-4aa2-a0fd-f1ec684adf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:42.326825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23452-5ea7-4aa2-a0fd-f1ec684adf58 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.327145 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23452-5ea7-4aa2-a0fd-f1ec684adf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.327410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23452-5ea7-4aa2-a0fd-f1ec684adf58 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.328119 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec23452-5ea7-4aa2-a0fd-f1ec684adf58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:42.330025 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec23452-5ea7-4aa2-a0fd-f1ec684adf58 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:42.349483 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1340/2691] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:21:42 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:42.354120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea1018-416f-4587-93ac-7a92d8ecfc64 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:42.359667 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:42.365886 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea1018-416f-4587-93ac-7a92d8ecfc64 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:42.372448 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a10b1-ea9d-42e8-b965-7e7abc3c7551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:42.373119 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a10b1-ea9d-42e8-b965-7e7abc3c7551 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.373406 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a10b1-ea9d-42e8-b965-7e7abc3c7551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.373703 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a10b1-ea9d-42e8-b965-7e7abc3c7551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.374431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a10b1-ea9d-42e8-b965-7e7abc3c7551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:42.376049 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a10b1-ea9d-42e8-b965-7e7abc3c7551 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:42.388028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1352/2692] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:42.391825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec23452-5ea7-4aa2-a0fd-f1ec684adf58 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:42.402654 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec23452-5ea7-4aa2-a0fd-f1ec684adf58 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:42.407362 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d9d7e-6da5-4769-899b-b4957ef6add3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:42.408062 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d9d7e-6da5-4769-899b-b4957ef6add3 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.408352 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d9d7e-6da5-4769-899b-b4957ef6add3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.408632 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d9d7e-6da5-4769-899b-b4957ef6add3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.409362 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d9d7e-6da5-4769-899b-b4957ef6add3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:42.411230 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d9d7e-6da5-4769-899b-b4957ef6add3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:42.421671 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1341/2693] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:42.425691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a10b1-ea9d-42e8-b965-7e7abc3c7551 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:42.435496 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a10b1-ea9d-42e8-b965-7e7abc3c7551 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:42.440473 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ed15b-3dc8-419b-aaa7-936d3a55aea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:42.441362 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed15b-3dc8-419b-aaa7-936d3a55aea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.441642 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed15b-3dc8-419b-aaa7-936d3a55aea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.441915 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed15b-3dc8-419b-aaa7-936d3a55aea4 admin admin] PATH_INFO: `/v3/projects/2a9f9a0fb981448d8ca3e7a9a214f9ae/users/7e6f08c1a2204f52bdc14d4543091f0d/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.456061 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ed15b-3dc8-419b-aaa7-936d3a55aea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9f9a0fb981448d8ca3e7a9a214f9ae, user_id=7e6f08c1a2204f52bdc14d4543091f0d, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:42.458740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ed15b-3dc8-419b-aaa7-936d3a55aea4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:42.471579 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1353/2694] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:21:42 2022] PUT /identity/v3/projects/2a9f9a0fb981448d8ca3e7a9a214f9ae/users/7e6f08c1a2204f52bdc14d4543091f0d/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:21:42.482354 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498ff04-7f54-4ba0-b5f9-ccda9f72600f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.482653 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498ff04-7f54-4ba0-b5f9-ccda9f72600f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.482938 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498ff04-7f54-4ba0-b5f9-ccda9f72600f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.509282 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b498ff04-7f54-4ba0-b5f9-ccda9f72600f None None] MFA Rules not processed for user `7e6f08c1a2204f52bdc14d4543091f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:42.510498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b498ff04-7f54-4ba0-b5f9-ccda9f72600f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:42.574669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1342/2695] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:42.579154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ed15b-3dc8-419b-aaa7-936d3a55aea4 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:42.640379 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ed15b-3dc8-419b-aaa7-936d3a55aea4 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:42.644945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768c973-f5a8-4841-929d-977dd7f32c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:42.645610 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768c973-f5a8-4841-929d-977dd7f32c3e admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.645898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768c973-f5a8-4841-929d-977dd7f32c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.646176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768c973-f5a8-4841-929d-977dd7f32c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.646878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768c973-f5a8-4841-929d-977dd7f32c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:42.648818 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768c973-f5a8-4841-929d-977dd7f32c3e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:42.674909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1354/2696] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:21:42 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:42.679029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498ff04-7f54-4ba0-b5f9-ccda9f72600f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:42.690521 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498ff04-7f54-4ba0-b5f9-ccda9f72600f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:42.703972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:42.748775 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10f816-40a6-47d3-a71b-8ce476d291b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:42.749436 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10f816-40a6-47d3-a71b-8ce476d291b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.749720 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10f816-40a6-47d3-a71b-8ce476d291b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.749996 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10f816-40a6-47d3-a71b-8ce476d291b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.750678 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10f816-40a6-47d3-a71b-8ce476d291b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:42.752626 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10f816-40a6-47d3-a71b-8ce476d291b9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:42.773108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1343/2697] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:21:42 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:42.777179 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768c973-f5a8-4841-929d-977dd7f32c3e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:42.787688 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768c973-f5a8-4841-929d-977dd7f32c3e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:42.792917 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97096f3d-172b-444a-94f1-69f9f9045176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:42.793586 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97096f3d-172b-444a-94f1-69f9f9045176 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.793870 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97096f3d-172b-444a-94f1-69f9f9045176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.794152 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97096f3d-172b-444a-94f1-69f9f9045176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.794890 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97096f3d-172b-444a-94f1-69f9f9045176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:42.796522 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97096f3d-172b-444a-94f1-69f9f9045176 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:42.807597 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1355/2698] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:42.811675 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10f816-40a6-47d3-a71b-8ce476d291b9 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:42.821577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10f816-40a6-47d3-a71b-8ce476d291b9 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:42.826223 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f0588-4626-4160-a390-f053fb9f4dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:42.827098 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f0588-4626-4160-a390-f053fb9f4dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.827385 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f0588-4626-4160-a390-f053fb9f4dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.827664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f0588-4626-4160-a390-f053fb9f4dbf admin admin] PATH_INFO: `/v3/projects/26c363f8716c4f1dbf810418367c5d2b/users/fd3e17d0a3654af2a975fd9f598d63db/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.843469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f0588-4626-4160-a390-f053fb9f4dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c363f8716c4f1dbf810418367c5d2b, user_id=fd3e17d0a3654af2a975fd9f598d63db, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:42.846258 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f0588-4626-4160-a390-f053fb9f4dbf admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:42.859389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1344/2699] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:21:42 2022] PUT /identity/v3/projects/26c363f8716c4f1dbf810418367c5d2b/users/fd3e17d0a3654af2a975fd9f598d63db/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:21:42.863241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97096f3d-172b-444a-94f1-69f9f9045176 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:42.873775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97096f3d-172b-444a-94f1-69f9f9045176 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:42.929237 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c933696-a122-40ce-9139-a5ab658cac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:42.929822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c933696-a122-40ce-9139-a5ab658cac20 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.930111 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c933696-a122-40ce-9139-a5ab658cac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.930421 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c933696-a122-40ce-9139-a5ab658cac20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.931434 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c933696-a122-40ce-9139-a5ab658cac20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:42.934002 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c933696-a122-40ce-9139-a5ab658cac20 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:42.951554 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1356/2700] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:42.955714 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f0588-4626-4160-a390-f053fb9f4dbf admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:42.966763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f0588-4626-4160-a390-f053fb9f4dbf admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:42.971299 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f5561-5298-4af2-b878-3f2d3ca1623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:42.972211 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5561-5298-4af2-b878-3f2d3ca1623a admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.972489 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5561-5298-4af2-b878-3f2d3ca1623a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.972759 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5561-5298-4af2-b878-3f2d3ca1623a admin admin] PATH_INFO: `/v3/projects/26c363f8716c4f1dbf810418367c5d2b/users/fd3e17d0a3654af2a975fd9f598d63db/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:42.974671 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f5561-5298-4af2-b878-3f2d3ca1623a admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c363f8716c4f1dbf810418367c5d2b, user_id=fd3e17d0a3654af2a975fd9f598d63db, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:42.977309 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f5561-5298-4af2-b878-3f2d3ca1623a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:42.987397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1345/2701] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:21:42 2022] PUT /identity/v3/projects/26c363f8716c4f1dbf810418367c5d2b/users/fd3e17d0a3654af2a975fd9f598d63db/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:42.998138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d0a76-6bf3-4e72-8f3b-784d18479bfe None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:42.998646 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d0a76-6bf3-4e72-8f3b-784d18479bfe None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:42.998762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d0a76-6bf3-4e72-8f3b-784d18479bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:43.025563 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-133d0a76-6bf3-4e72-8f3b-784d18479bfe None None] MFA Rules not processed for user `fd3e17d0a3654af2a975fd9f598d63db`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:43.026771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-133d0a76-6bf3-4e72-8f3b-784d18479bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:43.052379 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:43.094940 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1357/2702] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:43.105751 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f5561-5298-4af2-b878-3f2d3ca1623a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:43.107490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d83f5561-5298-4af2-b878-3f2d3ca1623a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:43.164411 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f5561-5298-4af2-b878-3f2d3ca1623a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:43.168145 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae8ff6-dc72-47f6-b3d4-eb3afab24845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:43.168790 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae8ff6-dc72-47f6-b3d4-eb3afab24845 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:43.169080 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae8ff6-dc72-47f6-b3d4-eb3afab24845 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:43.169363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae8ff6-dc72-47f6-b3d4-eb3afab24845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:43.225381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae8ff6-dc72-47f6-b3d4-eb3afab24845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:43.226749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae8ff6-dc72-47f6-b3d4-eb3afab24845 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:43.235741 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1346/2703] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:21:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:45.743405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d0a76-6bf3-4e72-8f3b-784d18479bfe None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:45.804961 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d0a76-6bf3-4e72-8f3b-784d18479bfe None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:45.809533 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241629e0-7192-49d9-9296-c31944152e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:45.810407 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241629e0-7192-49d9-9296-c31944152e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:45.810693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241629e0-7192-49d9-9296-c31944152e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:45.810973 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241629e0-7192-49d9-9296-c31944152e55 admin admin] PATH_INFO: `/v3/users/7e6f08c1a2204f52bdc14d4543091f0d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:45.812180 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241629e0-7192-49d9-9296-c31944152e55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6f08c1a2204f52bdc14d4543091f0d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:45.814128 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241629e0-7192-49d9-9296-c31944152e55 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:45.859036 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-241629e0-7192-49d9-9296-c31944152e55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6f08c1a2204f52bdc14d4543091f0d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:45.859688 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-241629e0-7192-49d9-9296-c31944152e55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6f08c1a2204f52bdc14d4543091f0d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:45.868724 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-241629e0-7192-49d9-9296-c31944152e55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6f08c1a2204f52bdc14d4543091f0d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:45.875716 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-241629e0-7192-49d9-9296-c31944152e55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6f08c1a2204f52bdc14d4543091f0d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:45.891468 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-241629e0-7192-49d9-9296-c31944152e55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6f08c1a2204f52bdc14d4543091f0d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:45.897348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1358/2704] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:21:45 2022] DELETE /identity/v3/users/7e6f08c1a2204f52bdc14d4543091f0d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:45.902359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3697f-0aa4-4000-98cc-8dbbfa30023c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:45.902861 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3697f-0aa4-4000-98cc-8dbbfa30023c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:45.902974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3697f-0aa4-4000-98cc-8dbbfa30023c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:45.924598 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-27f3697f-0aa4-4000-98cc-8dbbfa30023c None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:45.925898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-27f3697f-0aa4-4000-98cc-8dbbfa30023c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:45.943952 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:45.987797 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1347/2705] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:45.997549 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241629e0-7192-49d9-9296-c31944152e55 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:45.998953 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-241629e0-7192-49d9-9296-c31944152e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:46.049199 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:46.062898 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241629e0-7192-49d9-9296-c31944152e55 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:46.066759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667884c-4ab9-4c27-a24f-6cbb0c179264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:46.067474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667884c-4ab9-4c27-a24f-6cbb0c179264 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:46.067763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667884c-4ab9-4c27-a24f-6cbb0c179264 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:46.068075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667884c-4ab9-4c27-a24f-6cbb0c179264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:46.077551 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667884c-4ab9-4c27-a24f-6cbb0c179264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:46.079068 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667884c-4ab9-4c27-a24f-6cbb0c179264 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:46.088600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1359/2706] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:21:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:21:46.348224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3697f-0aa4-4000-98cc-8dbbfa30023c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:46.349822 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-27f3697f-0aa4-4000-98cc-8dbbfa30023c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:46.365454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3697f-0aa4-4000-98cc-8dbbfa30023c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:46.370504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e53d3-d6c4-419f-9787-12c057f130d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:46.371481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e53d3-d6c4-419f-9787-12c057f130d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:46.371848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e53d3-d6c4-419f-9787-12c057f130d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:46.372246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e53d3-d6c4-419f-9787-12c057f130d7 admin admin] PATH_INFO: `/v3/projects/2a9f9a0fb981448d8ca3e7a9a214f9ae` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:46.373554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e53d3-d6c4-419f-9787-12c057f130d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9f9a0fb981448d8ca3e7a9a214f9ae)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:46.375554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e53d3-d6c4-419f-9787-12c057f130d7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:46.424632 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-639e53d3-d6c4-419f-9787-12c057f130d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9f9a0fb981448d8ca3e7a9a214f9ae', 'request_id': 'req-639e53d3-d6c4-419f-9787-12c057f130d7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:46.430011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-639e53d3-d6c4-419f-9787-12c057f130d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9f9a0fb981448d8ca3e7a9a214f9ae', 'request_id': 'req-639e53d3-d6c4-419f-9787-12c057f130d7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:46.436958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-639e53d3-d6c4-419f-9787-12c057f130d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9f9a0fb981448d8ca3e7a9a214f9ae', 'request_id': 'req-639e53d3-d6c4-419f-9787-12c057f130d7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:46.448188 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-639e53d3-d6c4-419f-9787-12c057f130d7 admin admin] The token cache is being invalidate because project 2a9f9a0fb981448d8ca3e7a9a214f9ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:46.448480 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-639e53d3-d6c4-419f-9787-12c057f130d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:46.449108 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-639e53d3-d6c4-419f-9787-12c057f130d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:46.450660 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1348/2707] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:21:46 2022] DELETE /identity/v3/projects/2a9f9a0fb981448d8ca3e7a9a214f9ae => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:21:46.454740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667884c-4ab9-4c27-a24f-6cbb0c179264 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:46.465320 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667884c-4ab9-4c27-a24f-6cbb0c179264 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:46.519883 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b158d-e943-4952-8c96-c8d1963d9afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:46.520789 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b158d-e943-4952-8c96-c8d1963d9afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:46.521079 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b158d-e943-4952-8c96-c8d1963d9afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:46.521364 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b158d-e943-4952-8c96-c8d1963d9afc admin admin] PATH_INFO: `/v3/users/fd3e17d0a3654af2a975fd9f598d63db` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:46.522556 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b158d-e943-4952-8c96-c8d1963d9afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd3e17d0a3654af2a975fd9f598d63db)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:46.525182 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b158d-e943-4952-8c96-c8d1963d9afc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:46.571586 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-743b158d-e943-4952-8c96-c8d1963d9afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd3e17d0a3654af2a975fd9f598d63db'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:46.572283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-743b158d-e943-4952-8c96-c8d1963d9afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd3e17d0a3654af2a975fd9f598d63db'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:46.579455 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-743b158d-e943-4952-8c96-c8d1963d9afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd3e17d0a3654af2a975fd9f598d63db'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:46.586632 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-743b158d-e943-4952-8c96-c8d1963d9afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd3e17d0a3654af2a975fd9f598d63db'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:46.598979 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-743b158d-e943-4952-8c96-c8d1963d9afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd3e17d0a3654af2a975fd9f598d63db'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:46.604936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1360/2708] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:21:46 2022] DELETE /identity/v3/users/fd3e17d0a3654af2a975fd9f598d63db => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:46.863627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e53d3-d6c4-419f-9787-12c057f130d7 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:46.865211 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-639e53d3-d6c4-419f-9787-12c057f130d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:46.882292 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e53d3-d6c4-419f-9787-12c057f130d7 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:46.939864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff633a-221b-42f8-a5c1-ccdbfe96c10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:46.940747 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff633a-221b-42f8-a5c1-ccdbfe96c10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:46.941035 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff633a-221b-42f8-a5c1-ccdbfe96c10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:46.941313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff633a-221b-42f8-a5c1-ccdbfe96c10d admin admin] PATH_INFO: `/v3/projects/26c363f8716c4f1dbf810418367c5d2b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:46.942486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff633a-221b-42f8-a5c1-ccdbfe96c10d admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c363f8716c4f1dbf810418367c5d2b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:46.944419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff633a-221b-42f8-a5c1-ccdbfe96c10d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:46.996570 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-05ff633a-221b-42f8-a5c1-ccdbfe96c10d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c363f8716c4f1dbf810418367c5d2b', 'request_id': 'req-05ff633a-221b-42f8-a5c1-ccdbfe96c10d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:46.997811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:47.003355 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-05ff633a-221b-42f8-a5c1-ccdbfe96c10d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c363f8716c4f1dbf810418367c5d2b', 'request_id': 'req-05ff633a-221b-42f8-a5c1-ccdbfe96c10d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:47.012008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-05ff633a-221b-42f8-a5c1-ccdbfe96c10d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c363f8716c4f1dbf810418367c5d2b', 'request_id': 'req-05ff633a-221b-42f8-a5c1-ccdbfe96c10d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:47.023170 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-05ff633a-221b-42f8-a5c1-ccdbfe96c10d admin admin] The token cache is being invalidate because project 26c363f8716c4f1dbf810418367c5d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:21:47.023462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-05ff633a-221b-42f8-a5c1-ccdbfe96c10d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:47.024131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-05ff633a-221b-42f8-a5c1-ccdbfe96c10d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:21:47.025680 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1349/2709] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:21:46 2022] DELETE /identity/v3/projects/26c363f8716c4f1dbf810418367c5d2b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:47.032711 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d214d-b809-4656-9023-cd139e32952a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:47.033177 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d214d-b809-4656-9023-cd139e32952a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:47.033483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d214d-b809-4656-9023-cd139e32952a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:47.053110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5a4d214d-b809-4656-9023-cd139e32952a None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:47.054253 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5a4d214d-b809-4656-9023-cd139e32952a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:47.112769 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1361/2710] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:47.121228 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05c2be-bbba-45dc-9bf7-a20be6ef5d88 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:47.121546 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05c2be-bbba-45dc-9bf7-a20be6ef5d88 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:47.121822 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05c2be-bbba-45dc-9bf7-a20be6ef5d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:47.140339 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0f05c2be-bbba-45dc-9bf7-a20be6ef5d88 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:47.141533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0f05c2be-bbba-45dc-9bf7-a20be6ef5d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:47.149376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1350/2711] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:47.153498 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d214d-b809-4656-9023-cd139e32952a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:47.159773 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:47.164134 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d214d-b809-4656-9023-cd139e32952a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:47.170313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b69b4c-15a6-4405-9ee9-539f584ec149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:47.170992 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b69b4c-15a6-4405-9ee9-539f584ec149 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:47.171483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b69b4c-15a6-4405-9ee9-539f584ec149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:47.172223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b69b4c-15a6-4405-9ee9-539f584ec149 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:47.173172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b69b4c-15a6-4405-9ee9-539f584ec149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:21:47.173492 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b69b4c-15a6-4405-9ee9-539f584ec149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:47.175130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b69b4c-15a6-4405-9ee9-539f584ec149 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:47.187411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1362/2712] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:21:47.191764 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05c2be-bbba-45dc-9bf7-a20be6ef5d88 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:47.201454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05c2be-bbba-45dc-9bf7-a20be6ef5d88 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:47.206077 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee62dc3-5231-4522-a774-a67712828b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:47.206721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee62dc3-5231-4522-a774-a67712828b75 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:47.207002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee62dc3-5231-4522-a774-a67712828b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:47.207275 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee62dc3-5231-4522-a774-a67712828b75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:47.208015 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee62dc3-5231-4522-a774-a67712828b75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:47.209893 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee62dc3-5231-4522-a774-a67712828b75 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:47.233961 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1351/2713] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:21:47 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:47.238280 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b69b4c-15a6-4405-9ee9-539f584ec149 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:47.249474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b69b4c-15a6-4405-9ee9-539f584ec149 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:47.306149 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d44e12-767d-4ac3-95d6-8d45ca844ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:47.306752 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d44e12-767d-4ac3-95d6-8d45ca844ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:47.307037 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d44e12-767d-4ac3-95d6-8d45ca844ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:47.307317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d44e12-767d-4ac3-95d6-8d45ca844ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:47.308037 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d44e12-767d-4ac3-95d6-8d45ca844ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:47.310023 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d44e12-767d-4ac3-95d6-8d45ca844ba2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:47.329857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1363/2714] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:21:47 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:21:47.333944 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee62dc3-5231-4522-a774-a67712828b75 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:47.344645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee62dc3-5231-4522-a774-a67712828b75 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:47.349350 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12966374-8593-46c4-bf30-a3fa88a9a349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:47.350007 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12966374-8593-46c4-bf30-a3fa88a9a349 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:47.350297 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12966374-8593-46c4-bf30-a3fa88a9a349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:47.350581 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12966374-8593-46c4-bf30-a3fa88a9a349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:47.351319 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12966374-8593-46c4-bf30-a3fa88a9a349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:47.353456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12966374-8593-46c4-bf30-a3fa88a9a349 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:47.363715 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1352/2715] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:47.367605 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d44e12-767d-4ac3-95d6-8d45ca844ba2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:47.378601 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d44e12-767d-4ac3-95d6-8d45ca844ba2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:47.383405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac33b75-4f70-4b5d-894b-0446efdea080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:47.384115 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac33b75-4f70-4b5d-894b-0446efdea080 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:47.384405 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac33b75-4f70-4b5d-894b-0446efdea080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:47.384704 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac33b75-4f70-4b5d-894b-0446efdea080 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:47.385413 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac33b75-4f70-4b5d-894b-0446efdea080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:47.387001 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac33b75-4f70-4b5d-894b-0446efdea080 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:47.397096 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1364/2716] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:21:47.401345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12966374-8593-46c4-bf30-a3fa88a9a349 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:47.411519 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12966374-8593-46c4-bf30-a3fa88a9a349 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:47.416687 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42ee0f-ab00-4de4-9c0c-83fdf1ddabd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:47.417561 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42ee0f-ab00-4de4-9c0c-83fdf1ddabd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:47.417845 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42ee0f-ab00-4de4-9c0c-83fdf1ddabd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:47.418120 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42ee0f-ab00-4de4-9c0c-83fdf1ddabd6 admin admin] PATH_INFO: `/v3/projects/22a27482ebba49ab8d71911c88376fca/users/8e29485cafda41219cad433dd77cc9f4/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:47.433024 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42ee0f-ab00-4de4-9c0c-83fdf1ddabd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a27482ebba49ab8d71911c88376fca, user_id=8e29485cafda41219cad433dd77cc9f4, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:47.435664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42ee0f-ab00-4de4-9c0c-83fdf1ddabd6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:47.448754 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1353/2717] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:21:47 2022] PUT /identity/v3/projects/22a27482ebba49ab8d71911c88376fca/users/8e29485cafda41219cad433dd77cc9f4/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:21:47.453871 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438d7da-9747-453b-964f-42f6ed20c2e3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:47.454176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438d7da-9747-453b-964f-42f6ed20c2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:47.454466 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438d7da-9747-453b-964f-42f6ed20c2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:47.472760 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4438d7da-9747-453b-964f-42f6ed20c2e3 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:47.473981 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4438d7da-9747-453b-964f-42f6ed20c2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:47.531518 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1365/2718] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:47.541483 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42ee0f-ab00-4de4-9c0c-83fdf1ddabd6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:47.543287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-de42ee0f-ab00-4de4-9c0c-83fdf1ddabd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:47.600493 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42ee0f-ab00-4de4-9c0c-83fdf1ddabd6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:47.604591 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfcc12-2255-46e7-8bc4-5c3518a1d4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:47.605225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfcc12-2255-46e7-8bc4-5c3518a1d4eb service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:47.605507 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfcc12-2255-46e7-8bc4-5c3518a1d4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:47.605781 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfcc12-2255-46e7-8bc4-5c3518a1d4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:47.614899 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfcc12-2255-46e7-8bc4-5c3518a1d4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:47.616374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfcc12-2255-46e7-8bc4-5c3518a1d4eb service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:47.626285 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1354/2719] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:21:48.253288 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc658-236c-43ac-9bf5-cb301d72bca4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:48.253819 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc658-236c-43ac-9bf5-cb301d72bca4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:48.254134 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc658-236c-43ac-9bf5-cb301d72bca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:48.282510 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ac2dc658-236c-43ac-9bf5-cb301d72bca4 None None] MFA Rules not processed for user `8e29485cafda41219cad433dd77cc9f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:48.283770 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ac2dc658-236c-43ac-9bf5-cb301d72bca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:48.350442 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:48.355365 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1366/2720] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:48.366902 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfcc12-2255-46e7-8bc4-5c3518a1d4eb service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:21:48.369090 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b0dfcc12-2255-46e7-8bc4-5c3518a1d4eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:48.433351 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfcc12-2255-46e7-8bc4-5c3518a1d4eb service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:21:48.437041 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ceb9d-a6e9-465d-a339-7bd406517fa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:21:48.437693 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ceb9d-a6e9-465d-a339-7bd406517fa1 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:48.437981 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ceb9d-a6e9-465d-a339-7bd406517fa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:48.438265 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ceb9d-a6e9-465d-a339-7bd406517fa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:48.447144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ceb9d-a6e9-465d-a339-7bd406517fa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:21:48.448618 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ceb9d-a6e9-465d-a339-7bd406517fa1 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:21:48.457498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1355/2721] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:21:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:21:49.848941 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17cda2-c284-4d37-a7f3-45097b990ac4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:21:49.849521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17cda2-c284-4d37-a7f3-45097b990ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:21:49.849521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17cda2-c284-4d37-a7f3-45097b990ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:21:49.867032 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6e17cda2-c284-4d37-a7f3-45097b990ac4 None None] MFA Rules not processed for user `8e29485cafda41219cad433dd77cc9f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:21:49.868285 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6e17cda2-c284-4d37-a7f3-45097b990ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:21:49.875031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1367/2722] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:21:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:21:58.453462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=3,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:21:59.861663 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:06.208666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d296fa5-7706-48ae-9ae0-87c5970e6c1e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:06.209148 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d296fa5-7706-48ae-9ae0-87c5970e6c1e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:06.209254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d296fa5-7706-48ae-9ae0-87c5970e6c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:06.228254 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2d296fa5-7706-48ae-9ae0-87c5970e6c1e None None] MFA Rules not processed for user `8e29485cafda41219cad433dd77cc9f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:06.229435 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2d296fa5-7706-48ae-9ae0-87c5970e6c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:06.236126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1356/2723] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:22:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:16.221504 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:30.059042 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e9fcd-807b-4432-90ec-3b27240af8e5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:30.059572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e9fcd-807b-4432-90ec-3b27240af8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:30.059572 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e9fcd-807b-4432-90ec-3b27240af8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:30.125489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-417e9fcd-807b-4432-90ec-3b27240af8e5 None None] MFA Rules not processed for user `b6c5da324ab2405a84036db91a1366a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:30.126725 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-417e9fcd-807b-4432-90ec-3b27240af8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:30.210378 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1368/2724] 10.222.0.73 () {58 vars in 1009 bytes} [Thu May 19 12:22:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:30.271426 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d296fa5-7706-48ae-9ae0-87c5970e6c1e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:30.273479 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2d296fa5-7706-48ae-9ae0-87c5970e6c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:30.391630 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d296fa5-7706-48ae-9ae0-87c5970e6c1e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:30.399067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fd90f-3d47-484a-a9ce-8ecddac3895e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371dae58e95d403b97e311c6616adab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:30.399986 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fd90f-3d47-484a-a9ce-8ecddac3895e service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:30.400539 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fd90f-3d47-484a-a9ce-8ecddac3895e service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:30.400916 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fd90f-3d47-484a-a9ce-8ecddac3895e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:30.411789 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1fd90f-3d47-484a-a9ce-8ecddac3895e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:30.413886 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1fd90f-3d47-484a-a9ce-8ecddac3895e service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:30.459544 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1357/2725] 10.222.0.73 () {60 vars in 1384 bytes} [Thu May 19 12:22:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:22:30.484102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e9fcd-807b-4432-90ec-3b27240af8e5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:30.484513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-417e9fcd-807b-4432-90ec-3b27240af8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:30.502688 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e9fcd-807b-4432-90ec-3b27240af8e5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:30.506504 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da021892-9894-4dde-8690-f2e461208f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:30.507736 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da021892-9894-4dde-8690-f2e461208f9f service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:30.508070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da021892-9894-4dde-8690-f2e461208f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:30.508350 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da021892-9894-4dde-8690-f2e461208f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:30.510164 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-da021892-9894-4dde-8690-f2e461208f9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:30.532167 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da021892-9894-4dde-8690-f2e461208f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:30.533963 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da021892-9894-4dde-8690-f2e461208f9f service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:30.544957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1369/2726] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:22:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:22:30.646977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fd90f-3d47-484a-a9ce-8ecddac3895e service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:30.660800 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fd90f-3d47-484a-a9ce-8ecddac3895e service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:30.665030 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5554a13-69f7-43a0-ae3a-3c3d0bf2468d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:30.665898 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5554a13-69f7-43a0-ae3a-3c3d0bf2468d service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:30.666186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5554a13-69f7-43a0-ae3a-3c3d0bf2468d service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:30.666467 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5554a13-69f7-43a0-ae3a-3c3d0bf2468d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:30.669554 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e5554a13-69f7-43a0-ae3a-3c3d0bf2468d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:30.774111 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5554a13-69f7-43a0-ae3a-3c3d0bf2468d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:30.775596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5554a13-69f7-43a0-ae3a-3c3d0bf2468d service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:30.789131 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1358/2727] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:22:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:22:40.540542 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=53 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:40.783218 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=75 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:45.953890 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531704c4-50d0-41af-a29b-9973a8f6f6dd None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:45.954354 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531704c4-50d0-41af-a29b-9973a8f6f6dd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:45.954467 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531704c4-50d0-41af-a29b-9973a8f6f6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:45.971984 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-531704c4-50d0-41af-a29b-9973a8f6f6dd None None] MFA Rules not processed for user `b6c5da324ab2405a84036db91a1366a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:22:45.973180 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-531704c4-50d0-41af-a29b-9973a8f6f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:22:45.980766 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1370/2728] 10.222.0.73 () {58 vars in 967 bytes} [Thu May 19 12:22:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:22:45.993232 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5554a13-69f7-43a0-ae3a-3c3d0bf2468d service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:46.004486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5554a13-69f7-43a0-ae3a-3c3d0bf2468d service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:46.009605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d670b-095d-4d95-baae-639a64827bf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '371dae58e95d403b97e311c6616adab5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:46.010244 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d670b-095d-4d95-baae-639a64827bf6 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:46.010561 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d670b-095d-4d95-baae-639a64827bf6 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:46.010843 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d670b-095d-4d95-baae-639a64827bf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:46.018846 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d670b-095d-4d95-baae-639a64827bf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:46.020481 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d670b-095d-4d95-baae-639a64827bf6 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:46.028493 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1359/2729] 10.222.0.73 () {60 vars in 1384 bytes} [Thu May 19 12:22:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 12:22:48.019959 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531704c4-50d0-41af-a29b-9973a8f6f6dd None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:48.032173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531704c4-50d0-41af-a29b-9973a8f6f6dd None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:48.037131 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016db8a-38d0-4c00-9fa9-0a975c082d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:48.038501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016db8a-38d0-4c00-9fa9-0a975c082d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:48.038785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016db8a-38d0-4c00-9fa9-0a975c082d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:48.039063 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016db8a-38d0-4c00-9fa9-0a975c082d5f admin admin] PATH_INFO: `/v3/users/8e29485cafda41219cad433dd77cc9f4` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:48.040298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016db8a-38d0-4c00-9fa9-0a975c082d5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e29485cafda41219cad433dd77cc9f4)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:48.042223 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016db8a-38d0-4c00-9fa9-0a975c082d5f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:48.092008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0016db8a-38d0-4c00-9fa9-0a975c082d5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e29485cafda41219cad433dd77cc9f4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:48.092793 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0016db8a-38d0-4c00-9fa9-0a975c082d5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e29485cafda41219cad433dd77cc9f4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:48.099964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0016db8a-38d0-4c00-9fa9-0a975c082d5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e29485cafda41219cad433dd77cc9f4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:48.107544 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0016db8a-38d0-4c00-9fa9-0a975c082d5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e29485cafda41219cad433dd77cc9f4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:48.119825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0016db8a-38d0-4c00-9fa9-0a975c082d5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e29485cafda41219cad433dd77cc9f4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:48.129571 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1371/2730] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:22:48 2022] DELETE /identity/v3/users/8e29485cafda41219cad433dd77cc9f4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:22:48.300201 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d670b-095d-4d95-baae-639a64827bf6 service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:22:48.312769 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d670b-095d-4d95-baae-639a64827bf6 service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:22:48.369555 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46961bc2-76bc-402f-9d93-496c0c12d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:22:48.370415 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46961bc2-76bc-402f-9d93-496c0c12d8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:22:48.370697 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46961bc2-76bc-402f-9d93-496c0c12d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:22:48.370973 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46961bc2-76bc-402f-9d93-496c0c12d8dd admin admin] PATH_INFO: `/v3/projects/22a27482ebba49ab8d71911c88376fca` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:22:48.372203 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46961bc2-76bc-402f-9d93-496c0c12d8dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a27482ebba49ab8d71911c88376fca)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:22:48.374095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46961bc2-76bc-402f-9d93-496c0c12d8dd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:22:48.420560 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-46961bc2-76bc-402f-9d93-496c0c12d8dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a27482ebba49ab8d71911c88376fca', 'request_id': 'req-46961bc2-76bc-402f-9d93-496c0c12d8dd'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:48.426447 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-46961bc2-76bc-402f-9d93-496c0c12d8dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a27482ebba49ab8d71911c88376fca', 'request_id': 'req-46961bc2-76bc-402f-9d93-496c0c12d8dd'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:48.433760 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-46961bc2-76bc-402f-9d93-496c0c12d8dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a27482ebba49ab8d71911c88376fca', 'request_id': 'req-46961bc2-76bc-402f-9d93-496c0c12d8dd'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:48.444668 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-46961bc2-76bc-402f-9d93-496c0c12d8dd admin admin] The token cache is being invalidate because project 22a27482ebba49ab8d71911c88376fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:22:48.445009 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-46961bc2-76bc-402f-9d93-496c0c12d8dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:48.445663 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-46961bc2-76bc-402f-9d93-496c0c12d8dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:22:48.447250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1360/2731] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:22:48 2022] DELETE /identity/v3/projects/22a27482ebba49ab8d71911c88376fca => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:22:58.122197 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:58.441514 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:23:14.653159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016db8a-38d0-4c00-9fa9-0a975c082d5f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:23:14.654583 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0016db8a-38d0-4c00-9fa9-0a975c082d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:23:14.743544 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016db8a-38d0-4c00-9fa9-0a975c082d5f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:23:14.802276 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6fcdd-4d86-4f48-93b7-bb35d43b2b15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cccb366fc6429e9a30d4f9de64e8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:23:14.802931 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6fcdd-4d86-4f48-93b7-bb35d43b2b15 service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:23:14.803220 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6fcdd-4d86-4f48-93b7-bb35d43b2b15 service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:23:14.803500 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6fcdd-4d86-4f48-93b7-bb35d43b2b15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:23:14.805309 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7ec6fcdd-4d86-4f48-93b7-bb35d43b2b15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:23:14.816427 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6fcdd-4d86-4f48-93b7-bb35d43b2b15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:23:14.818008 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6fcdd-4d86-4f48-93b7-bb35d43b2b15 service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:23:14.827959 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1372/2732] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:23:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:23:24.823570 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=67 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:23.774098 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46961bc2-76bc-402f-9d93-496c0c12d8dd admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:23.775547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-46961bc2-76bc-402f-9d93-496c0c12d8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:23.832008 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46961bc2-76bc-402f-9d93-496c0c12d8dd admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:23.835564 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eedf64-37b7-481a-89c8-203728b88c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:23.836247 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eedf64-37b7-481a-89c8-203728b88c69 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:23.836533 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eedf64-37b7-481a-89c8-203728b88c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:23.836811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eedf64-37b7-481a-89c8-203728b88c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:23.838548 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-92eedf64-37b7-481a-89c8-203728b88c69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:23.895688 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eedf64-37b7-481a-89c8-203728b88c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:23.897144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eedf64-37b7-481a-89c8-203728b88c69 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:23.905803 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1361/2733] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:24:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:24:25.152120 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6fcdd-4d86-4f48-93b7-bb35d43b2b15 service placement] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:25.154217 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7ec6fcdd-4d86-4f48-93b7-bb35d43b2b15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:25.168069 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6fcdd-4d86-4f48-93b7-bb35d43b2b15 service placement] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:25.172170 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf37df9-b450-4ee8-a959-52d206346ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:25.173092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf37df9-b450-4ee8-a959-52d206346ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:25.173092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf37df9-b450-4ee8-a959-52d206346ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:25.173375 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf37df9-b450-4ee8-a959-52d206346ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:25.175196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3bf37df9-b450-4ee8-a959-52d206346ce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:25.271148 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf37df9-b450-4ee8-a959-52d206346ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:25.272548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf37df9-b450-4ee8-a959-52d206346ce7 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:25.294709 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1373/2734] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:24:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:24:26.485350 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eedf64-37b7-481a-89c8-203728b88c69 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:26.494274 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eedf64-37b7-481a-89c8-203728b88c69 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:26.497961 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3673c65-738e-40fe-855a-8db28124b991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:26.498599 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3673c65-738e-40fe-855a-8db28124b991 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:26.498886 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3673c65-738e-40fe-855a-8db28124b991 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:26.499166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3673c65-738e-40fe-855a-8db28124b991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:26.500967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c3673c65-738e-40fe-855a-8db28124b991 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:26.514189 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3673c65-738e-40fe-855a-8db28124b991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:26.515610 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3673c65-738e-40fe-855a-8db28124b991 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:26.527379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1362/2735] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:24:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:24:28.989205 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf37df9-b450-4ee8-a959-52d206346ce7 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:28.998738 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf37df9-b450-4ee8-a959-52d206346ce7 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:29.002471 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5a95a-fe59-47e3-ac20-4d9daa82f5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:29.003052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5a95a-fe59-47e3-ac20-4d9daa82f5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:29.003943 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5a95a-fe59-47e3-ac20-4d9daa82f5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:29.004239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5a95a-fe59-47e3-ac20-4d9daa82f5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:29.006104 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8ea5a95a-fe59-47e3-ac20-4d9daa82f5a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:29.069298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5a95a-fe59-47e3-ac20-4d9daa82f5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:29.070743 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5a95a-fe59-47e3-ac20-4d9daa82f5a3 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:29.080456 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1374/2736] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:24:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:24:34.922014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3673c65-738e-40fe-855a-8db28124b991 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:34.923464 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c3673c65-738e-40fe-855a-8db28124b991 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:34.939453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3673c65-738e-40fe-855a-8db28124b991 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:34.944829 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1c027-988c-4d3e-ad45-87f763f8dded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:34.945693 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1c027-988c-4d3e-ad45-87f763f8dded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:34.945978 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1c027-988c-4d3e-ad45-87f763f8dded admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:34.946256 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1c027-988c-4d3e-ad45-87f763f8dded admin admin] PATH_INFO: `/v3/users/9778bd2585c8469399ce4b2a5db1c6ff` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:34.947428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1c027-988c-4d3e-ad45-87f763f8dded admin admin] RBAC: Authorizing `identity:delete_user(user_id=9778bd2585c8469399ce4b2a5db1c6ff)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:34.949369 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1c027-988c-4d3e-ad45-87f763f8dded admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:34.995755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3cc1c027-988c-4d3e-ad45-87f763f8dded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9778bd2585c8469399ce4b2a5db1c6ff'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.003312 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3cc1c027-988c-4d3e-ad45-87f763f8dded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9778bd2585c8469399ce4b2a5db1c6ff'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.010303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3cc1c027-988c-4d3e-ad45-87f763f8dded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9778bd2585c8469399ce4b2a5db1c6ff'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.010926 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3cc1c027-988c-4d3e-ad45-87f763f8dded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9778bd2585c8469399ce4b2a5db1c6ff'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.011549 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3cc1c027-988c-4d3e-ad45-87f763f8dded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9778bd2585c8469399ce4b2a5db1c6ff'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.028688 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1363/2737] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:24:34 2022] DELETE /identity/v3/users/9778bd2585c8469399ce4b2a5db1c6ff => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:24:35.197239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5a95a-fe59-47e3-ac20-4d9daa82f5a3 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:35.215096 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5a95a-fe59-47e3-ac20-4d9daa82f5a3 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:35.271817 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d3c85-fa5e-42f4-9ad9-bba660695eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:35.272723 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3c85-fa5e-42f4-9ad9-bba660695eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:35.273010 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3c85-fa5e-42f4-9ad9-bba660695eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:35.273316 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3c85-fa5e-42f4-9ad9-bba660695eda admin admin] PATH_INFO: `/v3/projects/59e0b3baca5648c9a20ca57e0529a7c7` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:35.274802 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d3c85-fa5e-42f4-9ad9-bba660695eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=59e0b3baca5648c9a20ca57e0529a7c7)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:35.277067 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d3c85-fa5e-42f4-9ad9-bba660695eda admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:35.278746 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:35.326639 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b30d3c85-fa5e-42f4-9ad9-bba660695eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59e0b3baca5648c9a20ca57e0529a7c7', 'request_id': 'req-b30d3c85-fa5e-42f4-9ad9-bba660695eda'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.333907 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b30d3c85-fa5e-42f4-9ad9-bba660695eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59e0b3baca5648c9a20ca57e0529a7c7', 'request_id': 'req-b30d3c85-fa5e-42f4-9ad9-bba660695eda'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.340268 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b30d3c85-fa5e-42f4-9ad9-bba660695eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59e0b3baca5648c9a20ca57e0529a7c7', 'request_id': 'req-b30d3c85-fa5e-42f4-9ad9-bba660695eda'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.351215 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b30d3c85-fa5e-42f4-9ad9-bba660695eda admin admin] The token cache is being invalidate because project 59e0b3baca5648c9a20ca57e0529a7c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:24:35.351492 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b30d3c85-fa5e-42f4-9ad9-bba660695eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.352158 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b30d3c85-fa5e-42f4-9ad9-bba660695eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.353717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1375/2738] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:24:35 2022] DELETE /identity/v3/projects/59e0b3baca5648c9a20ca57e0529a7c7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:24:35.357665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1c027-988c-4d3e-ad45-87f763f8dded admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:35.359054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3cc1c027-988c-4d3e-ad45-87f763f8dded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:35.372581 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1c027-988c-4d3e-ad45-87f763f8dded admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:35.381371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:35.430185 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed5ee4-4459-4fd3-ab55-63593b610592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:35.431053 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed5ee4-4459-4fd3-ab55-63593b610592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:35.431335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed5ee4-4459-4fd3-ab55-63593b610592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:35.431610 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed5ee4-4459-4fd3-ab55-63593b610592 admin admin] PATH_INFO: `/v3/users/976b3335cbb1490b8992c2c3ff067bd2` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:35.432831 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed5ee4-4459-4fd3-ab55-63593b610592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=976b3335cbb1490b8992c2c3ff067bd2)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:35.434775 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed5ee4-4459-4fd3-ab55-63593b610592 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:35.479500 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-98ed5ee4-4459-4fd3-ab55-63593b610592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '976b3335cbb1490b8992c2c3ff067bd2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.486138 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-98ed5ee4-4459-4fd3-ab55-63593b610592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '976b3335cbb1490b8992c2c3ff067bd2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.492930 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-98ed5ee4-4459-4fd3-ab55-63593b610592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '976b3335cbb1490b8992c2c3ff067bd2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.493607 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-98ed5ee4-4459-4fd3-ab55-63593b610592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '976b3335cbb1490b8992c2c3ff067bd2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.494225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-98ed5ee4-4459-4fd3-ab55-63593b610592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '976b3335cbb1490b8992c2c3ff067bd2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.511614 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1364/2739] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:24:35 2022] DELETE /identity/v3/users/976b3335cbb1490b8992c2c3ff067bd2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:24:35.683279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d3c85-fa5e-42f4-9ad9-bba660695eda admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:35.684802 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b30d3c85-fa5e-42f4-9ad9-bba660695eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:35.697982 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d3c85-fa5e-42f4-9ad9-bba660695eda admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:35.756952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c9266-14f9-4f7f-9682-97c77f71d1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:35.757765 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c9266-14f9-4f7f-9682-97c77f71d1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:35.758052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c9266-14f9-4f7f-9682-97c77f71d1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:35.758332 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c9266-14f9-4f7f-9682-97c77f71d1d7 admin admin] PATH_INFO: `/v3/projects/63b225219d2f4c4394f589b0892ec958` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:35.759602 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c9266-14f9-4f7f-9682-97c77f71d1d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63b225219d2f4c4394f589b0892ec958)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:35.761586 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c9266-14f9-4f7f-9682-97c77f71d1d7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:35.807814 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c23c9266-14f9-4f7f-9682-97c77f71d1d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63b225219d2f4c4394f589b0892ec958', 'request_id': 'req-c23c9266-14f9-4f7f-9682-97c77f71d1d7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.814778 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c23c9266-14f9-4f7f-9682-97c77f71d1d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63b225219d2f4c4394f589b0892ec958', 'request_id': 'req-c23c9266-14f9-4f7f-9682-97c77f71d1d7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.821552 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c23c9266-14f9-4f7f-9682-97c77f71d1d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63b225219d2f4c4394f589b0892ec958', 'request_id': 'req-c23c9266-14f9-4f7f-9682-97c77f71d1d7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.832222 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c23c9266-14f9-4f7f-9682-97c77f71d1d7 admin admin] The token cache is being invalidate because project 63b225219d2f4c4394f589b0892ec958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:24:35.832514 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c23c9266-14f9-4f7f-9682-97c77f71d1d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.833141 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c23c9266-14f9-4f7f-9682-97c77f71d1d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:24:35.835121 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1376/2740] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:24:35 2022] DELETE /identity/v3/projects/63b225219d2f4c4394f589b0892ec958 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:24:45.508127 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=47,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:45.828721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=75,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:56.241632 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086b9c6-3814-475f-9558-26fac8ed3326 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:56.242134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086b9c6-3814-475f-9558-26fac8ed3326 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:56.242238 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086b9c6-3814-475f-9558-26fac8ed3326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:56.259808 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d086b9c6-3814-475f-9558-26fac8ed3326 None None] MFA Rules not processed for user `66a9a7d0456a45049b29216b3d0f89c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:24:56.261041 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d086b9c6-3814-475f-9558-26fac8ed3326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:56.316688 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1365/2741] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:24:56.614324 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c9266-14f9-4f7f-9682-97c77f71d1d7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:56.615815 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c23c9266-14f9-4f7f-9682-97c77f71d1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:56.674494 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c9266-14f9-4f7f-9682-97c77f71d1d7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:56.678248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bf5c2-fc42-4d9b-bc60-6e3bba782d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:56.678977 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bf5c2-fc42-4d9b-bc60-6e3bba782d8b service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:56.679325 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bf5c2-fc42-4d9b-bc60-6e3bba782d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:56.679673 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bf5c2-fc42-4d9b-bc60-6e3bba782d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:56.681839 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-624bf5c2-fc42-4d9b-bc60-6e3bba782d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:56.692794 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624bf5c2-fc42-4d9b-bc60-6e3bba782d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:56.694296 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624bf5c2-fc42-4d9b-bc60-6e3bba782d8b service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:56.702827 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1377/2742] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:24:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:24:59.788002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086b9c6-3814-475f-9558-26fac8ed3326 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:24:59.789602 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d086b9c6-3814-475f-9558-26fac8ed3326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:59.802246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086b9c6-3814-475f-9558-26fac8ed3326 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:24:59.805969 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d9bb9-a6e2-4eb0-bf9d-8a16fbaf06bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:24:59.806635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d9bb9-a6e2-4eb0-bf9d-8a16fbaf06bb service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:24:59.806925 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d9bb9-a6e2-4eb0-bf9d-8a16fbaf06bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:24:59.807206 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d9bb9-a6e2-4eb0-bf9d-8a16fbaf06bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:24:59.809035 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7a7d9bb9-a6e2-4eb0-bf9d-8a16fbaf06bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:24:59.819946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d9bb9-a6e2-4eb0-bf9d-8a16fbaf06bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:24:59.821400 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d9bb9-a6e2-4eb0-bf9d-8a16fbaf06bb service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:24:59.831469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1366/2743] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:24:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:25:06.699635 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=26 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:09.826760 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=31 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:23.900097 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bf5c2-fc42-4d9b-bc60-6e3bba782d8b service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:23.901579 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-624bf5c2-fc42-4d9b-bc60-6e3bba782d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:23.975842 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bf5c2-fc42-4d9b-bc60-6e3bba782d8b service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:23.981429 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00099b2e-0a0d-4151-91a2-6fe94c0332ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:23.982083 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00099b2e-0a0d-4151-91a2-6fe94c0332ef service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:23.982370 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00099b2e-0a0d-4151-91a2-6fe94c0332ef service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:23.982653 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00099b2e-0a0d-4151-91a2-6fe94c0332ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:23.984445 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-00099b2e-0a0d-4151-91a2-6fe94c0332ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:23.995154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00099b2e-0a0d-4151-91a2-6fe94c0332ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:23.996808 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00099b2e-0a0d-4151-91a2-6fe94c0332ef service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:24.005804 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1378/2744] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:26:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:26:34.001717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=34 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:48.643188 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d9bb9-a6e2-4eb0-bf9d-8a16fbaf06bb service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:48.673817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d9bb9-a6e2-4eb0-bf9d-8a16fbaf06bb service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:48.680844 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bc952-2616-454b-a49c-2217063bf38d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:48.681657 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bc952-2616-454b-a49c-2217063bf38d service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:48.682002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bc952-2616-454b-a49c-2217063bf38d service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:48.682287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bc952-2616-454b-a49c-2217063bf38d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:48.684315 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-528bc952-2616-454b-a49c-2217063bf38d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:48.718399 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bc952-2616-454b-a49c-2217063bf38d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:48.720749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bc952-2616-454b-a49c-2217063bf38d service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:48.743404 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1367/2745] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:26:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:26:54.327348 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00099b2e-0a0d-4151-91a2-6fe94c0332ef service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:54.337493 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00099b2e-0a0d-4151-91a2-6fe94c0332ef service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:54.341187 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ba2b8-4ee6-4956-9753-fe3e48a331f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:54.341850 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ba2b8-4ee6-4956-9753-fe3e48a331f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:54.342122 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ba2b8-4ee6-4956-9753-fe3e48a331f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:54.342404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ba2b8-4ee6-4956-9753-fe3e48a331f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:54.344244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-214ba2b8-4ee6-4956-9753-fe3e48a331f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:54.417717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ba2b8-4ee6-4956-9753-fe3e48a331f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:54.419142 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ba2b8-4ee6-4956-9753-fe3e48a331f0 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:54.428610 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1379/2746] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:26:57.308162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bc952-2616-454b-a49c-2217063bf38d service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:57.309993 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-528bc952-2616-454b-a49c-2217063bf38d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:57.327777 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bc952-2616-454b-a49c-2217063bf38d service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:57.332932 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c57a7-739a-4c12-bf33-5f7bed990843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:57.333820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c57a7-739a-4c12-bf33-5f7bed990843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:57.334077 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c57a7-739a-4c12-bf33-5f7bed990843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:57.334350 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c57a7-739a-4c12-bf33-5f7bed990843 admin admin] PATH_INFO: `/v3/users/66a9a7d0456a45049b29216b3d0f89c7` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:57.335637 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c57a7-739a-4c12-bf33-5f7bed990843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a9a7d0456a45049b29216b3d0f89c7)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:57.337634 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c57a7-739a-4c12-bf33-5f7bed990843 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:57.390065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-112c57a7-739a-4c12-bf33-5f7bed990843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a9a7d0456a45049b29216b3d0f89c7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:57.397998 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-112c57a7-739a-4c12-bf33-5f7bed990843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a9a7d0456a45049b29216b3d0f89c7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:57.405912 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-112c57a7-739a-4c12-bf33-5f7bed990843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a9a7d0456a45049b29216b3d0f89c7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:57.407004 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-112c57a7-739a-4c12-bf33-5f7bed990843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a9a7d0456a45049b29216b3d0f89c7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:57.407938 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-112c57a7-739a-4c12-bf33-5f7bed990843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a9a7d0456a45049b29216b3d0f89c7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:57.430125 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1368/2747] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:26:57 2022] DELETE /identity/v3/users/66a9a7d0456a45049b29216b3d0f89c7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:26:57.608758 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ba2b8-4ee6-4956-9753-fe3e48a331f0 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:57.625814 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ba2b8-4ee6-4956-9753-fe3e48a331f0 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:57.691324 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fad53f-4138-4a81-bcea-e999f0dcb331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:57.692226 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad53f-4138-4a81-bcea-e999f0dcb331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:57.692521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad53f-4138-4a81-bcea-e999f0dcb331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:57.692847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad53f-4138-4a81-bcea-e999f0dcb331 admin admin] PATH_INFO: `/v3/projects/e168e4c51b294ece9801b8aab0699afe` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:57.694196 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fad53f-4138-4a81-bcea-e999f0dcb331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e168e4c51b294ece9801b8aab0699afe)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:57.696151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fad53f-4138-4a81-bcea-e999f0dcb331 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:57.741257 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-42fad53f-4138-4a81-bcea-e999f0dcb331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e168e4c51b294ece9801b8aab0699afe', 'request_id': 'req-42fad53f-4138-4a81-bcea-e999f0dcb331'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:57.748250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-42fad53f-4138-4a81-bcea-e999f0dcb331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e168e4c51b294ece9801b8aab0699afe', 'request_id': 'req-42fad53f-4138-4a81-bcea-e999f0dcb331'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:57.755313 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-42fad53f-4138-4a81-bcea-e999f0dcb331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e168e4c51b294ece9801b8aab0699afe', 'request_id': 'req-42fad53f-4138-4a81-bcea-e999f0dcb331'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:57.766172 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-42fad53f-4138-4a81-bcea-e999f0dcb331 admin admin] The token cache is being invalidate because project e168e4c51b294ece9801b8aab0699afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:26:57.766465 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-42fad53f-4138-4a81-bcea-e999f0dcb331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:57.767093 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-42fad53f-4138-4a81-bcea-e999f0dcb331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:26:57.768658 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1380/2748] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:26:57 2022] DELETE /identity/v3/projects/e168e4c51b294ece9801b8aab0699afe => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:26:57.773653 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214161a-d772-4352-8156-b554171c44b7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:57.773948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214161a-d772-4352-8156-b554171c44b7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:57.774233 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214161a-d772-4352-8156-b554171c44b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:57.798288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1214161a-d772-4352-8156-b554171c44b7 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:57.799419 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1214161a-d772-4352-8156-b554171c44b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:57.857985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1369/2749] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:57.866534 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd56c4-0efc-4e69-8b5f-67d76188cd8f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:57.866837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd56c4-0efc-4e69-8b5f-67d76188cd8f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:57.867111 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd56c4-0efc-4e69-8b5f-67d76188cd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:57.885338 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-73dd56c4-0efc-4e69-8b5f-67d76188cd8f None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:57.886556 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-73dd56c4-0efc-4e69-8b5f-67d76188cd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:57.894614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1381/2750] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:57.898904 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214161a-d772-4352-8156-b554171c44b7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:57.909356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214161a-d772-4352-8156-b554171c44b7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:57.914075 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b368f8-7616-463e-a608-7220568ff66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:57.914718 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b368f8-7616-463e-a608-7220568ff66d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:57.914998 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b368f8-7616-463e-a608-7220568ff66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:57.915273 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b368f8-7616-463e-a608-7220568ff66d admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:57.916025 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b368f8-7616-463e-a608-7220568ff66d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:26:57.916333 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b368f8-7616-463e-a608-7220568ff66d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:57.917921 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b368f8-7616-463e-a608-7220568ff66d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:57.929711 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1370/2751] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:26:57.933841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd56c4-0efc-4e69-8b5f-67d76188cd8f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:57.943278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd56c4-0efc-4e69-8b5f-67d76188cd8f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:57.947960 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c94852-27ce-4a98-a1a7-7bdfd12c495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:57.948612 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c94852-27ce-4a98-a1a7-7bdfd12c495e admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:57.948899 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c94852-27ce-4a98-a1a7-7bdfd12c495e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:57.949183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c94852-27ce-4a98-a1a7-7bdfd12c495e admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:57.949872 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c94852-27ce-4a98-a1a7-7bdfd12c495e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:57.951763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c94852-27ce-4a98-a1a7-7bdfd12c495e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:57.965621 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:57.979209 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1382/2752] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:26:57 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:26:57.983458 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b368f8-7616-463e-a608-7220568ff66d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:57.994682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b368f8-7616-463e-a608-7220568ff66d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:58.038227 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:58.053303 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b36f6d-d41d-4485-ad50-8f369de79bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:58.053919 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b36f6d-d41d-4485-ad50-8f369de79bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:58.054231 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b36f6d-d41d-4485-ad50-8f369de79bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:58.054513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b36f6d-d41d-4485-ad50-8f369de79bd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:58.055224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b36f6d-d41d-4485-ad50-8f369de79bd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:58.057186 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b36f6d-d41d-4485-ad50-8f369de79bd7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:58.076665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1371/2753] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:26:57 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:26:58.080739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c94852-27ce-4a98-a1a7-7bdfd12c495e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:58.091031 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c94852-27ce-4a98-a1a7-7bdfd12c495e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:58.096249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf8913-2dd1-4d36-bf6c-182e2b80c972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:58.096894 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf8913-2dd1-4d36-bf6c-182e2b80c972 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:58.097183 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf8913-2dd1-4d36-bf6c-182e2b80c972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:58.097465 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf8913-2dd1-4d36-bf6c-182e2b80c972 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:58.098193 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf8913-2dd1-4d36-bf6c-182e2b80c972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:58.099856 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf8913-2dd1-4d36-bf6c-182e2b80c972 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:58.111371 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1383/2754] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:26:58.115292 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b36f6d-d41d-4485-ad50-8f369de79bd7 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:58.125449 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b36f6d-d41d-4485-ad50-8f369de79bd7 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:58.130073 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821e3d7-19ae-4cf5-941f-542a944a3115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:58.130728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821e3d7-19ae-4cf5-941f-542a944a3115 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:58.131011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821e3d7-19ae-4cf5-941f-542a944a3115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:58.131291 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821e3d7-19ae-4cf5-941f-542a944a3115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:58.132051 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821e3d7-19ae-4cf5-941f-542a944a3115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:58.133644 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821e3d7-19ae-4cf5-941f-542a944a3115 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:58.143613 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1372/2755] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:26:58.147702 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf8913-2dd1-4d36-bf6c-182e2b80c972 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:58.158325 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf8913-2dd1-4d36-bf6c-182e2b80c972 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:58.163184 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a2856-a8d4-443f-aa4e-eefa1d5788c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:58.164090 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a2856-a8d4-443f-aa4e-eefa1d5788c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:58.164376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a2856-a8d4-443f-aa4e-eefa1d5788c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:58.164654 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a2856-a8d4-443f-aa4e-eefa1d5788c9 admin admin] PATH_INFO: `/v3/projects/cd1c8c321996493ab5ea2d9b121249d5/users/8fea3b8bc1744b249774fb4b8a237716/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:58.179425 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a2856-a8d4-443f-aa4e-eefa1d5788c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1c8c321996493ab5ea2d9b121249d5, user_id=8fea3b8bc1744b249774fb4b8a237716, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:58.182148 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a2856-a8d4-443f-aa4e-eefa1d5788c9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:58.194823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1384/2756] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:26:58 2022] PUT /identity/v3/projects/cd1c8c321996493ab5ea2d9b121249d5/users/8fea3b8bc1744b249774fb4b8a237716/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:26:58.205363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bc63c-3345-4c78-b401-af7cc891c6e8 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:58.205665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bc63c-3345-4c78-b401-af7cc891c6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:58.205951 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bc63c-3345-4c78-b401-af7cc891c6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:58.232669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b58bc63c-3345-4c78-b401-af7cc891c6e8 None None] MFA Rules not processed for user `8fea3b8bc1744b249774fb4b8a237716`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:26:58.233891 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b58bc63c-3345-4c78-b401-af7cc891c6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:58.297630 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1373/2757] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:26:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:26:58.309413 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a2856-a8d4-443f-aa4e-eefa1d5788c9 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:26:58.311098 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e81a2856-a8d4-443f-aa4e-eefa1d5788c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:26:58.384375 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a2856-a8d4-443f-aa4e-eefa1d5788c9 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:26:58.389974 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d224b-e879-48d2-b666-3ac6fb577c19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:26:58.391148 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d224b-e879-48d2-b666-3ac6fb577c19 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:26:58.391440 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d224b-e879-48d2-b666-3ac6fb577c19 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:26:58.391725 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d224b-e879-48d2-b666-3ac6fb577c19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:26:58.399486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d224b-e879-48d2-b666-3ac6fb577c19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:26:58.401112 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d224b-e879-48d2-b666-3ac6fb577c19 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:26:58.410702 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1385/2758] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:26:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:27:01.074723 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bc63c-3345-4c78-b401-af7cc891c6e8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:01.135299 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bc63c-3345-4c78-b401-af7cc891c6e8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:01.139847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23a01b-10ae-41ca-ba28-1ac75ed7a063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:01.141138 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23a01b-10ae-41ca-ba28-1ac75ed7a063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:01.141906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23a01b-10ae-41ca-ba28-1ac75ed7a063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:01.142177 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23a01b-10ae-41ca-ba28-1ac75ed7a063 admin admin] PATH_INFO: `/v3/users/8fea3b8bc1744b249774fb4b8a237716` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:01.143389 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23a01b-10ae-41ca-ba28-1ac75ed7a063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fea3b8bc1744b249774fb4b8a237716)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:01.145347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23a01b-10ae-41ca-ba28-1ac75ed7a063 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:01.194937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-be23a01b-10ae-41ca-ba28-1ac75ed7a063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fea3b8bc1744b249774fb4b8a237716'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:01.201654 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-be23a01b-10ae-41ca-ba28-1ac75ed7a063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fea3b8bc1744b249774fb4b8a237716'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:01.204011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:01.210320 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-be23a01b-10ae-41ca-ba28-1ac75ed7a063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fea3b8bc1744b249774fb4b8a237716'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:01.211411 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-be23a01b-10ae-41ca-ba28-1ac75ed7a063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fea3b8bc1744b249774fb4b8a237716'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:01.212134 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-be23a01b-10ae-41ca-ba28-1ac75ed7a063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fea3b8bc1744b249774fb4b8a237716'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:01.236908 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1374/2759] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:27:01 2022] DELETE /identity/v3/users/8fea3b8bc1744b249774fb4b8a237716 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:01.241478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd5b7d-c36e-48c2-be5b-494b6169ecac None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:01.241937 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd5b7d-c36e-48c2-be5b-494b6169ecac None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:01.242075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd5b7d-c36e-48c2-be5b-494b6169ecac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:01.259620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-94bd5b7d-c36e-48c2-be5b-494b6169ecac None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:01.260854 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-94bd5b7d-c36e-48c2-be5b-494b6169ecac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:01.319439 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1386/2760] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:01.329225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23a01b-10ae-41ca-ba28-1ac75ed7a063 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:01.330615 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-be23a01b-10ae-41ca-ba28-1ac75ed7a063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:01.388359 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23a01b-10ae-41ca-ba28-1ac75ed7a063 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:01.392018 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2a68c-cc6e-4670-95e9-1e6416406000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:01.392680 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2a68c-cc6e-4670-95e9-1e6416406000 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:01.392958 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2a68c-cc6e-4670-95e9-1e6416406000 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:01.393240 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2a68c-cc6e-4670-95e9-1e6416406000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:01.402137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2a68c-cc6e-4670-95e9-1e6416406000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:01.403576 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2a68c-cc6e-4670-95e9-1e6416406000 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:01.413250 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1375/2761] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:27:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:27:01.679186 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd5b7d-c36e-48c2-be5b-494b6169ecac None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:01.680698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-94bd5b7d-c36e-48c2-be5b-494b6169ecac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:01.693497 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd5b7d-c36e-48c2-be5b-494b6169ecac None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:01.698370 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd050dc-1166-4619-9261-6e60f1f7de62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:01.699935 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd050dc-1166-4619-9261-6e60f1f7de62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:01.700600 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd050dc-1166-4619-9261-6e60f1f7de62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:01.700928 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd050dc-1166-4619-9261-6e60f1f7de62 admin admin] PATH_INFO: `/v3/projects/cd1c8c321996493ab5ea2d9b121249d5` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:01.702169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd050dc-1166-4619-9261-6e60f1f7de62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd1c8c321996493ab5ea2d9b121249d5)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:01.704153 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd050dc-1166-4619-9261-6e60f1f7de62 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:01.747886 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:01.754579 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bcd050dc-1166-4619-9261-6e60f1f7de62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd1c8c321996493ab5ea2d9b121249d5', 'request_id': 'req-bcd050dc-1166-4619-9261-6e60f1f7de62'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:01.762837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bcd050dc-1166-4619-9261-6e60f1f7de62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd1c8c321996493ab5ea2d9b121249d5', 'request_id': 'req-bcd050dc-1166-4619-9261-6e60f1f7de62'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:01.769173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bcd050dc-1166-4619-9261-6e60f1f7de62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd1c8c321996493ab5ea2d9b121249d5', 'request_id': 'req-bcd050dc-1166-4619-9261-6e60f1f7de62'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:01.779487 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bcd050dc-1166-4619-9261-6e60f1f7de62 admin admin] The token cache is being invalidate because project cd1c8c321996493ab5ea2d9b121249d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:27:01.779781 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bcd050dc-1166-4619-9261-6e60f1f7de62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:01.780503 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bcd050dc-1166-4619-9261-6e60f1f7de62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:01.782599 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1387/2762] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:27:01 2022] DELETE /identity/v3/projects/cd1c8c321996493ab5ea2d9b121249d5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:01.787746 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506c7f8-6037-4bf3-b666-30a07b9e5b55 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:01.788078 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506c7f8-6037-4bf3-b666-30a07b9e5b55 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:01.788366 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506c7f8-6037-4bf3-b666-30a07b9e5b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:01.806242 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e506c7f8-6037-4bf3-b666-30a07b9e5b55 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:01.807445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e506c7f8-6037-4bf3-b666-30a07b9e5b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:01.866152 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1376/2763] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:27:01.874802 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708686a1-6dee-49cd-93d8-ef45067fce43 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:01.875109 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708686a1-6dee-49cd-93d8-ef45067fce43 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:01.875400 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708686a1-6dee-49cd-93d8-ef45067fce43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:01.893641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-708686a1-6dee-49cd-93d8-ef45067fce43 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:01.894847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-708686a1-6dee-49cd-93d8-ef45067fce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:01.902714 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1388/2764] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:01.907259 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506c7f8-6037-4bf3-b666-30a07b9e5b55 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:01.917354 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506c7f8-6037-4bf3-b666-30a07b9e5b55 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:01.922552 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca8b9a-2a0d-4315-9f2b-f49c91a8bd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:01.923202 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca8b9a-2a0d-4315-9f2b-f49c91a8bd8b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:01.923491 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca8b9a-2a0d-4315-9f2b-f49c91a8bd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:01.923772 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca8b9a-2a0d-4315-9f2b-f49c91a8bd8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:01.924648 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca8b9a-2a0d-4315-9f2b-f49c91a8bd8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:27:01.924964 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca8b9a-2a0d-4315-9f2b-f49c91a8bd8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:01.926557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca8b9a-2a0d-4315-9f2b-f49c91a8bd8b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:01.938074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1377/2765] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:27:01.942101 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708686a1-6dee-49cd-93d8-ef45067fce43 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:01.951248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708686a1-6dee-49cd-93d8-ef45067fce43 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:01.956846 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb76f7-534a-43a6-9511-0593c1d2ed4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:01.957505 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb76f7-534a-43a6-9511-0593c1d2ed4b admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:01.957792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb76f7-534a-43a6-9511-0593c1d2ed4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:01.958070 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb76f7-534a-43a6-9511-0593c1d2ed4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:01.958776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb76f7-534a-43a6-9511-0593c1d2ed4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:01.960775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb76f7-534a-43a6-9511-0593c1d2ed4b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:01.986101 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1389/2766] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:27:01 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:27:01.990178 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca8b9a-2a0d-4315-9f2b-f49c91a8bd8b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:01.999962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca8b9a-2a0d-4315-9f2b-f49c91a8bd8b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:02.055552 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc24d54-55bc-4d70-96d7-25426f827903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:02.056242 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc24d54-55bc-4d70-96d7-25426f827903 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:02.056529 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc24d54-55bc-4d70-96d7-25426f827903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:02.056835 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc24d54-55bc-4d70-96d7-25426f827903 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:02.057517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc24d54-55bc-4d70-96d7-25426f827903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:02.059455 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc24d54-55bc-4d70-96d7-25426f827903 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:02.068167 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:02.080728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1378/2767] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:27:01 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:27:02.084844 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb76f7-534a-43a6-9511-0593c1d2ed4b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:02.095498 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb76f7-534a-43a6-9511-0593c1d2ed4b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:02.100162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcb2ff-ef71-4b21-818c-51426f441506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:02.100796 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcb2ff-ef71-4b21-818c-51426f441506 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:02.101086 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcb2ff-ef71-4b21-818c-51426f441506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:02.101355 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcb2ff-ef71-4b21-818c-51426f441506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:02.102124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcb2ff-ef71-4b21-818c-51426f441506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:02.103712 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcb2ff-ef71-4b21-818c-51426f441506 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:02.114037 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1390/2768] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:27:02.117788 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc24d54-55bc-4d70-96d7-25426f827903 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:02.127476 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc24d54-55bc-4d70-96d7-25426f827903 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:02.132117 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705ac2d-d35e-4680-8cd7-725cf2d98701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:02.132766 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705ac2d-d35e-4680-8cd7-725cf2d98701 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:02.133054 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705ac2d-d35e-4680-8cd7-725cf2d98701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:02.133335 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705ac2d-d35e-4680-8cd7-725cf2d98701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:02.134063 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705ac2d-d35e-4680-8cd7-725cf2d98701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:02.135664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705ac2d-d35e-4680-8cd7-725cf2d98701 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:02.145850 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1379/2769] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:27:02.150159 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcb2ff-ef71-4b21-818c-51426f441506 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:02.160949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcb2ff-ef71-4b21-818c-51426f441506 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:02.165604 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577af16-e0fa-4e56-bc29-62a97eeaf4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:02.166476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577af16-e0fa-4e56-bc29-62a97eeaf4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:02.166762 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577af16-e0fa-4e56-bc29-62a97eeaf4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:02.167040 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577af16-e0fa-4e56-bc29-62a97eeaf4f0 admin admin] PATH_INFO: `/v3/projects/b753ee63755248ffa5f206b37bdd7336/users/6b6acb046e4c4f45b05719d86bc57492/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:02.181283 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577af16-e0fa-4e56-bc29-62a97eeaf4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b753ee63755248ffa5f206b37bdd7336, user_id=6b6acb046e4c4f45b05719d86bc57492, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:02.183951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577af16-e0fa-4e56-bc29-62a97eeaf4f0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:02.196647 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1391/2770] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:27:02 2022] PUT /identity/v3/projects/b753ee63755248ffa5f206b37bdd7336/users/6b6acb046e4c4f45b05719d86bc57492/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:02.207245 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275c7f-dd09-42e4-974e-31e76bcfdbd9 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:02.207542 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275c7f-dd09-42e4-974e-31e76bcfdbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:02.207824 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275c7f-dd09-42e4-974e-31e76bcfdbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:02.234371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-34275c7f-dd09-42e4-974e-31e76bcfdbd9 None None] MFA Rules not processed for user `6b6acb046e4c4f45b05719d86bc57492`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:02.235577 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-34275c7f-dd09-42e4-974e-31e76bcfdbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:02.302297 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1380/2771] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:02.307154 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577af16-e0fa-4e56-bc29-62a97eeaf4f0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:02.369288 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577af16-e0fa-4e56-bc29-62a97eeaf4f0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:02.373891 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4804b77-2422-425d-97a2-8c4f820e5741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:02.374563 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4804b77-2422-425d-97a2-8c4f820e5741 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:02.374852 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4804b77-2422-425d-97a2-8c4f820e5741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:02.375619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4804b77-2422-425d-97a2-8c4f820e5741 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:02.376363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4804b77-2422-425d-97a2-8c4f820e5741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:02.378268 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4804b77-2422-425d-97a2-8c4f820e5741 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:02.405198 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1392/2772] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:27:02 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:27:02.409525 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34275c7f-dd09-42e4-974e-31e76bcfdbd9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:02.419940 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34275c7f-dd09-42e4-974e-31e76bcfdbd9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:02.476508 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5506cc-2414-4b54-8b96-e9923a49f262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:02.477184 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5506cc-2414-4b54-8b96-e9923a49f262 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:02.477470 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5506cc-2414-4b54-8b96-e9923a49f262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:02.477748 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5506cc-2414-4b54-8b96-e9923a49f262 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:02.478451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5506cc-2414-4b54-8b96-e9923a49f262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:02.480387 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5506cc-2414-4b54-8b96-e9923a49f262 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:02.499664 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1381/2773] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:27:02 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:27:02.504075 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4804b77-2422-425d-97a2-8c4f820e5741 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:02.514360 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4804b77-2422-425d-97a2-8c4f820e5741 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:02.519615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad13ad5-d696-470b-a26c-0ecf521bdd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:02.520312 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad13ad5-d696-470b-a26c-0ecf521bdd8c admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:02.520604 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad13ad5-d696-470b-a26c-0ecf521bdd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:02.520888 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad13ad5-d696-470b-a26c-0ecf521bdd8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:02.521620 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad13ad5-d696-470b-a26c-0ecf521bdd8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:02.523218 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad13ad5-d696-470b-a26c-0ecf521bdd8c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:02.533913 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1393/2774] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:27:02.537639 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5506cc-2414-4b54-8b96-e9923a49f262 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:02.548166 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5506cc-2414-4b54-8b96-e9923a49f262 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:02.552818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ca628-c4ed-4377-bb80-f235db9adec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:02.553688 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ca628-c4ed-4377-bb80-f235db9adec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:02.553978 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ca628-c4ed-4377-bb80-f235db9adec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:02.554257 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ca628-c4ed-4377-bb80-f235db9adec8 admin admin] PATH_INFO: `/v3/projects/f444166ee65e4d79b2d2c1d1c484b65f/users/f93ae608de25491483fdb42e61580b56/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:02.569275 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ca628-c4ed-4377-bb80-f235db9adec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f444166ee65e4d79b2d2c1d1c484b65f, user_id=f93ae608de25491483fdb42e61580b56, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:02.571943 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ca628-c4ed-4377-bb80-f235db9adec8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:02.586480 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1382/2775] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:27:02 2022] PUT /identity/v3/projects/f444166ee65e4d79b2d2c1d1c484b65f/users/f93ae608de25491483fdb42e61580b56/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:02.590546 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad13ad5-d696-470b-a26c-0ecf521bdd8c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:02.600593 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad13ad5-d696-470b-a26c-0ecf521bdd8c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:02.638005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:02.658045 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ba1b3-0ff8-431d-a0cb-36089e48db0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:02.658967 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ba1b3-0ff8-431d-a0cb-36089e48db0d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:02.659250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ba1b3-0ff8-431d-a0cb-36089e48db0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:02.659524 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ba1b3-0ff8-431d-a0cb-36089e48db0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:02.660280 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ba1b3-0ff8-431d-a0cb-36089e48db0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:02.661857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ba1b3-0ff8-431d-a0cb-36089e48db0d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:02.671438 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1394/2776] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:27:02.675648 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ca628-c4ed-4377-bb80-f235db9adec8 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:02.685588 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ca628-c4ed-4377-bb80-f235db9adec8 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:02.690629 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d7be2-d90b-4d02-9857-24a9fdee474c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:02.691491 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d7be2-d90b-4d02-9857-24a9fdee474c admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:02.691775 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d7be2-d90b-4d02-9857-24a9fdee474c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:02.692082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d7be2-d90b-4d02-9857-24a9fdee474c admin admin] PATH_INFO: `/v3/projects/f444166ee65e4d79b2d2c1d1c484b65f/users/f93ae608de25491483fdb42e61580b56/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:02.694023 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d7be2-d90b-4d02-9857-24a9fdee474c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f444166ee65e4d79b2d2c1d1c484b65f, user_id=f93ae608de25491483fdb42e61580b56, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:02.696665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d7be2-d90b-4d02-9857-24a9fdee474c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:02.707243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1383/2777] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:27:02 2022] PUT /identity/v3/projects/f444166ee65e4d79b2d2c1d1c484b65f/users/f93ae608de25491483fdb42e61580b56/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:02.717145 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f139-146e-4ee1-8034-588b302160e4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:02.717445 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f139-146e-4ee1-8034-588b302160e4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:02.717757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f139-146e-4ee1-8034-588b302160e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:02.744018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2e36f139-146e-4ee1-8034-588b302160e4 None None] MFA Rules not processed for user `f93ae608de25491483fdb42e61580b56`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:02.745249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2e36f139-146e-4ee1-8034-588b302160e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:02.811641 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1395/2778] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:02.823322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d7be2-d90b-4d02-9857-24a9fdee474c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:02.825030 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ee3d7be2-d90b-4d02-9857-24a9fdee474c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:02.851567 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:02.904913 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d7be2-d90b-4d02-9857-24a9fdee474c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:02.908717 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718d35a-34a5-4db3-8b97-622f3d8d2a8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:02.909361 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d35a-34a5-4db3-8b97-622f3d8d2a8c service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:02.909642 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d35a-34a5-4db3-8b97-622f3d8d2a8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:02.909914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d35a-34a5-4db3-8b97-622f3d8d2a8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:02.918961 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718d35a-34a5-4db3-8b97-622f3d8d2a8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:02.920405 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718d35a-34a5-4db3-8b97-622f3d8d2a8c service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:02.930214 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1384/2779] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:27:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:27:03.003740 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f139-146e-4ee1-8034-588b302160e4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:03.013238 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f139-146e-4ee1-8034-588b302160e4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:03.016789 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88668542-4bf4-4c6f-a6fb-59be7e89808d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:03.017423 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88668542-4bf4-4c6f-a6fb-59be7e89808d service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:03.017705 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88668542-4bf4-4c6f-a6fb-59be7e89808d service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:03.017980 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88668542-4bf4-4c6f-a6fb-59be7e89808d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:03.074145 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88668542-4bf4-4c6f-a6fb-59be7e89808d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:03.075573 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88668542-4bf4-4c6f-a6fb-59be7e89808d service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:03.084363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1396/2780] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:27:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:27:12.926065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=24 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:13.080324 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=73 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:45.445379 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718d35a-34a5-4db3-8b97-622f3d8d2a8c service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:45.507500 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718d35a-34a5-4db3-8b97-622f3d8d2a8c service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:45.512082 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a500cc-6d29-442f-bcec-523679d99444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:45.512950 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a500cc-6d29-442f-bcec-523679d99444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:45.513234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a500cc-6d29-442f-bcec-523679d99444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:45.513513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a500cc-6d29-442f-bcec-523679d99444 admin admin] PATH_INFO: `/v3/users/6b6acb046e4c4f45b05719d86bc57492` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:45.514693 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a500cc-6d29-442f-bcec-523679d99444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6acb046e4c4f45b05719d86bc57492)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:45.516645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a500cc-6d29-442f-bcec-523679d99444 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:45.560428 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-78a500cc-6d29-442f-bcec-523679d99444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6acb046e4c4f45b05719d86bc57492'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:45.568041 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-78a500cc-6d29-442f-bcec-523679d99444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6acb046e4c4f45b05719d86bc57492'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:45.574918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-78a500cc-6d29-442f-bcec-523679d99444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6acb046e4c4f45b05719d86bc57492'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:45.575526 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-78a500cc-6d29-442f-bcec-523679d99444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6acb046e4c4f45b05719d86bc57492'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:45.576227 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-78a500cc-6d29-442f-bcec-523679d99444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6acb046e4c4f45b05719d86bc57492'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:45.594017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1385/2781] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:27:45 2022] DELETE /identity/v3/users/6b6acb046e4c4f45b05719d86bc57492 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:45.598670 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dda58b-e383-4d0b-a6b8-4a73f60b4de5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:45.599147 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dda58b-e383-4d0b-a6b8-4a73f60b4de5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:45.599250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dda58b-e383-4d0b-a6b8-4a73f60b4de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:45.616664 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-46dda58b-e383-4d0b-a6b8-4a73f60b4de5 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:45.617870 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-46dda58b-e383-4d0b-a6b8-4a73f60b4de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:45.675686 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1397/2782] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:45.685276 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a500cc-6d29-442f-bcec-523679d99444 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:45.687398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-78a500cc-6d29-442f-bcec-523679d99444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:45.742928 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a500cc-6d29-442f-bcec-523679d99444 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:45.746536 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9b309-61da-49de-8709-eb4df5578640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:45.747173 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9b309-61da-49de-8709-eb4df5578640 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:45.747454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9b309-61da-49de-8709-eb4df5578640 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:45.747727 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9b309-61da-49de-8709-eb4df5578640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:45.757093 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9b309-61da-49de-8709-eb4df5578640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:45.758513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9b309-61da-49de-8709-eb4df5578640 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:45.767752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1386/2783] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:27:46.031436 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dda58b-e383-4d0b-a6b8-4a73f60b4de5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:46.032896 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-46dda58b-e383-4d0b-a6b8-4a73f60b4de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:46.045777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dda58b-e383-4d0b-a6b8-4a73f60b4de5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:46.050415 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e546c3-1ee4-49db-8927-8ceb298036d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:46.051290 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e546c3-1ee4-49db-8927-8ceb298036d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:46.051576 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e546c3-1ee4-49db-8927-8ceb298036d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:46.051854 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e546c3-1ee4-49db-8927-8ceb298036d7 admin admin] PATH_INFO: `/v3/projects/b753ee63755248ffa5f206b37bdd7336` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:46.053112 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e546c3-1ee4-49db-8927-8ceb298036d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b753ee63755248ffa5f206b37bdd7336)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:46.055025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e546c3-1ee4-49db-8927-8ceb298036d7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:46.104544 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-35e546c3-1ee4-49db-8927-8ceb298036d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b753ee63755248ffa5f206b37bdd7336', 'request_id': 'req-35e546c3-1ee4-49db-8927-8ceb298036d7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:46.112061 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-35e546c3-1ee4-49db-8927-8ceb298036d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b753ee63755248ffa5f206b37bdd7336', 'request_id': 'req-35e546c3-1ee4-49db-8927-8ceb298036d7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:46.118308 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-35e546c3-1ee4-49db-8927-8ceb298036d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b753ee63755248ffa5f206b37bdd7336', 'request_id': 'req-35e546c3-1ee4-49db-8927-8ceb298036d7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:46.129538 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-35e546c3-1ee4-49db-8927-8ceb298036d7 admin admin] The token cache is being invalidate because project b753ee63755248ffa5f206b37bdd7336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:27:46.129831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-35e546c3-1ee4-49db-8927-8ceb298036d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:46.130457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-35e546c3-1ee4-49db-8927-8ceb298036d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:46.132290 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1398/2784] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:27:46 2022] DELETE /identity/v3/projects/b753ee63755248ffa5f206b37bdd7336 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:46.136260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9b309-61da-49de-8709-eb4df5578640 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:46.146371 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9b309-61da-49de-8709-eb4df5578640 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:46.164650 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:46.205797 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d9c46-3168-4e41-b3a2-ec2bfd26516b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:46.206703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d9c46-3168-4e41-b3a2-ec2bfd26516b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:46.206979 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d9c46-3168-4e41-b3a2-ec2bfd26516b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:46.207258 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d9c46-3168-4e41-b3a2-ec2bfd26516b admin admin] PATH_INFO: `/v3/users/f93ae608de25491483fdb42e61580b56` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:46.208469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d9c46-3168-4e41-b3a2-ec2bfd26516b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f93ae608de25491483fdb42e61580b56)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:46.210392 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d9c46-3168-4e41-b3a2-ec2bfd26516b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:46.254811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-890d9c46-3168-4e41-b3a2-ec2bfd26516b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f93ae608de25491483fdb42e61580b56'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:46.261547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-890d9c46-3168-4e41-b3a2-ec2bfd26516b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f93ae608de25491483fdb42e61580b56'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:46.268058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-890d9c46-3168-4e41-b3a2-ec2bfd26516b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f93ae608de25491483fdb42e61580b56'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:46.268686 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-890d9c46-3168-4e41-b3a2-ec2bfd26516b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f93ae608de25491483fdb42e61580b56'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:46.269272 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-890d9c46-3168-4e41-b3a2-ec2bfd26516b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f93ae608de25491483fdb42e61580b56'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:46.286328 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1387/2785] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:27:46 2022] DELETE /identity/v3/users/f93ae608de25491483fdb42e61580b56 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:46.800414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e546c3-1ee4-49db-8927-8ceb298036d7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:46.801967 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-35e546c3-1ee4-49db-8927-8ceb298036d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:46.818307 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e546c3-1ee4-49db-8927-8ceb298036d7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:46.878003 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea17fb-170e-471a-934b-c314831ed74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:46.878864 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea17fb-170e-471a-934b-c314831ed74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:46.879146 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea17fb-170e-471a-934b-c314831ed74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:46.879525 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea17fb-170e-471a-934b-c314831ed74b admin admin] PATH_INFO: `/v3/projects/f444166ee65e4d79b2d2c1d1c484b65f` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:46.880725 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea17fb-170e-471a-934b-c314831ed74b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f444166ee65e4d79b2d2c1d1c484b65f)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:46.882742 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea17fb-170e-471a-934b-c314831ed74b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:46.912717 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:46.930374 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-edea17fb-170e-471a-934b-c314831ed74b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f444166ee65e4d79b2d2c1d1c484b65f', 'request_id': 'req-edea17fb-170e-471a-934b-c314831ed74b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:46.937583 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-edea17fb-170e-471a-934b-c314831ed74b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f444166ee65e4d79b2d2c1d1c484b65f', 'request_id': 'req-edea17fb-170e-471a-934b-c314831ed74b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:46.943648 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-edea17fb-170e-471a-934b-c314831ed74b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f444166ee65e4d79b2d2c1d1c484b65f', 'request_id': 'req-edea17fb-170e-471a-934b-c314831ed74b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:46.954374 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-edea17fb-170e-471a-934b-c314831ed74b admin admin] The token cache is being invalidate because project f444166ee65e4d79b2d2c1d1c484b65f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:27:46.954662 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-edea17fb-170e-471a-934b-c314831ed74b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:46.955284 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-edea17fb-170e-471a-934b-c314831ed74b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:46.956819 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1399/2786] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:27:46 2022] DELETE /identity/v3/projects/f444166ee65e4d79b2d2c1d1c484b65f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:46.961652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c925c73-2685-437c-b3be-e0d5a6f24e4d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:46.962128 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c925c73-2685-437c-b3be-e0d5a6f24e4d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:46.962245 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c925c73-2685-437c-b3be-e0d5a6f24e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:46.980738 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3c925c73-2685-437c-b3be-e0d5a6f24e4d None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:46.981948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3c925c73-2685-437c-b3be-e0d5a6f24e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:47.040592 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1388/2787] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:47.048212 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516cb1a-53bb-4d39-8576-c7437a0fb297 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:47.048505 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516cb1a-53bb-4d39-8576-c7437a0fb297 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:47.048785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516cb1a-53bb-4d39-8576-c7437a0fb297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:47.066823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a516cb1a-53bb-4d39-8576-c7437a0fb297 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:47.068057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a516cb1a-53bb-4d39-8576-c7437a0fb297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:47.077243 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1400/2788] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:47.081645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c925c73-2685-437c-b3be-e0d5a6f24e4d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:47.091330 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c925c73-2685-437c-b3be-e0d5a6f24e4d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:47.096400 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892d53e-9240-435c-930f-81c256e7b4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:47.097048 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d53e-9240-435c-930f-81c256e7b4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:47.097332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d53e-9240-435c-930f-81c256e7b4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:47.097609 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d53e-9240-435c-930f-81c256e7b4e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:47.098331 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892d53e-9240-435c-930f-81c256e7b4e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:27:47.098636 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892d53e-9240-435c-930f-81c256e7b4e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:47.100260 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892d53e-9240-435c-930f-81c256e7b4e5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:47.114855 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1389/2789] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:27:47.119098 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516cb1a-53bb-4d39-8576-c7437a0fb297 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:47.128458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516cb1a-53bb-4d39-8576-c7437a0fb297 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:47.133139 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ddb66-5fa4-4daf-85bb-de53633e1d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:47.133785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ddb66-5fa4-4daf-85bb-de53633e1d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:47.134078 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ddb66-5fa4-4daf-85bb-de53633e1d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:47.134361 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ddb66-5fa4-4daf-85bb-de53633e1d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:47.135052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ddb66-5fa4-4daf-85bb-de53633e1d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:47.137047 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ddb66-5fa4-4daf-85bb-de53633e1d4d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:47.177005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1401/2790] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:27:47 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:27:47.178160 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892d53e-9240-435c-930f-81c256e7b4e5 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:47.188725 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892d53e-9240-435c-930f-81c256e7b4e5 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:47.214329 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:47.246391 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bed78c-c83b-4d94-a942-c5f9c1d36971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:47.247061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bed78c-c83b-4d94-a942-c5f9c1d36971 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:47.247345 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bed78c-c83b-4d94-a942-c5f9c1d36971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:47.247622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bed78c-c83b-4d94-a942-c5f9c1d36971 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:47.248352 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bed78c-c83b-4d94-a942-c5f9c1d36971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:47.250264 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bed78c-c83b-4d94-a942-c5f9c1d36971 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:47.269612 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1390/2791] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:27:47 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:27:47.273781 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ddb66-5fa4-4daf-85bb-de53633e1d4d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:47.285491 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ddb66-5fa4-4daf-85bb-de53633e1d4d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:47.290385 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b2075-5b1c-4fc7-a155-c166555fa0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:47.291051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b2075-5b1c-4fc7-a155-c166555fa0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:47.291341 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b2075-5b1c-4fc7-a155-c166555fa0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:47.291625 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b2075-5b1c-4fc7-a155-c166555fa0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:47.292386 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b2075-5b1c-4fc7-a155-c166555fa0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:47.293996 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b2075-5b1c-4fc7-a155-c166555fa0f8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:47.303868 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1402/2792] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:27:47.307648 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bed78c-c83b-4d94-a942-c5f9c1d36971 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:47.318137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bed78c-c83b-4d94-a942-c5f9c1d36971 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:47.322813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f563b2-722a-420d-9449-89dad19456aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:47.323465 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f563b2-722a-420d-9449-89dad19456aa admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:47.323747 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f563b2-722a-420d-9449-89dad19456aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:47.324065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f563b2-722a-420d-9449-89dad19456aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:47.324793 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f563b2-722a-420d-9449-89dad19456aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:47.326377 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f563b2-722a-420d-9449-89dad19456aa admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:47.338353 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1391/2793] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:27:47.342314 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b2075-5b1c-4fc7-a155-c166555fa0f8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:47.352636 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b2075-5b1c-4fc7-a155-c166555fa0f8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:47.357327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33705579-bacb-42bd-b98f-eee6cf717d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:47.358236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33705579-bacb-42bd-b98f-eee6cf717d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:47.358523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33705579-bacb-42bd-b98f-eee6cf717d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:47.358802 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33705579-bacb-42bd-b98f-eee6cf717d65 admin admin] PATH_INFO: `/v3/projects/31fbfb7eece04327aade3836f51fda79/users/c920fa841bf74c2c94b920418a6d87ee/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:47.375138 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33705579-bacb-42bd-b98f-eee6cf717d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31fbfb7eece04327aade3836f51fda79, user_id=c920fa841bf74c2c94b920418a6d87ee, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:47.377844 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33705579-bacb-42bd-b98f-eee6cf717d65 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:47.391836 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1403/2794] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:27:47 2022] PUT /identity/v3/projects/31fbfb7eece04327aade3836f51fda79/users/c920fa841bf74c2c94b920418a6d87ee/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:27:47.403490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22129c-7a41-45a8-8902-51206fd6318c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:47.403780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22129c-7a41-45a8-8902-51206fd6318c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:47.404089 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22129c-7a41-45a8-8902-51206fd6318c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:47.430802 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-7e22129c-7a41-45a8-8902-51206fd6318c None None] MFA Rules not processed for user `c920fa841bf74c2c94b920418a6d87ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:47.432031 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7e22129c-7a41-45a8-8902-51206fd6318c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:47.495244 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1392/2795] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:47.500018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33705579-bacb-42bd-b98f-eee6cf717d65 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:47.562168 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33705579-bacb-42bd-b98f-eee6cf717d65 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:47.566829 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fd6da-fe4a-485d-aa06-08b646ed2fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:47.567489 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fd6da-fe4a-485d-aa06-08b646ed2fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:47.567779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fd6da-fe4a-485d-aa06-08b646ed2fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:47.568097 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fd6da-fe4a-485d-aa06-08b646ed2fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:47.568798 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fd6da-fe4a-485d-aa06-08b646ed2fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:47.570693 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fd6da-fe4a-485d-aa06-08b646ed2fb1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:47.595668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1404/2796] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:27:47 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:27:47.599726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22129c-7a41-45a8-8902-51206fd6318c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:47.610416 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22129c-7a41-45a8-8902-51206fd6318c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:47.665847 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4f000-c7af-460e-a5cf-e07d8819ce06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:47.666537 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4f000-c7af-460e-a5cf-e07d8819ce06 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:47.666818 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4f000-c7af-460e-a5cf-e07d8819ce06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:47.667092 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4f000-c7af-460e-a5cf-e07d8819ce06 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:47.667778 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4f000-c7af-460e-a5cf-e07d8819ce06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:47.669769 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4f000-c7af-460e-a5cf-e07d8819ce06 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:47.689700 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1393/2797] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:27:47 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:27:47.693698 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fd6da-fe4a-485d-aa06-08b646ed2fb1 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:47.704510 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fd6da-fe4a-485d-aa06-08b646ed2fb1 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:47.709293 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853a82f-9c3c-4084-9877-06d695343017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:47.709952 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853a82f-9c3c-4084-9877-06d695343017 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:47.710241 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853a82f-9c3c-4084-9877-06d695343017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:47.710524 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853a82f-9c3c-4084-9877-06d695343017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:47.711254 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853a82f-9c3c-4084-9877-06d695343017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:47.712908 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853a82f-9c3c-4084-9877-06d695343017 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:47.723568 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1405/2798] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:27:47.727502 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4f000-c7af-460e-a5cf-e07d8819ce06 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:47.737632 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4f000-c7af-460e-a5cf-e07d8819ce06 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:47.742548 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b5298-643d-4837-8164-0e0ddd31af06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:47.743406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b5298-643d-4837-8164-0e0ddd31af06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:47.743685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b5298-643d-4837-8164-0e0ddd31af06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:47.743988 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b5298-643d-4837-8164-0e0ddd31af06 admin admin] PATH_INFO: `/v3/projects/d7f39b601cd747d1bb749411ebe4f1b7/users/0b017d991bb2416f8d6164eff60e2aca/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:47.758854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b5298-643d-4837-8164-0e0ddd31af06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f39b601cd747d1bb749411ebe4f1b7, user_id=0b017d991bb2416f8d6164eff60e2aca, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:47.761440 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b5298-643d-4837-8164-0e0ddd31af06 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:47.774289 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1394/2799] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:27:47 2022] PUT /identity/v3/projects/d7f39b601cd747d1bb749411ebe4f1b7/users/0b017d991bb2416f8d6164eff60e2aca/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:47.778102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853a82f-9c3c-4084-9877-06d695343017 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:47.788315 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853a82f-9c3c-4084-9877-06d695343017 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:47.800112 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:47.847752 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e901e1-1803-43b0-9121-b39ba2186d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:47.848482 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e901e1-1803-43b0-9121-b39ba2186d54 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:47.848768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e901e1-1803-43b0-9121-b39ba2186d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:47.849049 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e901e1-1803-43b0-9121-b39ba2186d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:47.849777 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e901e1-1803-43b0-9121-b39ba2186d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:47.851393 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e901e1-1803-43b0-9121-b39ba2186d54 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:47.861580 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1406/2800] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:27:47.865709 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b5298-643d-4837-8164-0e0ddd31af06 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:47.871224 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:47.878176 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b5298-643d-4837-8164-0e0ddd31af06 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:47.883332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed61aba-8f1b-4e0c-99dc-abaa9c65deed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:47.884253 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61aba-8f1b-4e0c-99dc-abaa9c65deed admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:47.884540 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61aba-8f1b-4e0c-99dc-abaa9c65deed admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:47.884820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61aba-8f1b-4e0c-99dc-abaa9c65deed admin admin] PATH_INFO: `/v3/projects/d7f39b601cd747d1bb749411ebe4f1b7/users/0b017d991bb2416f8d6164eff60e2aca/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:47.886786 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed61aba-8f1b-4e0c-99dc-abaa9c65deed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f39b601cd747d1bb749411ebe4f1b7, user_id=0b017d991bb2416f8d6164eff60e2aca, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:47.889494 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed61aba-8f1b-4e0c-99dc-abaa9c65deed admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:47.899760 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1395/2801] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:27:47 2022] PUT /identity/v3/projects/d7f39b601cd747d1bb749411ebe4f1b7/users/0b017d991bb2416f8d6164eff60e2aca/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:47.909964 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ff015-782c-4f1c-87bf-aed40202a1ac None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:47.910267 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ff015-782c-4f1c-87bf-aed40202a1ac None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:47.910558 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ff015-782c-4f1c-87bf-aed40202a1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:47.945146 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-074ff015-782c-4f1c-87bf-aed40202a1ac None None] MFA Rules not processed for user `0b017d991bb2416f8d6164eff60e2aca`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:47.946379 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-074ff015-782c-4f1c-87bf-aed40202a1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:48.013642 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1407/2802] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:48.025321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed61aba-8f1b-4e0c-99dc-abaa9c65deed admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:48.027028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4ed61aba-8f1b-4e0c-99dc-abaa9c65deed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:48.083216 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed61aba-8f1b-4e0c-99dc-abaa9c65deed admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:48.086841 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7c71c-b930-4c66-af2c-c94e1aa50bc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:48.087469 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7c71c-b930-4c66-af2c-c94e1aa50bc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:48.087757 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7c71c-b930-4c66-af2c-c94e1aa50bc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:48.088069 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7c71c-b930-4c66-af2c-c94e1aa50bc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:48.097331 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7c71c-b930-4c66-af2c-c94e1aa50bc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:48.098759 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7c71c-b930-4c66-af2c-c94e1aa50bc4 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:48.108517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1396/2803] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:27:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:27:48.182861 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ff015-782c-4f1c-87bf-aed40202a1ac None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:48.192857 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ff015-782c-4f1c-87bf-aed40202a1ac None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:48.196565 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea512253-b584-4e73-afde-2a9cbdbe6e28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:48.197206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea512253-b584-4e73-afde-2a9cbdbe6e28 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:48.197492 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea512253-b584-4e73-afde-2a9cbdbe6e28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:48.197768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea512253-b584-4e73-afde-2a9cbdbe6e28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:48.253616 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea512253-b584-4e73-afde-2a9cbdbe6e28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:48.255050 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea512253-b584-4e73-afde-2a9cbdbe6e28 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:48.263899 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1408/2804] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:27:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:27:50.954981 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7c71c-b930-4c66-af2c-c94e1aa50bc4 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:51.016454 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7c71c-b930-4c66-af2c-c94e1aa50bc4 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:51.020921 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63171d9a-0f4a-45c9-8bb0-16ff91459080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:51.021780 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63171d9a-0f4a-45c9-8bb0-16ff91459080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:51.022059 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63171d9a-0f4a-45c9-8bb0-16ff91459080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:51.022332 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63171d9a-0f4a-45c9-8bb0-16ff91459080 admin admin] PATH_INFO: `/v3/users/c920fa841bf74c2c94b920418a6d87ee` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:51.023492 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63171d9a-0f4a-45c9-8bb0-16ff91459080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c920fa841bf74c2c94b920418a6d87ee)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:51.025434 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63171d9a-0f4a-45c9-8bb0-16ff91459080 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:51.073541 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-63171d9a-0f4a-45c9-8bb0-16ff91459080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c920fa841bf74c2c94b920418a6d87ee'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:51.081083 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-63171d9a-0f4a-45c9-8bb0-16ff91459080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c920fa841bf74c2c94b920418a6d87ee'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:51.088733 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-63171d9a-0f4a-45c9-8bb0-16ff91459080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c920fa841bf74c2c94b920418a6d87ee'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:51.089372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-63171d9a-0f4a-45c9-8bb0-16ff91459080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c920fa841bf74c2c94b920418a6d87ee'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:51.089978 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-63171d9a-0f4a-45c9-8bb0-16ff91459080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c920fa841bf74c2c94b920418a6d87ee'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:51.106822 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1397/2805] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:27:50 2022] DELETE /identity/v3/users/c920fa841bf74c2c94b920418a6d87ee => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:51.111493 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3db221-09dc-4c80-baa3-9129f1420389 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:51.112003 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3db221-09dc-4c80-baa3-9129f1420389 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:51.112126 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3db221-09dc-4c80-baa3-9129f1420389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:51.129272 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-cf3db221-09dc-4c80-baa3-9129f1420389 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:51.130484 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cf3db221-09dc-4c80-baa3-9129f1420389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:51.164205 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:51.193917 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1409/2806] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:51.205014 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63171d9a-0f4a-45c9-8bb0-16ff91459080 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:51.206417 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-63171d9a-0f4a-45c9-8bb0-16ff91459080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:51.219720 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:51.265334 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63171d9a-0f4a-45c9-8bb0-16ff91459080 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:51.268977 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420c797-a430-4fba-9301-66ea28dc32ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:51.269620 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c797-a430-4fba-9301-66ea28dc32ef service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:51.269906 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c797-a430-4fba-9301-66ea28dc32ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:51.270185 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c797-a430-4fba-9301-66ea28dc32ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:51.279078 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420c797-a430-4fba-9301-66ea28dc32ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:51.280578 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420c797-a430-4fba-9301-66ea28dc32ef service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:51.290815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1398/2807] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 12:27:51.556575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3db221-09dc-4c80-baa3-9129f1420389 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:51.558010 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cf3db221-09dc-4c80-baa3-9129f1420389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:51.570474 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3db221-09dc-4c80-baa3-9129f1420389 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:51.575319 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:51.576447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:51.576735 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:51.577014 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9 admin admin] PATH_INFO: `/v3/projects/31fbfb7eece04327aade3836f51fda79` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:51.578460 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31fbfb7eece04327aade3836f51fda79)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:51.580186 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:51.630373 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31fbfb7eece04327aade3836f51fda79', 'request_id': 'req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:51.637509 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31fbfb7eece04327aade3836f51fda79', 'request_id': 'req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:51.643759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31fbfb7eece04327aade3836f51fda79', 'request_id': 'req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:51.654027 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9 admin admin] The token cache is being invalidate because project 31fbfb7eece04327aade3836f51fda79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:27:51.654318 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:51.654946 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:51.656513 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1410/2808] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:27:51 2022] DELETE /identity/v3/projects/31fbfb7eece04327aade3836f51fda79 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:51.660753 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420c797-a430-4fba-9301-66ea28dc32ef service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:51.670730 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420c797-a430-4fba-9301-66ea28dc32ef service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:51.725138 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930a1aa-9d1e-4ebf-9f5b-92db4ed06040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:51.725999 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930a1aa-9d1e-4ebf-9f5b-92db4ed06040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:51.726281 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930a1aa-9d1e-4ebf-9f5b-92db4ed06040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:51.726559 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930a1aa-9d1e-4ebf-9f5b-92db4ed06040 admin admin] PATH_INFO: `/v3/users/0b017d991bb2416f8d6164eff60e2aca` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:51.727726 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930a1aa-9d1e-4ebf-9f5b-92db4ed06040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b017d991bb2416f8d6164eff60e2aca)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:51.729668 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930a1aa-9d1e-4ebf-9f5b-92db4ed06040 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:51.773367 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c930a1aa-9d1e-4ebf-9f5b-92db4ed06040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b017d991bb2416f8d6164eff60e2aca'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:51.780114 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c930a1aa-9d1e-4ebf-9f5b-92db4ed06040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b017d991bb2416f8d6164eff60e2aca'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:51.787605 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c930a1aa-9d1e-4ebf-9f5b-92db4ed06040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b017d991bb2416f8d6164eff60e2aca'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:51.788356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c930a1aa-9d1e-4ebf-9f5b-92db4ed06040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b017d991bb2416f8d6164eff60e2aca'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:51.788985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c930a1aa-9d1e-4ebf-9f5b-92db4ed06040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b017d991bb2416f8d6164eff60e2aca'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:51.809410 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1399/2809] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:27:51 2022] DELETE /identity/v3/users/0b017d991bb2416f8d6164eff60e2aca => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:52.080112 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:52.081547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:52.095796 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4d02b-b1db-4fbc-b153-ab81c4c5d4e9 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:52.159328 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f6e30-43a9-48e1-9883-f7de3e5fc17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:52.160289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f6e30-43a9-48e1-9883-f7de3e5fc17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:52.160528 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f6e30-43a9-48e1-9883-f7de3e5fc17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:52.160702 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f6e30-43a9-48e1-9883-f7de3e5fc17e admin admin] PATH_INFO: `/v3/projects/d7f39b601cd747d1bb749411ebe4f1b7` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:52.161891 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f6e30-43a9-48e1-9883-f7de3e5fc17e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f39b601cd747d1bb749411ebe4f1b7)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:52.163792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f6e30-43a9-48e1-9883-f7de3e5fc17e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:52.209501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-842f6e30-43a9-48e1-9883-f7de3e5fc17e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f39b601cd747d1bb749411ebe4f1b7', 'request_id': 'req-842f6e30-43a9-48e1-9883-f7de3e5fc17e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:52.216414 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-842f6e30-43a9-48e1-9883-f7de3e5fc17e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f39b601cd747d1bb749411ebe4f1b7', 'request_id': 'req-842f6e30-43a9-48e1-9883-f7de3e5fc17e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:52.223220 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-842f6e30-43a9-48e1-9883-f7de3e5fc17e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f39b601cd747d1bb749411ebe4f1b7', 'request_id': 'req-842f6e30-43a9-48e1-9883-f7de3e5fc17e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:52.224447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:52.235793 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-842f6e30-43a9-48e1-9883-f7de3e5fc17e admin admin] The token cache is being invalidate because project d7f39b601cd747d1bb749411ebe4f1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:27:52.236119 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-842f6e30-43a9-48e1-9883-f7de3e5fc17e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:52.236739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-842f6e30-43a9-48e1-9883-f7de3e5fc17e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:52.238255 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1411/2810] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:27:52 2022] DELETE /identity/v3/projects/d7f39b601cd747d1bb749411ebe4f1b7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:52.243124 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb5333-0b1e-4fa2-81c4-30954f8b71ea None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:52.243690 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb5333-0b1e-4fa2-81c4-30954f8b71ea None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:52.243690 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb5333-0b1e-4fa2-81c4-30954f8b71ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:52.261330 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3bfb5333-0b1e-4fa2-81c4-30954f8b71ea None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:52.262783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3bfb5333-0b1e-4fa2-81c4-30954f8b71ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:52.294023 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:52.324719 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1400/2811] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:52.333244 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36061db1-3b2f-4efa-99cb-8f8b55fdb703 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:52.333668 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36061db1-3b2f-4efa-99cb-8f8b55fdb703 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:52.333957 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36061db1-3b2f-4efa-99cb-8f8b55fdb703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:52.352812 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-36061db1-3b2f-4efa-99cb-8f8b55fdb703 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:52.354026 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-36061db1-3b2f-4efa-99cb-8f8b55fdb703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:52.362191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1412/2812] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:52.366462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb5333-0b1e-4fa2-81c4-30954f8b71ea None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:52.376383 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb5333-0b1e-4fa2-81c4-30954f8b71ea None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:52.380975 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2da566-a468-49ed-8caa-13365873687d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:52.381636 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2da566-a468-49ed-8caa-13365873687d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:52.381920 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2da566-a468-49ed-8caa-13365873687d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:52.382198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2da566-a468-49ed-8caa-13365873687d admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:52.382934 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2da566-a468-49ed-8caa-13365873687d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:27:52.383243 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2da566-a468-49ed-8caa-13365873687d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:52.384863 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2da566-a468-49ed-8caa-13365873687d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:52.396842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1401/2813] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:27:52.401261 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36061db1-3b2f-4efa-99cb-8f8b55fdb703 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:52.411342 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36061db1-3b2f-4efa-99cb-8f8b55fdb703 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:52.415860 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75667a31-99db-47cf-81c2-c0f248f7a8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:52.416563 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75667a31-99db-47cf-81c2-c0f248f7a8cc admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:52.416850 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75667a31-99db-47cf-81c2-c0f248f7a8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:52.417130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75667a31-99db-47cf-81c2-c0f248f7a8cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:52.417824 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75667a31-99db-47cf-81c2-c0f248f7a8cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:52.419714 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75667a31-99db-47cf-81c2-c0f248f7a8cc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:52.443792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1413/2814] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:27:52 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:27:52.447862 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2da566-a468-49ed-8caa-13365873687d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:52.458969 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2da566-a468-49ed-8caa-13365873687d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:52.514138 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8eb08-641a-4802-a06f-15b1d83f4bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:52.514814 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8eb08-641a-4802-a06f-15b1d83f4bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:52.515098 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8eb08-641a-4802-a06f-15b1d83f4bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:52.515374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8eb08-641a-4802-a06f-15b1d83f4bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:52.516095 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8eb08-641a-4802-a06f-15b1d83f4bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:52.518003 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8eb08-641a-4802-a06f-15b1d83f4bb3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:52.537833 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1402/2815] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:27:52 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:27:52.541869 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75667a31-99db-47cf-81c2-c0f248f7a8cc admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:52.552105 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75667a31-99db-47cf-81c2-c0f248f7a8cc admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:52.556709 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee9b5d-127d-49fe-875c-c1b6970b173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:52.557359 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee9b5d-127d-49fe-875c-c1b6970b173e admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:52.557643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee9b5d-127d-49fe-875c-c1b6970b173e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:52.557921 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee9b5d-127d-49fe-875c-c1b6970b173e admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:52.558646 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee9b5d-127d-49fe-875c-c1b6970b173e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:52.560266 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee9b5d-127d-49fe-875c-c1b6970b173e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:52.572195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1414/2816] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:27:52.576062 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8eb08-641a-4802-a06f-15b1d83f4bb3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:52.586665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8eb08-641a-4802-a06f-15b1d83f4bb3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:52.591234 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8bbd3-f5d2-458f-9a28-250bfd071792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:52.591899 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8bbd3-f5d2-458f-9a28-250bfd071792 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:52.592238 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8bbd3-f5d2-458f-9a28-250bfd071792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:52.592499 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8bbd3-f5d2-458f-9a28-250bfd071792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:52.593225 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8bbd3-f5d2-458f-9a28-250bfd071792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:52.595230 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8bbd3-f5d2-458f-9a28-250bfd071792 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:52.605002 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1403/2817] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:27:52.609277 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee9b5d-127d-49fe-875c-c1b6970b173e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:52.619161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee9b5d-127d-49fe-875c-c1b6970b173e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:52.624302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f0f39-f6f0-49e4-9cd2-b214666d410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:52.625171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f0f39-f6f0-49e4-9cd2-b214666d410d admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:52.625454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f0f39-f6f0-49e4-9cd2-b214666d410d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:52.625731 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f0f39-f6f0-49e4-9cd2-b214666d410d admin admin] PATH_INFO: `/v3/projects/2e5e39f2b157400c9afa74c3915957d6/users/eeab75c985304c4dbb0955a0e94c3ce2/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:52.640367 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f0f39-f6f0-49e4-9cd2-b214666d410d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5e39f2b157400c9afa74c3915957d6, user_id=eeab75c985304c4dbb0955a0e94c3ce2, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:52.642997 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f0f39-f6f0-49e4-9cd2-b214666d410d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:52.655893 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1415/2818] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:27:52 2022] PUT /identity/v3/projects/2e5e39f2b157400c9afa74c3915957d6/users/eeab75c985304c4dbb0955a0e94c3ce2/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:52.667627 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb6d84-9b3e-4563-a8ce-974a888113df None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:52.667864 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb6d84-9b3e-4563-a8ce-974a888113df None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:52.668183 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb6d84-9b3e-4563-a8ce-974a888113df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:52.694449 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-badb6d84-9b3e-4563-a8ce-974a888113df None None] MFA Rules not processed for user `eeab75c985304c4dbb0955a0e94c3ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:52.695652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-badb6d84-9b3e-4563-a8ce-974a888113df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:52.757830 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1404/2819] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:52.762230 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f0f39-f6f0-49e4-9cd2-b214666d410d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:52.823254 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f0f39-f6f0-49e4-9cd2-b214666d410d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:52.828540 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597728e-68c0-4926-bb35-7d377fc7498b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:52.829198 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597728e-68c0-4926-bb35-7d377fc7498b admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:52.829485 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597728e-68c0-4926-bb35-7d377fc7498b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:52.829769 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597728e-68c0-4926-bb35-7d377fc7498b admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:52.830470 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597728e-68c0-4926-bb35-7d377fc7498b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:52.832404 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597728e-68c0-4926-bb35-7d377fc7498b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:52.857061 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1416/2820] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:27:52 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:27:52.861316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb6d84-9b3e-4563-a8ce-974a888113df None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:52.872088 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb6d84-9b3e-4563-a8ce-974a888113df None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:52.899471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:52.930306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233e639-a95b-4425-99a9-8722432a6442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:52.930911 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233e639-a95b-4425-99a9-8722432a6442 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:52.931198 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233e639-a95b-4425-99a9-8722432a6442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:52.931478 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233e639-a95b-4425-99a9-8722432a6442 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:52.932208 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233e639-a95b-4425-99a9-8722432a6442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:52.934162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233e639-a95b-4425-99a9-8722432a6442 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:52.954472 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1405/2821] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:27:52 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:27:52.958458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597728e-68c0-4926-bb35-7d377fc7498b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:52.968841 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597728e-68c0-4926-bb35-7d377fc7498b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:52.973768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0119b-ce25-44ac-b341-64000fc0bb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:52.974424 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0119b-ce25-44ac-b341-64000fc0bb4d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:52.974711 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0119b-ce25-44ac-b341-64000fc0bb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:52.974991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0119b-ce25-44ac-b341-64000fc0bb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:52.975744 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0119b-ce25-44ac-b341-64000fc0bb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:52.977363 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0119b-ce25-44ac-b341-64000fc0bb4d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:52.988492 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1417/2822] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:27:52.992216 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233e639-a95b-4425-99a9-8722432a6442 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:53.002981 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233e639-a95b-4425-99a9-8722432a6442 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:53.007523 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0e214-5842-4849-a6c6-b2ea201a588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:53.008220 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0e214-5842-4849-a6c6-b2ea201a588f admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:53.008501 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0e214-5842-4849-a6c6-b2ea201a588f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:53.008776 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0e214-5842-4849-a6c6-b2ea201a588f admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:53.009517 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0e214-5842-4849-a6c6-b2ea201a588f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:53.011105 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0e214-5842-4849-a6c6-b2ea201a588f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:53.020849 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1406/2823] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:27:53.024759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0119b-ce25-44ac-b341-64000fc0bb4d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:53.034760 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0119b-ce25-44ac-b341-64000fc0bb4d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:53.039287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2a315-933e-4aa1-946a-87781326006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:53.040188 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2a315-933e-4aa1-946a-87781326006d admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:53.040476 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2a315-933e-4aa1-946a-87781326006d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:53.040759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2a315-933e-4aa1-946a-87781326006d admin admin] PATH_INFO: `/v3/projects/5395adcba8a24dc1bb291d6b3ce9c169/users/17dc688745c642a591cc35901ea0dfe6/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:53.055262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2a315-933e-4aa1-946a-87781326006d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5395adcba8a24dc1bb291d6b3ce9c169, user_id=17dc688745c642a591cc35901ea0dfe6, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:53.057922 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2a315-933e-4aa1-946a-87781326006d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:53.071628 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1418/2824] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:27:53 2022] PUT /identity/v3/projects/5395adcba8a24dc1bb291d6b3ce9c169/users/17dc688745c642a591cc35901ea0dfe6/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:53.081792 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762fca7-218a-4ae7-bacf-9b8897495bea None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:53.082086 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762fca7-218a-4ae7-bacf-9b8897495bea None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:53.082391 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762fca7-218a-4ae7-bacf-9b8897495bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:53.108451 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e762fca7-218a-4ae7-bacf-9b8897495bea None None] MFA Rules not processed for user `17dc688745c642a591cc35901ea0dfe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:53.109635 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e762fca7-218a-4ae7-bacf-9b8897495bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:53.171343 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1407/2825] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:53.175846 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2a315-933e-4aa1-946a-87781326006d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:53.214633 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:53.238376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2a315-933e-4aa1-946a-87781326006d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:53.242949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28832745-cf81-4de7-a1d3-e03eaa743348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:53.243598 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28832745-cf81-4de7-a1d3-e03eaa743348 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:53.243882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28832745-cf81-4de7-a1d3-e03eaa743348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:53.244191 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28832745-cf81-4de7-a1d3-e03eaa743348 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:53.244878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28832745-cf81-4de7-a1d3-e03eaa743348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:53.246755 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28832745-cf81-4de7-a1d3-e03eaa743348 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:53.271418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1419/2826] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:27:53 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:27:53.275421 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762fca7-218a-4ae7-bacf-9b8897495bea None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:53.286207 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762fca7-218a-4ae7-bacf-9b8897495bea None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:53.339877 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc961a5d-a9b1-44a8-8eee-a6472ac0ddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:53.340566 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc961a5d-a9b1-44a8-8eee-a6472ac0ddad admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:53.340848 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc961a5d-a9b1-44a8-8eee-a6472ac0ddad admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:53.341122 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc961a5d-a9b1-44a8-8eee-a6472ac0ddad admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:53.342320 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc961a5d-a9b1-44a8-8eee-a6472ac0ddad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:53.344255 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc961a5d-a9b1-44a8-8eee-a6472ac0ddad admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:53.367638 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1408/2827] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:27:53 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:27:53.375782 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28832745-cf81-4de7-a1d3-e03eaa743348 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:53.382369 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28832745-cf81-4de7-a1d3-e03eaa743348 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:53.386989 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7bc57-4995-4696-910b-537b9231b577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:53.387643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7bc57-4995-4696-910b-537b9231b577 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:53.387951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7bc57-4995-4696-910b-537b9231b577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:53.388237 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7bc57-4995-4696-910b-537b9231b577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:53.388961 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7bc57-4995-4696-910b-537b9231b577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:53.390546 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7bc57-4995-4696-910b-537b9231b577 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:53.401051 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1420/2828] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:27:53.405643 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc961a5d-a9b1-44a8-8eee-a6472ac0ddad admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:53.415820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc961a5d-a9b1-44a8-8eee-a6472ac0ddad admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:53.421106 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54ee7e-7268-4c2d-a327-2e6f1430f6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:53.421978 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54ee7e-7268-4c2d-a327-2e6f1430f6d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:53.422258 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54ee7e-7268-4c2d-a327-2e6f1430f6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:53.422529 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54ee7e-7268-4c2d-a327-2e6f1430f6d6 admin admin] PATH_INFO: `/v3/projects/ed174e6ea8b54fe6b0de98e200c09b93/users/6bd76cc71b9f4113983fbfc028c8b958/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:53.436739 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54ee7e-7268-4c2d-a327-2e6f1430f6d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed174e6ea8b54fe6b0de98e200c09b93, user_id=6bd76cc71b9f4113983fbfc028c8b958, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:53.439394 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54ee7e-7268-4c2d-a327-2e6f1430f6d6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:53.451813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1409/2829] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:27:53 2022] PUT /identity/v3/projects/ed174e6ea8b54fe6b0de98e200c09b93/users/6bd76cc71b9f4113983fbfc028c8b958/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:53.455737 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7bc57-4995-4696-910b-537b9231b577 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:53.465848 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7bc57-4995-4696-910b-537b9231b577 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:53.527418 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2e428-2dbf-4f98-9475-613ec784ce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:53.528111 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2e428-2dbf-4f98-9475-613ec784ce36 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:53.528401 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2e428-2dbf-4f98-9475-613ec784ce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:53.528680 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2e428-2dbf-4f98-9475-613ec784ce36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:53.529936 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2e428-2dbf-4f98-9475-613ec784ce36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:53.531521 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2e428-2dbf-4f98-9475-613ec784ce36 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:53.541389 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1421/2830] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:27:53.546285 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54ee7e-7268-4c2d-a327-2e6f1430f6d6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:53.551647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:53.557763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54ee7e-7268-4c2d-a327-2e6f1430f6d6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:53.562858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf81ad-456c-4bf5-ba75-f5d23dabcbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:53.563882 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf81ad-456c-4bf5-ba75-f5d23dabcbbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:53.564204 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf81ad-456c-4bf5-ba75-f5d23dabcbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:53.564486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf81ad-456c-4bf5-ba75-f5d23dabcbbc admin admin] PATH_INFO: `/v3/projects/ed174e6ea8b54fe6b0de98e200c09b93/users/6bd76cc71b9f4113983fbfc028c8b958/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:53.566551 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf81ad-456c-4bf5-ba75-f5d23dabcbbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed174e6ea8b54fe6b0de98e200c09b93, user_id=6bd76cc71b9f4113983fbfc028c8b958, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:53.569246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf81ad-456c-4bf5-ba75-f5d23dabcbbc admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:53.579775 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1410/2831] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:27:53 2022] PUT /identity/v3/projects/ed174e6ea8b54fe6b0de98e200c09b93/users/6bd76cc71b9f4113983fbfc028c8b958/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:53.589703 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31be3c-cf9f-4522-90b1-4638c7fa0586 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:53.589998 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31be3c-cf9f-4522-90b1-4638c7fa0586 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:53.590278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31be3c-cf9f-4522-90b1-4638c7fa0586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:53.617135 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5c31be3c-cf9f-4522-90b1-4638c7fa0586 None None] MFA Rules not processed for user `6bd76cc71b9f4113983fbfc028c8b958`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:53.618327 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5c31be3c-cf9f-4522-90b1-4638c7fa0586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:53.684324 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1422/2832] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:53.695348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf81ad-456c-4bf5-ba75-f5d23dabcbbc admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:53.697118 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8ddf81ad-456c-4bf5-ba75-f5d23dabcbbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:53.753242 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf81ad-456c-4bf5-ba75-f5d23dabcbbc admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:53.756783 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686b788-fb80-4394-86f1-31839c4220a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:53.757411 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686b788-fb80-4394-86f1-31839c4220a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:53.757693 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686b788-fb80-4394-86f1-31839c4220a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:53.757967 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686b788-fb80-4394-86f1-31839c4220a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:53.767277 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686b788-fb80-4394-86f1-31839c4220a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:53.768721 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686b788-fb80-4394-86f1-31839c4220a9 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:53.777825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1411/2833] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:27:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:27:53.820457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31be3c-cf9f-4522-90b1-4638c7fa0586 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:53.821822 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5c31be3c-cf9f-4522-90b1-4638c7fa0586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:53.834111 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31be3c-cf9f-4522-90b1-4638c7fa0586 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:53.837700 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15c966-ce12-4401-a15a-20969d3c870b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:53.838331 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15c966-ce12-4401-a15a-20969d3c870b service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:53.838613 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15c966-ce12-4401-a15a-20969d3c870b service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:53.838890 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15c966-ce12-4401-a15a-20969d3c870b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:53.868298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:53.897021 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15c966-ce12-4401-a15a-20969d3c870b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:53.898457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15c966-ce12-4401-a15a-20969d3c870b service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:53.907831 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1423/2834] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:27:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:27:56.745227 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686b788-fb80-4394-86f1-31839c4220a9 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:56.806825 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686b788-fb80-4394-86f1-31839c4220a9 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:56.812152 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d79223-f936-4b43-8833-9d7073e24549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:56.813031 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d79223-f936-4b43-8833-9d7073e24549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:56.813316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d79223-f936-4b43-8833-9d7073e24549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:56.813594 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d79223-f936-4b43-8833-9d7073e24549 admin admin] PATH_INFO: `/v3/users/eeab75c985304c4dbb0955a0e94c3ce2` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:56.814831 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d79223-f936-4b43-8833-9d7073e24549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeab75c985304c4dbb0955a0e94c3ce2)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:56.816791 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d79223-f936-4b43-8833-9d7073e24549 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:56.862462 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-43d79223-f936-4b43-8833-9d7073e24549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeab75c985304c4dbb0955a0e94c3ce2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:56.869374 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-43d79223-f936-4b43-8833-9d7073e24549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeab75c985304c4dbb0955a0e94c3ce2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:56.878107 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-43d79223-f936-4b43-8833-9d7073e24549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeab75c985304c4dbb0955a0e94c3ce2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:56.878820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-43d79223-f936-4b43-8833-9d7073e24549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeab75c985304c4dbb0955a0e94c3ce2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:56.879547 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-43d79223-f936-4b43-8833-9d7073e24549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeab75c985304c4dbb0955a0e94c3ce2'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:56.897559 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1412/2835] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:27:56 2022] DELETE /identity/v3/users/eeab75c985304c4dbb0955a0e94c3ce2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:56.902536 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8359d9-02d0-49e4-af07-321f09b2354b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:56.903028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8359d9-02d0-49e4-af07-321f09b2354b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:56.903133 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8359d9-02d0-49e4-af07-321f09b2354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:56.920795 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fc8359d9-02d0-49e4-af07-321f09b2354b None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:56.921926 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fc8359d9-02d0-49e4-af07-321f09b2354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:56.979877 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1424/2836] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:56.989992 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d79223-f936-4b43-8833-9d7073e24549 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:56.991391 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-43d79223-f936-4b43-8833-9d7073e24549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:57.005348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:57.050750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d79223-f936-4b43-8833-9d7073e24549 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:57.054322 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0782d-16b6-48b2-b1b2-ee544a82319a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:57.054962 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0782d-16b6-48b2-b1b2-ee544a82319a service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:57.055242 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0782d-16b6-48b2-b1b2-ee544a82319a service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:57.055516 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0782d-16b6-48b2-b1b2-ee544a82319a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:57.064974 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0782d-16b6-48b2-b1b2-ee544a82319a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:57.066383 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0782d-16b6-48b2-b1b2-ee544a82319a service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:57.075581 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1413/2837] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:27:57.338453 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8359d9-02d0-49e4-af07-321f09b2354b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:57.339968 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fc8359d9-02d0-49e4-af07-321f09b2354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:57.352615 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8359d9-02d0-49e4-af07-321f09b2354b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:57.357998 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dab588-9cf9-447f-89f7-f151a48b52f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:57.358878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dab588-9cf9-447f-89f7-f151a48b52f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:57.359168 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dab588-9cf9-447f-89f7-f151a48b52f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:57.359447 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dab588-9cf9-447f-89f7-f151a48b52f3 admin admin] PATH_INFO: `/v3/projects/2e5e39f2b157400c9afa74c3915957d6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:57.360653 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dab588-9cf9-447f-89f7-f151a48b52f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5e39f2b157400c9afa74c3915957d6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:57.362590 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dab588-9cf9-447f-89f7-f151a48b52f3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:57.411967 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-38dab588-9cf9-447f-89f7-f151a48b52f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5e39f2b157400c9afa74c3915957d6', 'request_id': 'req-38dab588-9cf9-447f-89f7-f151a48b52f3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:57.418440 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-38dab588-9cf9-447f-89f7-f151a48b52f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5e39f2b157400c9afa74c3915957d6', 'request_id': 'req-38dab588-9cf9-447f-89f7-f151a48b52f3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:57.427387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-38dab588-9cf9-447f-89f7-f151a48b52f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5e39f2b157400c9afa74c3915957d6', 'request_id': 'req-38dab588-9cf9-447f-89f7-f151a48b52f3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:57.437763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-38dab588-9cf9-447f-89f7-f151a48b52f3 admin admin] The token cache is being invalidate because project 2e5e39f2b157400c9afa74c3915957d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:27:57.438053 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-38dab588-9cf9-447f-89f7-f151a48b52f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:57.438691 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-38dab588-9cf9-447f-89f7-f151a48b52f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:57.440264 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1425/2838] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:27:57 2022] DELETE /identity/v3/projects/2e5e39f2b157400c9afa74c3915957d6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:57.444196 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0782d-16b6-48b2-b1b2-ee544a82319a service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:57.454064 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0782d-16b6-48b2-b1b2-ee544a82319a service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:57.511067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca379fd6-a253-4054-b117-4fba9682e17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:57.511854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca379fd6-a253-4054-b117-4fba9682e17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:57.512169 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca379fd6-a253-4054-b117-4fba9682e17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:57.512455 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca379fd6-a253-4054-b117-4fba9682e17b admin admin] PATH_INFO: `/v3/users/17dc688745c642a591cc35901ea0dfe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:57.514162 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca379fd6-a253-4054-b117-4fba9682e17b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17dc688745c642a591cc35901ea0dfe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:57.516293 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca379fd6-a253-4054-b117-4fba9682e17b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:57.564157 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ca379fd6-a253-4054-b117-4fba9682e17b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17dc688745c642a591cc35901ea0dfe6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:57.571027 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ca379fd6-a253-4054-b117-4fba9682e17b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17dc688745c642a591cc35901ea0dfe6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:57.578797 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ca379fd6-a253-4054-b117-4fba9682e17b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17dc688745c642a591cc35901ea0dfe6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:57.579472 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ca379fd6-a253-4054-b117-4fba9682e17b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17dc688745c642a591cc35901ea0dfe6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:57.580158 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ca379fd6-a253-4054-b117-4fba9682e17b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17dc688745c642a591cc35901ea0dfe6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:57.598399 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1414/2839] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:27:57 2022] DELETE /identity/v3/users/17dc688745c642a591cc35901ea0dfe6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:58.129115 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dab588-9cf9-447f-89f7-f151a48b52f3 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:58.130618 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-38dab588-9cf9-447f-89f7-f151a48b52f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:58.145018 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dab588-9cf9-447f-89f7-f151a48b52f3 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:58.193413 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:58.204366 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ad937-d9a1-4669-945b-d0e01cad4a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:58.205395 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ad937-d9a1-4669-945b-d0e01cad4a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:58.205897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ad937-d9a1-4669-945b-d0e01cad4a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:58.206506 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ad937-d9a1-4669-945b-d0e01cad4a55 admin admin] PATH_INFO: `/v3/projects/5395adcba8a24dc1bb291d6b3ce9c169` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:58.207728 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ad937-d9a1-4669-945b-d0e01cad4a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5395adcba8a24dc1bb291d6b3ce9c169)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:58.209669 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ad937-d9a1-4669-945b-d0e01cad4a55 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:58.253825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-380ad937-d9a1-4669-945b-d0e01cad4a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5395adcba8a24dc1bb291d6b3ce9c169', 'request_id': 'req-380ad937-d9a1-4669-945b-d0e01cad4a55'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:58.260795 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-380ad937-d9a1-4669-945b-d0e01cad4a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5395adcba8a24dc1bb291d6b3ce9c169', 'request_id': 'req-380ad937-d9a1-4669-945b-d0e01cad4a55'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:58.267374 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-380ad937-d9a1-4669-945b-d0e01cad4a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5395adcba8a24dc1bb291d6b3ce9c169', 'request_id': 'req-380ad937-d9a1-4669-945b-d0e01cad4a55'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:58.277533 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-380ad937-d9a1-4669-945b-d0e01cad4a55 admin admin] The token cache is being invalidate because project 5395adcba8a24dc1bb291d6b3ce9c169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:27:58.277855 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-380ad937-d9a1-4669-945b-d0e01cad4a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:58.278493 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-380ad937-d9a1-4669-945b-d0e01cad4a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:58.280578 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1426/2840] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:27:58 2022] DELETE /identity/v3/projects/5395adcba8a24dc1bb291d6b3ce9c169 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:27:58.284795 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca379fd6-a253-4054-b117-4fba9682e17b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:58.286300 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ca379fd6-a253-4054-b117-4fba9682e17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:58.299063 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca379fd6-a253-4054-b117-4fba9682e17b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:58.328914 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:58.356741 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3ffff-ffc4-4347-b5ba-f35a134daf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:58.358110 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3ffff-ffc4-4347-b5ba-f35a134daf4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:58.358396 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3ffff-ffc4-4347-b5ba-f35a134daf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:58.358670 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3ffff-ffc4-4347-b5ba-f35a134daf4d admin admin] PATH_INFO: `/v3/users/6bd76cc71b9f4113983fbfc028c8b958` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:58.359860 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3ffff-ffc4-4347-b5ba-f35a134daf4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bd76cc71b9f4113983fbfc028c8b958)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:58.361810 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3ffff-ffc4-4347-b5ba-f35a134daf4d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:58.407316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-35e3ffff-ffc4-4347-b5ba-f35a134daf4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bd76cc71b9f4113983fbfc028c8b958'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:58.414391 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-35e3ffff-ffc4-4347-b5ba-f35a134daf4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bd76cc71b9f4113983fbfc028c8b958'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:58.422463 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-35e3ffff-ffc4-4347-b5ba-f35a134daf4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bd76cc71b9f4113983fbfc028c8b958'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:58.423227 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-35e3ffff-ffc4-4347-b5ba-f35a134daf4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bd76cc71b9f4113983fbfc028c8b958'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:58.423878 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-35e3ffff-ffc4-4347-b5ba-f35a134daf4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bd76cc71b9f4113983fbfc028c8b958'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:58.441709 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1415/2841] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:27:58 2022] DELETE /identity/v3/users/6bd76cc71b9f4113983fbfc028c8b958 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:58.700118 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ad937-d9a1-4669-945b-d0e01cad4a55 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:58.702202 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-380ad937-d9a1-4669-945b-d0e01cad4a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:58.715277 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ad937-d9a1-4669-945b-d0e01cad4a55 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:58.770686 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f96511-7fa0-432c-8db3-5f773876ebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:58.771557 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96511-7fa0-432c-8db3-5f773876ebe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:58.771838 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96511-7fa0-432c-8db3-5f773876ebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:58.772142 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96511-7fa0-432c-8db3-5f773876ebe3 admin admin] PATH_INFO: `/v3/projects/ed174e6ea8b54fe6b0de98e200c09b93` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:58.773298 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f96511-7fa0-432c-8db3-5f773876ebe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed174e6ea8b54fe6b0de98e200c09b93)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:58.775195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f96511-7fa0-432c-8db3-5f773876ebe3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:58.820462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-21f96511-7fa0-432c-8db3-5f773876ebe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed174e6ea8b54fe6b0de98e200c09b93', 'request_id': 'req-21f96511-7fa0-432c-8db3-5f773876ebe3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:58.828273 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-21f96511-7fa0-432c-8db3-5f773876ebe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed174e6ea8b54fe6b0de98e200c09b93', 'request_id': 'req-21f96511-7fa0-432c-8db3-5f773876ebe3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:58.834322 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-21f96511-7fa0-432c-8db3-5f773876ebe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed174e6ea8b54fe6b0de98e200c09b93', 'request_id': 'req-21f96511-7fa0-432c-8db3-5f773876ebe3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:58.844335 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-21f96511-7fa0-432c-8db3-5f773876ebe3 admin admin] The token cache is being invalidate because project ed174e6ea8b54fe6b0de98e200c09b93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:27:58.844618 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-21f96511-7fa0-432c-8db3-5f773876ebe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:58.845236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-21f96511-7fa0-432c-8db3-5f773876ebe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:27:58.846749 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1427/2842] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:27:58 2022] DELETE /identity/v3/projects/ed174e6ea8b54fe6b0de98e200c09b93 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:58.852701 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730e0cb-cfd7-4696-8230-07bb9a13e763 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:58.853025 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730e0cb-cfd7-4696-8230-07bb9a13e763 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:58.853308 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730e0cb-cfd7-4696-8230-07bb9a13e763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:58.871716 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-7730e0cb-cfd7-4696-8230-07bb9a13e763 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:58.873459 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7730e0cb-cfd7-4696-8230-07bb9a13e763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:58.930918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1416/2843] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:58.990877 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0e86d-ed2d-4e08-88f2-e3b5729814b7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:58.991164 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0e86d-ed2d-4e08-88f2-e3b5729814b7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:58.991442 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0e86d-ed2d-4e08-88f2-e3b5729814b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:59.009933 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-24e0e86d-ed2d-4e08-88f2-e3b5729814b7 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:59.011125 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-24e0e86d-ed2d-4e08-88f2-e3b5729814b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:59.019286 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1428/2844] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:59.023246 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730e0cb-cfd7-4696-8230-07bb9a13e763 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:59.033522 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730e0cb-cfd7-4696-8230-07bb9a13e763 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:59.038411 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ae15b-3be1-4a65-9e24-daacdf047a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:59.039047 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ae15b-3be1-4a65-9e24-daacdf047a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:59.039347 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ae15b-3be1-4a65-9e24-daacdf047a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:59.039611 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ae15b-3be1-4a65-9e24-daacdf047a43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:59.040398 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ae15b-3be1-4a65-9e24-daacdf047a43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:27:59.040707 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ae15b-3be1-4a65-9e24-daacdf047a43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:59.042320 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ae15b-3be1-4a65-9e24-daacdf047a43 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:59.054633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1417/2845] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:27:59.059268 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0e86d-ed2d-4e08-88f2-e3b5729814b7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:59.069144 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0e86d-ed2d-4e08-88f2-e3b5729814b7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:59.073810 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547ed71-d555-48fe-b83f-053547623268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:59.074461 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547ed71-d555-48fe-b83f-053547623268 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:59.074752 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547ed71-d555-48fe-b83f-053547623268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:59.075038 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547ed71-d555-48fe-b83f-053547623268 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:59.075730 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547ed71-d555-48fe-b83f-053547623268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:59.077779 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547ed71-d555-48fe-b83f-053547623268 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:59.081279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:59.105028 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1429/2846] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:27:59 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:27:59.109560 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ae15b-3be1-4a65-9e24-daacdf047a43 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:59.119372 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ae15b-3be1-4a65-9e24-daacdf047a43 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:59.156665 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:59.177586 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b25d8b-b859-4d00-a599-ffeba3d0859d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:59.178249 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b25d8b-b859-4d00-a599-ffeba3d0859d admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:59.178534 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b25d8b-b859-4d00-a599-ffeba3d0859d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:59.178832 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b25d8b-b859-4d00-a599-ffeba3d0859d admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:59.179523 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b25d8b-b859-4d00-a599-ffeba3d0859d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:59.181513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b25d8b-b859-4d00-a599-ffeba3d0859d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:59.200921 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1418/2847] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:27:59 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:27:59.204909 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547ed71-d555-48fe-b83f-053547623268 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:59.215136 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547ed71-d555-48fe-b83f-053547623268 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:59.219792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c613c3-0ccd-4784-b917-52e99a688bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:59.220481 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c613c3-0ccd-4784-b917-52e99a688bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:59.220771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c613c3-0ccd-4784-b917-52e99a688bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:59.221057 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c613c3-0ccd-4784-b917-52e99a688bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:59.221791 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c613c3-0ccd-4784-b917-52e99a688bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:59.223381 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c613c3-0ccd-4784-b917-52e99a688bf5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:59.233767 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1430/2848] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:27:59.237445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b25d8b-b859-4d00-a599-ffeba3d0859d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:59.247121 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b25d8b-b859-4d00-a599-ffeba3d0859d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:59.252212 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd7713-9275-4f38-b5d2-c4757efbf39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:59.252857 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd7713-9275-4f38-b5d2-c4757efbf39f admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:59.253146 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd7713-9275-4f38-b5d2-c4757efbf39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:59.253420 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd7713-9275-4f38-b5d2-c4757efbf39f admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:59.254138 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd7713-9275-4f38-b5d2-c4757efbf39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:59.255699 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd7713-9275-4f38-b5d2-c4757efbf39f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:59.265370 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1419/2849] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:27:59.269268 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c613c3-0ccd-4784-b917-52e99a688bf5 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:59.279195 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c613c3-0ccd-4784-b917-52e99a688bf5 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:59.284111 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da4e63-1414-42c2-83f1-babd7b398966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:59.284982 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da4e63-1414-42c2-83f1-babd7b398966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:59.285270 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da4e63-1414-42c2-83f1-babd7b398966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:59.285550 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da4e63-1414-42c2-83f1-babd7b398966 admin admin] PATH_INFO: `/v3/projects/68f2e3c19cf343a09b0f0d7591d217ec/users/9b18fdd4c1f24a0e8c9255c23458b65f/roles/0251662126f747ad9804858316f8573a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:59.300625 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da4e63-1414-42c2-83f1-babd7b398966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f2e3c19cf343a09b0f0d7591d217ec, user_id=9b18fdd4c1f24a0e8c9255c23458b65f, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:59.303262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da4e63-1414-42c2-83f1-babd7b398966 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:59.316289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1431/2850] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:27:59 2022] PUT /identity/v3/projects/68f2e3c19cf343a09b0f0d7591d217ec/users/9b18fdd4c1f24a0e8c9255c23458b65f/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:59.327062 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e7bc0-87b8-4854-a47a-f5653c05232e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:59.327584 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e7bc0-87b8-4854-a47a-f5653c05232e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:59.327700 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e7bc0-87b8-4854-a47a-f5653c05232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:59.353472 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a40e7bc0-87b8-4854-a47a-f5653c05232e None None] MFA Rules not processed for user `9b18fdd4c1f24a0e8c9255c23458b65f`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:59.354655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a40e7bc0-87b8-4854-a47a-f5653c05232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:59.421913 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1420/2851] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:27:59.426395 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da4e63-1414-42c2-83f1-babd7b398966 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:59.486529 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da4e63-1414-42c2-83f1-babd7b398966 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:59.491071 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041633f9-09b7-4d97-8624-7a1085aedfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:59.491725 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041633f9-09b7-4d97-8624-7a1085aedfbc admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:59.492155 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041633f9-09b7-4d97-8624-7a1085aedfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:59.492317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041633f9-09b7-4d97-8624-7a1085aedfbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:59.493248 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041633f9-09b7-4d97-8624-7a1085aedfbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:59.494991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041633f9-09b7-4d97-8624-7a1085aedfbc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:59.520084 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1432/2852] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:27:59 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:27:59.524061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e7bc0-87b8-4854-a47a-f5653c05232e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:59.535182 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e7bc0-87b8-4854-a47a-f5653c05232e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:59.590170 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e0ef5-2e48-4a29-8783-5a3ef5de7c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:59.590838 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e0ef5-2e48-4a29-8783-5a3ef5de7c84 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:59.591126 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e0ef5-2e48-4a29-8783-5a3ef5de7c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:59.591407 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e0ef5-2e48-4a29-8783-5a3ef5de7c84 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:59.592628 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e0ef5-2e48-4a29-8783-5a3ef5de7c84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:59.594553 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e0ef5-2e48-4a29-8783-5a3ef5de7c84 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:59.615055 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1421/2853] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:27:59 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:27:59.619065 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041633f9-09b7-4d97-8624-7a1085aedfbc admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:59.629393 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041633f9-09b7-4d97-8624-7a1085aedfbc admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:59.634754 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3d8cc-3ecd-4ef0-af6c-450cb2f582a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:59.635519 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3d8cc-3ecd-4ef0-af6c-450cb2f582a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:59.635819 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3d8cc-3ecd-4ef0-af6c-450cb2f582a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:59.636178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3d8cc-3ecd-4ef0-af6c-450cb2f582a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:59.636868 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3d8cc-3ecd-4ef0-af6c-450cb2f582a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:59.638501 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3d8cc-3ecd-4ef0-af6c-450cb2f582a0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:59.649371 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1433/2854] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:27:59.653491 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e0ef5-2e48-4a29-8783-5a3ef5de7c84 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:59.664038 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e0ef5-2e48-4a29-8783-5a3ef5de7c84 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:59.668622 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322b4fa-2cc6-4ea0-bf18-6f62821d616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:59.669498 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322b4fa-2cc6-4ea0-bf18-6f62821d616c admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:59.669828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322b4fa-2cc6-4ea0-bf18-6f62821d616c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:59.670601 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322b4fa-2cc6-4ea0-bf18-6f62821d616c admin admin] PATH_INFO: `/v3/projects/7c70e927a64d41cba2565d623a39e648/users/3c6b5c72559a4d11b81c9f490b1b6a6a/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:59.685972 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322b4fa-2cc6-4ea0-bf18-6f62821d616c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c70e927a64d41cba2565d623a39e648, user_id=3c6b5c72559a4d11b81c9f490b1b6a6a, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:59.688685 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322b4fa-2cc6-4ea0-bf18-6f62821d616c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:59.701737 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1422/2855] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:27:59 2022] PUT /identity/v3/projects/7c70e927a64d41cba2565d623a39e648/users/3c6b5c72559a4d11b81c9f490b1b6a6a/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:59.705797 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3d8cc-3ecd-4ef0-af6c-450cb2f582a0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:59.715825 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3d8cc-3ecd-4ef0-af6c-450cb2f582a0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:59.771249 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2202cfe-8e15-4e81-818b-55c087af9337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:59.771847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2202cfe-8e15-4e81-818b-55c087af9337 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:59.772161 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2202cfe-8e15-4e81-818b-55c087af9337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:59.772442 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2202cfe-8e15-4e81-818b-55c087af9337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:59.773169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2202cfe-8e15-4e81-818b-55c087af9337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:59.774759 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2202cfe-8e15-4e81-818b-55c087af9337 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:59.785265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1434/2856] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:27:59.789223 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322b4fa-2cc6-4ea0-bf18-6f62821d616c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:59.799155 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322b4fa-2cc6-4ea0-bf18-6f62821d616c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:27:59.803674 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fa130-3694-412c-a173-c84c63c3eaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:27:59.804573 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fa130-3694-412c-a173-c84c63c3eaae admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:59.804858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fa130-3694-412c-a173-c84c63c3eaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:59.805137 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fa130-3694-412c-a173-c84c63c3eaae admin admin] PATH_INFO: `/v3/projects/7c70e927a64d41cba2565d623a39e648/users/3c6b5c72559a4d11b81c9f490b1b6a6a/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:59.807085 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fa130-3694-412c-a173-c84c63c3eaae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c70e927a64d41cba2565d623a39e648, user_id=3c6b5c72559a4d11b81c9f490b1b6a6a, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:27:59.809754 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fa130-3694-412c-a173-c84c63c3eaae admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:27:59.815763 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:59.820365 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1423/2857] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:27:59 2022] PUT /identity/v3/projects/7c70e927a64d41cba2565d623a39e648/users/3c6b5c72559a4d11b81c9f490b1b6a6a/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:27:59.831052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343758f-5ffb-47e2-a57f-5f36d1925f9d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:27:59.831370 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343758f-5ffb-47e2-a57f-5f36d1925f9d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:27:59.831675 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343758f-5ffb-47e2-a57f-5f36d1925f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:27:59.857631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c343758f-5ffb-47e2-a57f-5f36d1925f9d None None] MFA Rules not processed for user `3c6b5c72559a4d11b81c9f490b1b6a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:27:59.858824 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c343758f-5ffb-47e2-a57f-5f36d1925f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:59.866776 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:59.929761 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1435/2858] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:27:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:27:59.940526 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fa130-3694-412c-a173-c84c63c3eaae admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:27:59.942266 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5b5fa130-3694-412c-a173-c84c63c3eaae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:27:59.999158 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fa130-3694-412c-a173-c84c63c3eaae admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:00.002772 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef8e82-2ac5-4a17-afa0-ab753b31a003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:00.003408 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef8e82-2ac5-4a17-afa0-ab753b31a003 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:00.003689 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef8e82-2ac5-4a17-afa0-ab753b31a003 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:00.003997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef8e82-2ac5-4a17-afa0-ab753b31a003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:00.012789 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef8e82-2ac5-4a17-afa0-ab753b31a003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:00.014728 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef8e82-2ac5-4a17-afa0-ab753b31a003 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:00.024287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1424/2859] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:27:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:28:00.376207 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343758f-5ffb-47e2-a57f-5f36d1925f9d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:00.437782 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343758f-5ffb-47e2-a57f-5f36d1925f9d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:00.442549 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ab6de-e7bc-4420-8518-dae4e733a9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:00.443419 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ab6de-e7bc-4420-8518-dae4e733a9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:00.443702 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ab6de-e7bc-4420-8518-dae4e733a9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:00.444007 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ab6de-e7bc-4420-8518-dae4e733a9a5 admin admin] PATH_INFO: `/v3/users/9b18fdd4c1f24a0e8c9255c23458b65f` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:00.445211 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ab6de-e7bc-4420-8518-dae4e733a9a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b18fdd4c1f24a0e8c9255c23458b65f)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:00.447124 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ab6de-e7bc-4420-8518-dae4e733a9a5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:00.492438 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-728ab6de-e7bc-4420-8518-dae4e733a9a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b18fdd4c1f24a0e8c9255c23458b65f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:00.493099 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-728ab6de-e7bc-4420-8518-dae4e733a9a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b18fdd4c1f24a0e8c9255c23458b65f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:00.501086 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-728ab6de-e7bc-4420-8518-dae4e733a9a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b18fdd4c1f24a0e8c9255c23458b65f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:00.508035 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-728ab6de-e7bc-4420-8518-dae4e733a9a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b18fdd4c1f24a0e8c9255c23458b65f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:00.520547 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-728ab6de-e7bc-4420-8518-dae4e733a9a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b18fdd4c1f24a0e8c9255c23458b65f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:00.526559 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1436/2860] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:28:00 2022] DELETE /identity/v3/users/9b18fdd4c1f24a0e8c9255c23458b65f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:28:00.531537 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17f9cb-dbc9-4e1a-8c7b-7e3b21f29ed7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:00.532009 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17f9cb-dbc9-4e1a-8c7b-7e3b21f29ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:00.532188 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17f9cb-dbc9-4e1a-8c7b-7e3b21f29ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:00.550313 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5d17f9cb-dbc9-4e1a-8c7b-7e3b21f29ed7 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:28:00.551487 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5d17f9cb-dbc9-4e1a-8c7b-7e3b21f29ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:00.609370 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1425/2861] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:28:00.619227 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ab6de-e7bc-4420-8518-dae4e733a9a5 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:00.620639 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-728ab6de-e7bc-4420-8518-dae4e733a9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:00.649092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:00.679627 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ab6de-e7bc-4420-8518-dae4e733a9a5 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:00.683317 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab8a31-f844-48e1-a3fd-fc56ba758d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:00.683987 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8a31-f844-48e1-a3fd-fc56ba758d7e service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:00.684279 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8a31-f844-48e1-a3fd-fc56ba758d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:00.684559 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8a31-f844-48e1-a3fd-fc56ba758d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:00.693991 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab8a31-f844-48e1-a3fd-fc56ba758d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:00.695411 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab8a31-f844-48e1-a3fd-fc56ba758d7e service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:00.705265 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1437/2862] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:28:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:28:00.960720 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17f9cb-dbc9-4e1a-8c7b-7e3b21f29ed7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:00.962203 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5d17f9cb-dbc9-4e1a-8c7b-7e3b21f29ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:00.974229 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17f9cb-dbc9-4e1a-8c7b-7e3b21f29ed7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:00.978814 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:00.979669 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:00.979978 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:00.980257 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8 admin admin] PATH_INFO: `/v3/projects/68f2e3c19cf343a09b0f0d7591d217ec` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:00.981453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f2e3c19cf343a09b0f0d7591d217ec)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:00.983421 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:01.028968 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f2e3c19cf343a09b0f0d7591d217ec', 'request_id': 'req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:01.034623 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f2e3c19cf343a09b0f0d7591d217ec', 'request_id': 'req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:01.041926 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f2e3c19cf343a09b0f0d7591d217ec', 'request_id': 'req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:01.052895 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8 admin admin] The token cache is being invalidate because project 68f2e3c19cf343a09b0f0d7591d217ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:28:01.053189 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:01.053842 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:01.055363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1426/2863] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:28:00 2022] DELETE /identity/v3/projects/68f2e3c19cf343a09b0f0d7591d217ec => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:28:01.059431 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab8a31-f844-48e1-a3fd-fc56ba758d7e service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:01.070127 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab8a31-f844-48e1-a3fd-fc56ba758d7e service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:01.125453 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6abdce-5ed0-4c96-903b-54f82c08da25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:01.126325 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6abdce-5ed0-4c96-903b-54f82c08da25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:01.126614 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6abdce-5ed0-4c96-903b-54f82c08da25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:01.126895 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6abdce-5ed0-4c96-903b-54f82c08da25 admin admin] PATH_INFO: `/v3/users/3c6b5c72559a4d11b81c9f490b1b6a6a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:01.128096 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6abdce-5ed0-4c96-903b-54f82c08da25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c6b5c72559a4d11b81c9f490b1b6a6a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:01.130000 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6abdce-5ed0-4c96-903b-54f82c08da25 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:01.174052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bc6abdce-5ed0-4c96-903b-54f82c08da25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c6b5c72559a4d11b81c9f490b1b6a6a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:01.174692 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bc6abdce-5ed0-4c96-903b-54f82c08da25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c6b5c72559a4d11b81c9f490b1b6a6a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:01.181792 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bc6abdce-5ed0-4c96-903b-54f82c08da25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c6b5c72559a4d11b81c9f490b1b6a6a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:01.189163 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bc6abdce-5ed0-4c96-903b-54f82c08da25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c6b5c72559a4d11b81c9f490b1b6a6a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:01.200757 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-bc6abdce-5ed0-4c96-903b-54f82c08da25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c6b5c72559a4d11b81c9f490b1b6a6a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:01.207151 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1438/2864] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:28:01 2022] DELETE /identity/v3/users/3c6b5c72559a4d11b81c9f490b1b6a6a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:28:01.470918 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:01.472456 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:01.488467 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd8472-5529-4645-a8c0-6bcfa0b09cd8 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:01.514663 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:01.549154 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75373441-a42a-4ff5-87cb-e4ea39deaf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:01.550017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75373441-a42a-4ff5-87cb-e4ea39deaf52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:01.550306 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75373441-a42a-4ff5-87cb-e4ea39deaf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:01.550583 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75373441-a42a-4ff5-87cb-e4ea39deaf52 admin admin] PATH_INFO: `/v3/projects/7c70e927a64d41cba2565d623a39e648` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:01.551828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75373441-a42a-4ff5-87cb-e4ea39deaf52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c70e927a64d41cba2565d623a39e648)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:01.553752 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75373441-a42a-4ff5-87cb-e4ea39deaf52 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:01.599029 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-75373441-a42a-4ff5-87cb-e4ea39deaf52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c70e927a64d41cba2565d623a39e648', 'request_id': 'req-75373441-a42a-4ff5-87cb-e4ea39deaf52'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:01.604884 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-75373441-a42a-4ff5-87cb-e4ea39deaf52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c70e927a64d41cba2565d623a39e648', 'request_id': 'req-75373441-a42a-4ff5-87cb-e4ea39deaf52'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:01.611831 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-75373441-a42a-4ff5-87cb-e4ea39deaf52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c70e927a64d41cba2565d623a39e648', 'request_id': 'req-75373441-a42a-4ff5-87cb-e4ea39deaf52'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:01.622479 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-75373441-a42a-4ff5-87cb-e4ea39deaf52 admin admin] The token cache is being invalidate because project 7c70e927a64d41cba2565d623a39e648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:28:01.623268 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-75373441-a42a-4ff5-87cb-e4ea39deaf52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:01.623883 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-75373441-a42a-4ff5-87cb-e4ea39deaf52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:28:01.625425 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1427/2865] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:28:01 2022] DELETE /identity/v3/projects/7c70e927a64d41cba2565d623a39e648 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:28:01.630719 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5d7fb-011f-4b1a-ba95-43fc74ab976c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:01.631206 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5d7fb-011f-4b1a-ba95-43fc74ab976c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:01.631304 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5d7fb-011f-4b1a-ba95-43fc74ab976c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:01.649137 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8ab5d7fb-011f-4b1a-ba95-43fc74ab976c None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:28:01.650343 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8ab5d7fb-011f-4b1a-ba95-43fc74ab976c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:01.691771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:01.711541 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1439/2866] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:28:01.719466 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b15acb-588e-4a37-bcf1-ad66e4d578a3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:01.719755 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b15acb-588e-4a37-bcf1-ad66e4d578a3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:01.720086 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b15acb-588e-4a37-bcf1-ad66e4d578a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:01.737822 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-99b15acb-588e-4a37-bcf1-ad66e4d578a3 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:28:01.739011 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-99b15acb-588e-4a37-bcf1-ad66e4d578a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:01.746859 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1428/2867] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:28:01.751380 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5d7fb-011f-4b1a-ba95-43fc74ab976c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:01.761134 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5d7fb-011f-4b1a-ba95-43fc74ab976c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:01.766305 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4927540-6b7a-4321-bd2b-e937615c3f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:01.766959 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4927540-6b7a-4321-bd2b-e937615c3f60 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:01.767250 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4927540-6b7a-4321-bd2b-e937615c3f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:01.767537 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4927540-6b7a-4321-bd2b-e937615c3f60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:01.768302 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4927540-6b7a-4321-bd2b-e937615c3f60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 12:28:01.768617 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4927540-6b7a-4321-bd2b-e937615c3f60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:01.770219 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4927540-6b7a-4321-bd2b-e937615c3f60 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:01.781606 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1440/2868] 10.222.0.73 () {58 vars in 1152 bytes} [Thu May 19 12:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 12:28:01.786019 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b15acb-588e-4a37-bcf1-ad66e4d578a3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:01.795075 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b15acb-588e-4a37-bcf1-ad66e4d578a3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:01.799645 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca7003-a6cf-4622-b8ac-c833a590efbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:01.800316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca7003-a6cf-4622-b8ac-c833a590efbd admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:01.801067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca7003-a6cf-4622-b8ac-c833a590efbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:01.801067 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca7003-a6cf-4622-b8ac-c833a590efbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:01.801523 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca7003-a6cf-4622-b8ac-c833a590efbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:01.803495 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca7003-a6cf-4622-b8ac-c833a590efbd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:01.828820 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1429/2869] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:28:01 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:28:01.832955 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4927540-6b7a-4321-bd2b-e937615c3f60 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:01.842945 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4927540-6b7a-4321-bd2b-e937615c3f60 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:01.897804 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f842a13-2a17-4295-bc88-b915bd418e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:01.898473 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f842a13-2a17-4295-bc88-b915bd418e5b admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:01.898756 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f842a13-2a17-4295-bc88-b915bd418e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:01.899035 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f842a13-2a17-4295-bc88-b915bd418e5b admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:01.899721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f842a13-2a17-4295-bc88-b915bd418e5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:01.901655 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f842a13-2a17-4295-bc88-b915bd418e5b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:01.921677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1441/2870] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:28:01 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 12:28:01.925682 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca7003-a6cf-4622-b8ac-c833a590efbd admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:01.936241 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca7003-a6cf-4622-b8ac-c833a590efbd admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:01.940775 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7c367-2c1e-4321-a300-77bbf4cb6215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:01.941472 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7c367-2c1e-4321-a300-77bbf4cb6215 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:01.941753 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7c367-2c1e-4321-a300-77bbf4cb6215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:01.942028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7c367-2c1e-4321-a300-77bbf4cb6215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:01.942750 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7c367-2c1e-4321-a300-77bbf4cb6215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:01.944376 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7c367-2c1e-4321-a300-77bbf4cb6215 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:01.955143 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1430/2871] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:28:01.958951 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f842a13-2a17-4295-bc88-b915bd418e5b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:01.969053 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f842a13-2a17-4295-bc88-b915bd418e5b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:01.973601 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74302e52-eeb2-4e65-9ce4-1943fb6f4c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:01.974246 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74302e52-eeb2-4e65-9ce4-1943fb6f4c82 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:01.974531 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74302e52-eeb2-4e65-9ce4-1943fb6f4c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:01.974808 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74302e52-eeb2-4e65-9ce4-1943fb6f4c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:01.975575 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74302e52-eeb2-4e65-9ce4-1943fb6f4c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:01.977169 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74302e52-eeb2-4e65-9ce4-1943fb6f4c82 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:01.987583 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1442/2872] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:28:01.991477 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7c367-2c1e-4321-a300-77bbf4cb6215 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:02.001791 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7c367-2c1e-4321-a300-77bbf4cb6215 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:02.006366 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8887cbc-c9fa-4d2d-b430-36d239b2d9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:02.007231 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8887cbc-c9fa-4d2d-b430-36d239b2d9c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:02.007513 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8887cbc-c9fa-4d2d-b430-36d239b2d9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:02.007791 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8887cbc-c9fa-4d2d-b430-36d239b2d9c1 admin admin] PATH_INFO: `/v3/projects/bbe111f574a949dc9f914856ad57f42e/users/05ec7424621f49f98f2e93275f2bc604/roles/0251662126f747ad9804858316f8573a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:02.021961 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8887cbc-c9fa-4d2d-b430-36d239b2d9c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe111f574a949dc9f914856ad57f42e, user_id=05ec7424621f49f98f2e93275f2bc604, role_id=0251662126f747ad9804858316f8573a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:02.024649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8887cbc-c9fa-4d2d-b430-36d239b2d9c1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:02.036861 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1431/2873] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:28:01 2022] PUT /identity/v3/projects/bbe111f574a949dc9f914856ad57f42e/users/05ec7424621f49f98f2e93275f2bc604/roles/0251662126f747ad9804858316f8573a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 12:28:02.042174 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae0a7e-f2e0-41ee-89a6-08345c144a82 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:02.042478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae0a7e-f2e0-41ee-89a6-08345c144a82 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:02.042763 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae0a7e-f2e0-41ee-89a6-08345c144a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:02.061544 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5cae0a7e-f2e0-41ee-89a6-08345c144a82 None None] MFA Rules not processed for user `dd72f905284743f09fbd1a8016bb1910`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:28:02.062734 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5cae0a7e-f2e0-41ee-89a6-08345c144a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:02.123666 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1443/2874] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 12:28:02.133287 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8887cbc-c9fa-4d2d-b430-36d239b2d9c1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:02.134948 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c8887cbc-c9fa-4d2d-b430-36d239b2d9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:02.191057 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8887cbc-c9fa-4d2d-b430-36d239b2d9c1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:02.194792 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29e139-5806-4a02-8cf4-dc6da0f0b628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:02.195423 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29e139-5806-4a02-8cf4-dc6da0f0b628 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:02.195706 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29e139-5806-4a02-8cf4-dc6da0f0b628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:02.196017 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29e139-5806-4a02-8cf4-dc6da0f0b628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:02.202839 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:02.205468 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29e139-5806-4a02-8cf4-dc6da0f0b628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:02.207981 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29e139-5806-4a02-8cf4-dc6da0f0b628 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:02.218879 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1432/2875] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:28:05.851721 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3401c-d9c0-4411-98c9-40c70738dff6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:05.852278 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3401c-d9c0-4411-98c9-40c70738dff6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:05.852458 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3401c-d9c0-4411-98c9-40c70738dff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:05.880751 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-24d3401c-d9c0-4411-98c9-40c70738dff6 None None] MFA Rules not processed for user `05ec7424621f49f98f2e93275f2bc604`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:28:05.882002 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-24d3401c-d9c0-4411-98c9-40c70738dff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:05.926110 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:05.949998 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1444/2876] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:28:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:28:05.954490 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29e139-5806-4a02-8cf4-dc6da0f0b628 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:05.964471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29e139-5806-4a02-8cf4-dc6da0f0b628 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:05.969356 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b721df-eca4-4982-9fb1-85d55552a526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:05.970037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b721df-eca4-4982-9fb1-85d55552a526 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:05.970321 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b721df-eca4-4982-9fb1-85d55552a526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:05.970595 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b721df-eca4-4982-9fb1-85d55552a526 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:05.971292 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b721df-eca4-4982-9fb1-85d55552a526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:05.973219 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b721df-eca4-4982-9fb1-85d55552a526 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:06.002400 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1433/2877] 10.222.0.73 () {60 vars in 1152 bytes} [Thu May 19 12:28:05 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:28:06.004314 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3401c-d9c0-4411-98c9-40c70738dff6 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:06.016049 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3401c-d9c0-4411-98c9-40c70738dff6 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:06.073643 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59b073-810f-4e9a-90b6-30ea8b699d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:06.074332 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59b073-810f-4e9a-90b6-30ea8b699d08 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:06.074619 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59b073-810f-4e9a-90b6-30ea8b699d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:06.074897 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59b073-810f-4e9a-90b6-30ea8b699d08 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:06.075589 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59b073-810f-4e9a-90b6-30ea8b699d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:06.077581 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59b073-810f-4e9a-90b6-30ea8b699d08 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:06.100775 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1445/2878] 10.222.0.73 () {60 vars in 1143 bytes} [Thu May 19 12:28:06 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 12:28:06.102423 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b721df-eca4-4982-9fb1-85d55552a526 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:06.114489 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b721df-eca4-4982-9fb1-85d55552a526 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:06.125061 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754baa0-d11b-48c0-89b3-e49b0621bd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:06.125749 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754baa0-d11b-48c0-89b3-e49b0621bd4f admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:06.126037 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754baa0-d11b-48c0-89b3-e49b0621bd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:06.126317 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754baa0-d11b-48c0-89b3-e49b0621bd4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:06.127103 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754baa0-d11b-48c0-89b3-e49b0621bd4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:06.128765 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754baa0-d11b-48c0-89b3-e49b0621bd4f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:06.139875 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1434/2879] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 12:28:06.144119 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59b073-810f-4e9a-90b6-30ea8b699d08 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:06.156060 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59b073-810f-4e9a-90b6-30ea8b699d08 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:06.163356 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd0997-d186-4b54-9b84-8f3345d4ae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:06.164835 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd0997-d186-4b54-9b84-8f3345d4ae12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:06.165193 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd0997-d186-4b54-9b84-8f3345d4ae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:06.165549 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd0997-d186-4b54-9b84-8f3345d4ae12 admin admin] PATH_INFO: `/v3/projects/79b6addb0fa14eea870dc6944fe4e3cc/users/13720f0964ef4a0a9994aeef02dfc711/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:06.183946 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd0997-d186-4b54-9b84-8f3345d4ae12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79b6addb0fa14eea870dc6944fe4e3cc, user_id=13720f0964ef4a0a9994aeef02dfc711, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:06.186907 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd0997-d186-4b54-9b84-8f3345d4ae12 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:06.199802 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1446/2880] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:28:06 2022] PUT /identity/v3/projects/79b6addb0fa14eea870dc6944fe4e3cc/users/13720f0964ef4a0a9994aeef02dfc711/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:28:06.203861 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754baa0-d11b-48c0-89b3-e49b0621bd4f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:06.214034 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754baa0-d11b-48c0-89b3-e49b0621bd4f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:06.273851 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d31e62-61c3-4c21-b247-915f80360c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:06.274666 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d31e62-61c3-4c21-b247-915f80360c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:06.274950 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d31e62-61c3-4c21-b247-915f80360c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:06.275229 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d31e62-61c3-4c21-b247-915f80360c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:06.275995 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d31e62-61c3-4c21-b247-915f80360c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:06.277600 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d31e62-61c3-4c21-b247-915f80360c67 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:06.292316 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1435/2881] 10.222.0.73 () {58 vars in 1121 bytes} [Thu May 19 12:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 12:28:06.293647 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd0997-d186-4b54-9b84-8f3345d4ae12 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:06.313490 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd0997-d186-4b54-9b84-8f3345d4ae12 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:06.326224 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849483f2-b240-4132-8499-8e41c1096b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:06.327171 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849483f2-b240-4132-8499-8e41c1096b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:06.327457 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849483f2-b240-4132-8499-8e41c1096b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:06.327739 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849483f2-b240-4132-8499-8e41c1096b7a admin admin] PATH_INFO: `/v3/projects/79b6addb0fa14eea870dc6944fe4e3cc/users/13720f0964ef4a0a9994aeef02dfc711/roles/489aaa5486d84d4a917a0a4208a7dbe6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:06.329785 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849483f2-b240-4132-8499-8e41c1096b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=79b6addb0fa14eea870dc6944fe4e3cc, user_id=13720f0964ef4a0a9994aeef02dfc711, role_id=489aaa5486d84d4a917a0a4208a7dbe6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:06.332464 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849483f2-b240-4132-8499-8e41c1096b7a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:06.343664 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1447/2882] 10.222.0.73 () {60 vars in 1482 bytes} [Thu May 19 12:28:06 2022] PUT /identity/v3/projects/79b6addb0fa14eea870dc6944fe4e3cc/users/13720f0964ef4a0a9994aeef02dfc711/roles/489aaa5486d84d4a917a0a4208a7dbe6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:28:10.933957 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40102a8c-94c9-4d63-a3be-37f218f6cf09 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:10.934548 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40102a8c-94c9-4d63-a3be-37f218f6cf09 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:10.934845 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40102a8c-94c9-4d63-a3be-37f218f6cf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:10.963288 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-40102a8c-94c9-4d63-a3be-37f218f6cf09 None None] MFA Rules not processed for user `13720f0964ef4a0a9994aeef02dfc711`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:28:10.964545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-40102a8c-94c9-4d63-a3be-37f218f6cf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:11.043835 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1436/2883] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:28:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:28:11.065424 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849483f2-b240-4132-8499-8e41c1096b7a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:11.067221 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-849483f2-b240-4132-8499-8e41c1096b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:11.162184 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849483f2-b240-4132-8499-8e41c1096b7a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:11.168005 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bcff8-6c81-41e2-8022-f51d7a787dfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:11.168761 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bcff8-6c81-41e2-8022-f51d7a787dfb service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:11.169055 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bcff8-6c81-41e2-8022-f51d7a787dfb service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:11.169376 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bcff8-6c81-41e2-8022-f51d7a787dfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:11.206765 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:11.234102 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bcff8-6c81-41e2-8022-f51d7a787dfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:11.235700 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bcff8-6c81-41e2-8022-f51d7a787dfb service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:11.244747 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1448/2884] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:28:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:28:19.591649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40102a8c-94c9-4d63-a3be-37f218f6cf09 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:19.593720 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-40102a8c-94c9-4d63-a3be-37f218f6cf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:19.642048 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:19.666804 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40102a8c-94c9-4d63-a3be-37f218f6cf09 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:19.671993 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ce52e-2aa4-44c8-9c3e-ada0cf659efb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cccb366fc6429e9a30d4f9de64e8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:19.672671 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ce52e-2aa4-44c8-9c3e-ada0cf659efb service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:19.672955 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ce52e-2aa4-44c8-9c3e-ada0cf659efb service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:19.673231 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ce52e-2aa4-44c8-9c3e-ada0cf659efb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:19.674984 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4e7ce52e-2aa4-44c8-9c3e-ada0cf659efb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:19.689433 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ce52e-2aa4-44c8-9c3e-ada0cf659efb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:19.691034 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ce52e-2aa4-44c8-9c3e-ada0cf659efb service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:19.702354 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1437/2885] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:28:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:28:21.240735 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=13 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:29.697055 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=12 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:32.684862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042c48c-9331-4142-a68e-bb5031c5f5f9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:32.685359 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042c48c-9331-4142-a68e-bb5031c5f5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:32.685469 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042c48c-9331-4142-a68e-bb5031c5f5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:32.702557 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0042c48c-9331-4142-a68e-bb5031c5f5f9 None None] MFA Rules not processed for user `05ec7424621f49f98f2e93275f2bc604`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:28:32.703747 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0042c48c-9331-4142-a68e-bb5031c5f5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:32.710552 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1449/2886] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:28:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:28:33.444164 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ce52e-2aa4-44c8-9c3e-ada0cf659efb service placement] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:33.445545 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4e7ce52e-2aa4-44c8-9c3e-ada0cf659efb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:33.459290 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ce52e-2aa4-44c8-9c3e-ada0cf659efb service placement] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:33.464418 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e46a25-d08a-4efd-9fa7-e3c8e2448723 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cccb366fc6429e9a30d4f9de64e8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:33.465074 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e46a25-d08a-4efd-9fa7-e3c8e2448723 service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:33.465363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e46a25-d08a-4efd-9fa7-e3c8e2448723 service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:33.466301 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e46a25-d08a-4efd-9fa7-e3c8e2448723 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:33.468132 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d4e46a25-d08a-4efd-9fa7-e3c8e2448723 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:33.480983 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e46a25-d08a-4efd-9fa7-e3c8e2448723 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:33.482488 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e46a25-d08a-4efd-9fa7-e3c8e2448723 service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:33.493065 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1438/2887] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:28:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:28:42.697178 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:43.489281 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:46.655041 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042c48c-9331-4142-a68e-bb5031c5f5f9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:46.656708 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0042c48c-9331-4142-a68e-bb5031c5f5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:46.674673 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042c48c-9331-4142-a68e-bb5031c5f5f9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:46.680082 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7547e-520a-4175-9baa-84050c9c5522 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:46.680729 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7547e-520a-4175-9baa-84050c9c5522 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:46.681013 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7547e-520a-4175-9baa-84050c9c5522 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:46.681289 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7547e-520a-4175-9baa-84050c9c5522 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:46.683025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a7c7547e-520a-4175-9baa-84050c9c5522 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:46.695225 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7547e-520a-4175-9baa-84050c9c5522 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:46.696839 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7547e-520a-4175-9baa-84050c9c5522 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:46.707631 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1450/2888] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:28:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:28:49.971353 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e46a25-d08a-4efd-9fa7-e3c8e2448723 service placement] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:49.972828 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d4e46a25-d08a-4efd-9fa7-e3c8e2448723 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:50.028058 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e46a25-d08a-4efd-9fa7-e3c8e2448723 service placement] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:50.031668 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a0e52-11ab-4ac1-8244-860f1b0fa62f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:50.032348 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a0e52-11ab-4ac1-8244-860f1b0fa62f service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:50.032640 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a0e52-11ab-4ac1-8244-860f1b0fa62f service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:50.033175 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a0e52-11ab-4ac1-8244-860f1b0fa62f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:50.042152 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a0e52-11ab-4ac1-8244-860f1b0fa62f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:50.043584 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a0e52-11ab-4ac1-8244-860f1b0fa62f service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:50.053581 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1439/2889] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:28:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:28:51.599173 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7547e-520a-4175-9baa-84050c9c5522 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:28:51.610583 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7547e-520a-4175-9baa-84050c9c5522 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:28:51.616130 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e098b-3e29-4d22-84c2-15295ede5088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:28:51.616899 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e098b-3e29-4d22-84c2-15295ede5088 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:28:51.617176 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e098b-3e29-4d22-84c2-15295ede5088 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:28:51.617454 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e098b-3e29-4d22-84c2-15295ede5088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:28:51.619282 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f99e098b-3e29-4d22-84c2-15295ede5088 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:28:51.631652 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e098b-3e29-4d22-84c2-15295ede5088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:28:51.633242 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e098b-3e29-4d22-84c2-15295ede5088 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:28:51.644306 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1451/2890] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:28:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:29:00.049301 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=26 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:01.639858 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=12 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:25.976656 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a0e52-11ab-4ac1-8244-860f1b0fa62f service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:30:25.985421 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a0e52-11ab-4ac1-8244-860f1b0fa62f service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:30:25.989661 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4d4cc-8a42-46a6-a251-5d2015054bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:30:25.990309 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4d4cc-8a42-46a6-a251-5d2015054bbe service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:30:25.990582 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4d4cc-8a42-46a6-a251-5d2015054bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:30:25.990859 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4d4cc-8a42-46a6-a251-5d2015054bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:30:25.992649 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-82f4d4cc-8a42-46a6-a251-5d2015054bbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:30:26.001946 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4d4cc-8a42-46a6-a251-5d2015054bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:30:26.003377 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4d4cc-8a42-46a6-a251-5d2015054bbe service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:30:26.011692 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1440/2891] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:30:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:30:36.008152 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:05.656436 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e098b-3e29-4d22-84c2-15295ede5088 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:31:05.666555 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e098b-3e29-4d22-84c2-15295ede5088 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:31:05.670068 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769e394-f26a-4617-bd77-cdc0e8c703e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:31:05.670704 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769e394-f26a-4617-bd77-cdc0e8c703e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:31:05.670985 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769e394-f26a-4617-bd77-cdc0e8c703e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:31:05.671262 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769e394-f26a-4617-bd77-cdc0e8c703e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:31:05.673649 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0769e394-f26a-4617-bd77-cdc0e8c703e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:31:05.686692 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769e394-f26a-4617-bd77-cdc0e8c703e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:31:05.688123 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769e394-f26a-4617-bd77-cdc0e8c703e9 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:31:05.698862 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1452/2892] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:31:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:31:06.871212 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4d4cc-8a42-46a6-a251-5d2015054bbe service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:31:06.881486 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4d4cc-8a42-46a6-a251-5d2015054bbe service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:31:06.885206 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb8f74-a859-4d62-9880-9ac2179089e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:31:06.885858 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb8f74-a859-4d62-9880-9ac2179089e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:31:06.886144 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb8f74-a859-4d62-9880-9ac2179089e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:31:06.886429 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb8f74-a859-4d62-9880-9ac2179089e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:31:06.888590 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-68fb8f74-a859-4d62-9880-9ac2179089e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:31:06.902476 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb8f74-a859-4d62-9880-9ac2179089e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:31:06.903907 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb8f74-a859-4d62-9880-9ac2179089e9 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:31:06.915163 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1441/2893] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:31:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:31:09.190103 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06b3f0-63a6-4122-aa42-36197bfcc84e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:31:09.190607 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06b3f0-63a6-4122-aa42-36197bfcc84e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:31:09.190712 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06b3f0-63a6-4122-aa42-36197bfcc84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:31:09.209430 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7f06b3f0-63a6-4122-aa42-36197bfcc84e None None] MFA Rules not processed for user `05ec7424621f49f98f2e93275f2bc604`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:31:09.210645 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7f06b3f0-63a6-4122-aa42-36197bfcc84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:31:09.217601 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1453/2894] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:31:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:31:09.526473 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb8f74-a859-4d62-9880-9ac2179089e9 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:31:09.535353 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb8f74-a859-4d62-9880-9ac2179089e9 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:31:09.539187 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d97dbf-930d-42ac-a554-01c8aeee36a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:31:09.539815 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d97dbf-930d-42ac-a554-01c8aeee36a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:31:09.540381 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d97dbf-930d-42ac-a554-01c8aeee36a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:31:09.540660 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d97dbf-930d-42ac-a554-01c8aeee36a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:31:09.542380 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d4d97dbf-930d-42ac-a554-01c8aeee36a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:31:09.551985 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d97dbf-930d-42ac-a554-01c8aeee36a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:31:09.553480 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d97dbf-930d-42ac-a554-01c8aeee36a0 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:31:09.562557 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1442/2895] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:31:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:31:19.203845 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=9 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:19.558501 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=12 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:16.907847 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06b3f0-63a6-4122-aa42-36197bfcc84e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:33:16.909272 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7f06b3f0-63a6-4122-aa42-36197bfcc84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:33:16.994765 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06b3f0-63a6-4122-aa42-36197bfcc84e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:33:16.998368 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ca038-65d4-4202-b14c-97474221c5a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44bb5fc455a4965ac6904fb548530f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:33:16.999043 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ca038-65d4-4202-b14c-97474221c5a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:33:16.999387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ca038-65d4-4202-b14c-97474221c5a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:33:16.999677 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ca038-65d4-4202-b14c-97474221c5a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:33:17.021162 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ca038-65d4-4202-b14c-97474221c5a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:33:17.022596 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ca038-65d4-4202-b14c-97474221c5a3 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:33:17.031684 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1454/2896] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:33:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:33:22.638996 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d97dbf-930d-42ac-a554-01c8aeee36a0 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:33:22.688172 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d97dbf-930d-42ac-a554-01c8aeee36a0 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:33:22.693884 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904ad03-269a-4169-8806-6761af2df2df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cccb366fc6429e9a30d4f9de64e8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:33:22.694531 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904ad03-269a-4169-8806-6761af2df2df service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:33:22.694813 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904ad03-269a-4169-8806-6761af2df2df service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:33:22.695088 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904ad03-269a-4169-8806-6761af2df2df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:33:22.703850 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904ad03-269a-4169-8806-6761af2df2df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:33:22.705445 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904ad03-269a-4169-8806-6761af2df2df service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:33:22.715703 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1443/2897] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:33:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:33:27.027483 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=45 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:27.997409 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d3730-2279-459b-8c4d-3a8872c2bd7a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:33:27.997699 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d3730-2279-459b-8c4d-3a8872c2bd7a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:33:27.997982 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d3730-2279-459b-8c4d-3a8872c2bd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:33:28.015236 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-bc2d3730-2279-459b-8c4d-3a8872c2bd7a None None] MFA Rules not processed for user `05ec7424621f49f98f2e93275f2bc604`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 12:33:28.016462 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bc2d3730-2279-459b-8c4d-3a8872c2bd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:33:28.023251 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1455/2898] 10.222.0.73 () {58 vars in 957 bytes} [Thu May 19 12:33:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 12:33:31.163650 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904ad03-269a-4169-8806-6761af2df2df service placement] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:33:31.218280 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904ad03-269a-4169-8806-6761af2df2df service placement] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:33:31.225406 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdea51-15ec-4b82-8074-51bb48db53a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:33:31.226071 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdea51-15ec-4b82-8074-51bb48db53a3 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:33:31.226358 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdea51-15ec-4b82-8074-51bb48db53a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:33:31.226633 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdea51-15ec-4b82-8074-51bb48db53a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:33:31.228482 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5ecdea51-15ec-4b82-8074-51bb48db53a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:33:31.242022 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdea51-15ec-4b82-8074-51bb48db53a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:33:31.243817 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdea51-15ec-4b82-8074-51bb48db53a3 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:33:31.257195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1444/2899] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:33:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:33:38.010436 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:41.250831 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=30 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:34.340396 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d3730-2279-459b-8c4d-3a8872c2bd7a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:34.360199 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d3730-2279-459b-8c4d-3a8872c2bd7a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:34.363823 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad0a93-b894-4751-ad52-27260945cd95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:34.364486 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0a93-b894-4751-ad52-27260945cd95 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:34.364768 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0a93-b894-4751-ad52-27260945cd95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:34.365073 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0a93-b894-4751-ad52-27260945cd95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:34.372771 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad0a93-b894-4751-ad52-27260945cd95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:34.374837 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad0a93-b894-4751-ad52-27260945cd95 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:34.383242 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1456/2900] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:35:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:35:36.991258 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdea51-15ec-4b82-8074-51bb48db53a3 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:37.020395 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdea51-15ec-4b82-8074-51bb48db53a3 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:37.026012 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc54a62-b067-4a63-9fad-c4be835ce7d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd0c1f0710f3447d94e67048a508781e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:37.026671 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc54a62-b067-4a63-9fad-c4be835ce7d5 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:37.026961 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc54a62-b067-4a63-9fad-c4be835ce7d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:37.027244 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc54a62-b067-4a63-9fad-c4be835ce7d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:37.038435 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc54a62-b067-4a63-9fad-c4be835ce7d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:37.040550 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc54a62-b067-4a63-9fad-c4be835ce7d5 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:37.053226 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1445/2901] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:35:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:35:44.380177 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=10 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:47.048363 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=10 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:49.194797 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad0a93-b894-4751-ad52-27260945cd95 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:49.203478 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad0a93-b894-4751-ad52-27260945cd95 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:49.207080 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc12d-b556-4bba-b961-9fb14f51bf3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4897919923a64881ac5540cc5d58df1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:49.207710 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc12d-b556-4bba-b961-9fb14f51bf3b service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:49.208025 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc12d-b556-4bba-b961-9fb14f51bf3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:49.208306 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc12d-b556-4bba-b961-9fb14f51bf3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:49.276523 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fc12d-b556-4bba-b961-9fb14f51bf3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:49.277878 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fc12d-b556-4bba-b961-9fb14f51bf3b service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:49.297052 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1457/2902] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:35:55.437195 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc54a62-b067-4a63-9fad-c4be835ce7d5 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:55.447661 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc54a62-b067-4a63-9fad-c4be835ce7d5 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:55.453422 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd633e7-4517-438d-8ee0-4b9d318e78e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:55.453652 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd633e7-4517-438d-8ee0-4b9d318e78e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:55.453937 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd633e7-4517-438d-8ee0-4b9d318e78e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:55.454212 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd633e7-4517-438d-8ee0-4b9d318e78e9 admin admin] PATH_INFO: `/v3/users/05ec7424621f49f98f2e93275f2bc604` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:55.455397 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd633e7-4517-438d-8ee0-4b9d318e78e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ec7424621f49f98f2e93275f2bc604)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:55.457343 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd633e7-4517-438d-8ee0-4b9d318e78e9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:55.502921 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3bd633e7-4517-438d-8ee0-4b9d318e78e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ec7424621f49f98f2e93275f2bc604'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:55.509655 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3bd633e7-4517-438d-8ee0-4b9d318e78e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ec7424621f49f98f2e93275f2bc604'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:55.516809 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3bd633e7-4517-438d-8ee0-4b9d318e78e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ec7424621f49f98f2e93275f2bc604'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:55.517423 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3bd633e7-4517-438d-8ee0-4b9d318e78e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ec7424621f49f98f2e93275f2bc604'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:55.518028 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3bd633e7-4517-438d-8ee0-4b9d318e78e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ec7424621f49f98f2e93275f2bc604'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:55.536491 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1446/2903] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:35:55 2022] DELETE /identity/v3/users/05ec7424621f49f98f2e93275f2bc604 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:55.703548 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc12d-b556-4bba-b961-9fb14f51bf3b service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:55.717239 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc12d-b556-4bba-b961-9fb14f51bf3b service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:55.781335 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8881bf-32f7-4ae1-8422-17969a8a40a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:55.782198 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8881bf-32f7-4ae1-8422-17969a8a40a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:55.782506 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8881bf-32f7-4ae1-8422-17969a8a40a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:55.782783 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8881bf-32f7-4ae1-8422-17969a8a40a0 admin admin] PATH_INFO: `/v3/projects/bbe111f574a949dc9f914856ad57f42e` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:55.783970 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8881bf-32f7-4ae1-8422-17969a8a40a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe111f574a949dc9f914856ad57f42e)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:55.785846 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8881bf-32f7-4ae1-8422-17969a8a40a0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:55.830995 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-df8881bf-32f7-4ae1-8422-17969a8a40a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe111f574a949dc9f914856ad57f42e', 'request_id': 'req-df8881bf-32f7-4ae1-8422-17969a8a40a0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:55.838106 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-df8881bf-32f7-4ae1-8422-17969a8a40a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe111f574a949dc9f914856ad57f42e', 'request_id': 'req-df8881bf-32f7-4ae1-8422-17969a8a40a0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:55.844949 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-df8881bf-32f7-4ae1-8422-17969a8a40a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe111f574a949dc9f914856ad57f42e', 'request_id': 'req-df8881bf-32f7-4ae1-8422-17969a8a40a0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:55.860882 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:55.867799 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-df8881bf-32f7-4ae1-8422-17969a8a40a0 admin admin] The token cache is being invalidate because project bbe111f574a949dc9f914856ad57f42e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:35:55.868416 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-df8881bf-32f7-4ae1-8422-17969a8a40a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:55.869086 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-df8881bf-32f7-4ae1-8422-17969a8a40a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:55.870626 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1458/2904] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:35:55 2022] DELETE /identity/v3/projects/bbe111f574a949dc9f914856ad57f42e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:55.874811 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd633e7-4517-438d-8ee0-4b9d318e78e9 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:55.876302 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3bd633e7-4517-438d-8ee0-4b9d318e78e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:55.889427 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd633e7-4517-438d-8ee0-4b9d318e78e9 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:55.944291 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b7bbf-d42e-4b61-9a8b-5fad55a2e83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:55.945154 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b7bbf-d42e-4b61-9a8b-5fad55a2e83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:55.945442 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b7bbf-d42e-4b61-9a8b-5fad55a2e83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:55.945720 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b7bbf-d42e-4b61-9a8b-5fad55a2e83d admin admin] PATH_INFO: `/v3/users/13720f0964ef4a0a9994aeef02dfc711` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:55.946903 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b7bbf-d42e-4b61-9a8b-5fad55a2e83d admin admin] RBAC: Authorizing `identity:delete_user(user_id=13720f0964ef4a0a9994aeef02dfc711)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:55.948854 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b7bbf-d42e-4b61-9a8b-5fad55a2e83d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:55.994509 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-565b7bbf-d42e-4b61-9a8b-5fad55a2e83d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13720f0964ef4a0a9994aeef02dfc711'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:56.001453 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-565b7bbf-d42e-4b61-9a8b-5fad55a2e83d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13720f0964ef4a0a9994aeef02dfc711'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:56.008672 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-565b7bbf-d42e-4b61-9a8b-5fad55a2e83d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13720f0964ef4a0a9994aeef02dfc711'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:56.009327 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-565b7bbf-d42e-4b61-9a8b-5fad55a2e83d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13720f0964ef4a0a9994aeef02dfc711'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:56.009997 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-565b7bbf-d42e-4b61-9a8b-5fad55a2e83d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13720f0964ef4a0a9994aeef02dfc711'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:56.018296 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:56.031010 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1447/2905] 10.222.0.73 () {58 vars in 1223 bytes} [Thu May 19 12:35:55 2022] DELETE /identity/v3/users/13720f0964ef4a0a9994aeef02dfc711 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:35:56.196713 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8881bf-32f7-4ae1-8422-17969a8a40a0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:35:56.198258 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-df8881bf-32f7-4ae1-8422-17969a8a40a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:35:56.220121 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8881bf-32f7-4ae1-8422-17969a8a40a0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:35:56.278092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd90df8-aec5-49af-920b-a0fe63ccdca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd72f905284743f09fbd1a8016bb1910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df2a417664864d77b82ff77f60f05d0b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:35:56.278996 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd90df8-aec5-49af-920b-a0fe63ccdca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:35:56.279287 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd90df8-aec5-49af-920b-a0fe63ccdca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:35:56.279596 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd90df8-aec5-49af-920b-a0fe63ccdca1 admin admin] PATH_INFO: `/v3/projects/79b6addb0fa14eea870dc6944fe4e3cc` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:35:56.281186 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd90df8-aec5-49af-920b-a0fe63ccdca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79b6addb0fa14eea870dc6944fe4e3cc)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:35:56.283092 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd90df8-aec5-49af-920b-a0fe63ccdca1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:35:56.328661 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2bd90df8-aec5-49af-920b-a0fe63ccdca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79b6addb0fa14eea870dc6944fe4e3cc', 'request_id': 'req-2bd90df8-aec5-49af-920b-a0fe63ccdca1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:56.335616 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2bd90df8-aec5-49af-920b-a0fe63ccdca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79b6addb0fa14eea870dc6944fe4e3cc', 'request_id': 'req-2bd90df8-aec5-49af-920b-a0fe63ccdca1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:56.341680 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2bd90df8-aec5-49af-920b-a0fe63ccdca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79b6addb0fa14eea870dc6944fe4e3cc', 'request_id': 'req-2bd90df8-aec5-49af-920b-a0fe63ccdca1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:56.351943 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2bd90df8-aec5-49af-920b-a0fe63ccdca1 admin admin] The token cache is being invalidate because project 79b6addb0fa14eea870dc6944fe4e3cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 12:35:56.352245 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2bd90df8-aec5-49af-920b-a0fe63ccdca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:56.352876 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2bd90df8-aec5-49af-920b-a0fe63ccdca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 12:35:56.354387 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1459/2906] 10.222.0.73 () {58 vars in 1232 bytes} [Thu May 19 12:35:56 2022] DELETE /identity/v3/projects/79b6addb0fa14eea870dc6944fe4e3cc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 12:36:06.031931 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:36:06.348770 dv-cinder-804735-30-iscsi devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:38:27.588786 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b7bbf-d42e-4b61-9a8b-5fad55a2e83d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 12:38:27.590192 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-565b7bbf-d42e-4b61-9a8b-5fad55a2e83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:38:27.675168 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b7bbf-d42e-4b61-9a8b-5fad55a2e83d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 12:38:27.732929 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df1a56-52ac-49ed-a333-e0c48d77ad5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cccb366fc6429e9a30d4f9de64e8f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90551d9446e4f2cbd14312d2af9f7c9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 12:38:27.734075 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df1a56-52ac-49ed-a333-e0c48d77ad5d service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 12:38:27.734364 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df1a56-52ac-49ed-a333-e0c48d77ad5d service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 12:38:27.734647 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df1a56-52ac-49ed-a333-e0c48d77ad5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 12:38:27.736465 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b3df1a56-52ac-49ed-a333-e0c48d77ad5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 12:38:27.747471 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df1a56-52ac-49ed-a333-e0c48d77ad5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 12:38:27.749737 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df1a56-52ac-49ed-a333-e0c48d77ad5d service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 12:38:27.759596 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1448/2907] 10.222.0.73 () {60 vars in 1365 bytes} [Thu May 19 12:38:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 12:38:37.755479 dv-cinder-804735-30-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=63 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}